2024-09-21T03:12:39.714 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:12:39.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:12:39.901 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913460' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client dirsize rbytes: false global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMf75Zhw/OmyzHnNP5ksJ7K4EbxL7bBNnXFgzErV3jmTwdzFyZdZ34AscHkGXUmNMhEVcBrVLjIu8QSOzEIjrn8= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3dfJ/OBsTXjhKEnNWPQC/koMdG6jywSALDHIN1U6N8l4it3EEOgEGLUHstySHiKmxqgf2ikMplO9igu9TYuOM= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdLxgCrhazycgwd5esUn+DHdAaJnQ07vHPie0IzTkEIWiqYwFjC29sxHvJlPpCJXWvRHY7rEihq4FWHTYFZqU0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:12:39.901 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:12:39.902 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:12:39.902 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:12:39.904 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:12:39.924 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:12:39.924 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:12:39.924 INFO:teuthology.packaging:ref: None 2024-09-21T03:12:39.924 INFO:teuthology.packaging:tag: None 2024-09-21T03:12:39.924 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:12:39.924 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:12:39.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:12:40.068 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:12:40.070 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:12:40.079 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:12:40.079 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:12:40.258 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:12:40.281 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:12:40.333 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:12:40.353 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:07:36.019651', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMf75Zhw/OmyzHnNP5ksJ7K4EbxL7bBNnXFgzErV3jmTwdzFyZdZ34AscHkGXUmNMhEVcBrVLjIu8QSOzEIjrn8='} 2024-09-21T03:12:40.373 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:07:36.017881', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO3dfJ/OBsTXjhKEnNWPQC/koMdG6jywSALDHIN1U6N8l4it3EEOgEGLUHstySHiKmxqgf2ikMplO9igu9TYuOM='} 2024-09-21T03:12:40.395 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:07:36.020874', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHdLxgCrhazycgwd5esUn+DHdAaJnQ07vHPie0IzTkEIWiqYwFjC29sxHvJlPpCJXWvRHY7rEihq4FWHTYFZqU0='} 2024-09-21T03:12:40.395 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:12:40.438 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T03:12:40.438 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T03:12:40.438 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T03:12:40.438 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:12:40.705 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2037c8160>, signals=[15]) 2024-09-21T03:12:40.705 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:12:40.711 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:12:40.711 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:12:40.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:12:40.788 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-09-21T03:12:40.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:12:40.862 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T03:12:40.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:12:40.936 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:12:40.942 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-21T03:12:40.960 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-21T03:12:40.960 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-21T03:12:41.017 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-21T03:12:41.017 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-21T03:12:41.017 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-21T03:12:41.017 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:12:41.017 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:12:41.018 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:12:41.019 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-21T03:12:41.041 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-09-21T03:12:41.059 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-09-21T03:12:41.060 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:12:41.117 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:12:41.118 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:12:41.118 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-09-21T03:12:41.141 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-09-21T03:12:41.159 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-09-21T03:12:41.160 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-09-21T03:12:41.216 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:12:41.217 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:12:41.218 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:12:41.218 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-09-21T03:12:41.241 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:12:41.251 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:12:41.353 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:12:41.354 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:12:41.356 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:12:41.359 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:12:41.376 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:12:41.407 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:12:41.407 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:12:41.413 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:12:41.416 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:12:41.512 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:12:41.599 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:12:41.674 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:12:41.674 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T03:12:41.674 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T03:12:41.674 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:12:41.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:12:41.691 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-21T03:12:41.749 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:12:41.749 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-21T03:12:41.750 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-21T03:12:44.027 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T03:12:45.728 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-21T03:12:50.504 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 6.4 MB/s | 6.5 MB 00:01 2024-09-21T03:12:51.988 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-21T03:12:52.917 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T03:12:58.298 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-09-21T03:13:00.196 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:13:00.197 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:13:00.302 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T03:13:00.308 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T03:13:00.308 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-21T03:13:00.309 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:00.310 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-21T03:13:00.310 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-21T03:13:00.310 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T03:13:00.558 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 311 kB/s | 36 kB 00:00 2024-09-21T03:13:01.192 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 45 MB/s | 29 MB 00:00 2024-09-21T03:13:01.351 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-21T03:13:01.742 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-21T03:13:01.743 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:13:01.743 INFO:teuthology.orchestra.run.smithi102.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-21T03:13:02.432 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T03:13:02.798 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T03:13:02.798 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T03:13:03.779 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T03:13:03.779 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T03:13:06.189 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T03:13:06.846 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:13:06.943 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:13:09.697 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:13:09.823 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:13:14.623 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:13:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:19.589 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:57.521 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:57.560 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:57.935 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:57.936 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:13:57.936 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:13:57.936 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:13:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:13:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:58.750 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T03:13:58.750 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:13:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:13:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:13:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:13:58.751 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:58.751 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T03:13:59.099 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:13:59.174 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:13:59.175 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:13:59.175 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:13:59.175 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:13:59.175 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:13:59.175 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T03:13:59.175 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:13:59.175 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:13:59.233 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:13:59.233 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:13:59.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:13:59.275 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:13:59.276 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:13:59.277 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:13:59.277 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:13:59.277 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:13:59.924 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-21T03:14:01.244 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:14:01.273 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-21T03:14:01.279 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-21T03:14:01.296 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.0Q6bBOh8pN 2024-09-21T03:14:01.296 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Q6bBOh8pN 2024-09-21T03:14:01.371 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.0Q6bBOh8pN 2024-09-21T03:14:01.510 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.0Q6bBOh8pN is 6KB 2024-09-21T03:14:01.559 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.0Q6bBOh8pN 2024-09-21T03:14:01.573 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:14:01.637 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:14:01.637 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:14:01.637 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:14:01.637 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:14:01.638 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:14:01.792 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-21T03:14:31.795 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T03:14:31.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:14:31.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:14:50.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-21T03:14:59.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:14:59.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:15:02.286 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-21T03:15:14.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:15:14.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:15:46.452 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-21T03:15:46.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:15:46.970 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:15:46.971 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-21T03:15:47.007 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:15:47.007 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:15:47.007 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:15:47.007 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:15:48.008 DEBUG:teuthology.parallel:result is None 2024-09-21T03:15:48.008 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:15:48.023 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:15:48.024 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:15:48.026 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:15:48.029 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:15:48.047 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:15:48.221 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:15:48.320 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:15:48.320 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:15:48.323 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:15:48.325 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:15:48.492 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:15:48.501 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:15:48.501 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:15:48.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:48.519 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:15:48.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:48.536 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:15:48.539 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:15:48.562 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:15:48.609 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.616 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.628 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.649 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.655 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:15:48.657 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:15:48.664 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:15:48.665 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:15:48.667 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:15:48.669 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:15:48.724 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:15:48.744 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:15:48.744 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:15:48.746 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:15:48.749 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:15:48.781 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:48.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:48.888 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:48.966 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:49.010 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:15:49.010 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:15:49.075 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:49.120 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:49.176 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:49.262 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:49.303 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:15:49.303 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:15:49.370 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:49.415 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:15:49.476 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:49.522 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:15:49.563 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:15:49.563 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:15:49.631 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-21T03:15:49.637 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-09-21T03:15:49.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2024-09-21T03:15:49.679 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:15:49.681 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:15:49.717 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:15:50.192 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:15:50.199 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:15:50.199 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:15:50.360 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:15:50.412 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T03:15:50.412 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-21T03:15:50.480 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-21T03:15:50.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-09-21T03:15:50.542 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-09-21T03:15:50.544 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2024-09-21T03:15:50.593 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2024-09-21T03:15:50.595 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:15:50.595 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-21T03:15:50.623 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-21T03:15:50.624 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-09-21T03:15:50.653 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-09-21T03:15:50.653 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2024-09-21T03:15:50.675 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2024-09-21T03:15:50.675 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi102.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:15:50.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:15:50.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:50.702 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:15:50.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:50.730 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:15:50.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:15:50.756 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:15:50.757 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:15:50.789 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:15:50.821 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:15:50.855 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:15:50.865 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T03:15:50.867 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T03:15:51.018 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:15:51.028 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:15:51.029 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi121.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:19:57.483 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2024-09-21T03:19:57.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:19:57.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:19:57.562 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-21T03:19:57.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-21T03:19:57.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-21T03:19:57.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:19:57.722 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-09-21T03:19:57.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-09-21T03:19:57.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T03:19:57.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:19:57.886 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-09-21T03:19:57.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-09-21T03:19:57.927 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:19:57.939 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:19:57.940 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:19:57.940 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:19:57.942 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:19:57.943 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:19:57.945 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:19:57.945 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:19:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:19:57.976 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:19:57.989 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:19:57.992 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:19:57.996 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:19:58.012 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:19:58.015 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-21T03:19:58.018 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-09-21T03:19:58.027 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-21T03:19:58.030 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-09-21T03:19:58.037 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2024-09-21T03:19:58.041 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:19:58.045 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:19:58.048 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2024-09-21T03:19:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:19:58.059 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:19:58.062 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:19:58.077 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:19:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:19:58.115 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:19:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-21T03:19:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.116 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.117 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.120 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.141 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:19:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:19:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T03:19:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.144 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.145 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:19:58.145 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:19:58.154 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:19:58.154 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:19:58.154 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:19:58.154 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:19:58.159 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:19:58.159 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:19:58.160 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:19:58.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:19:58.162 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:19:58.162 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:19:58.163 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:19:58.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:19:58.311 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:19:58.311 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:19:58.319 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:19:58.320 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:19:58.323 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:19:58.323 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:19:58.420 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:19:58.421 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:19:58.421 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:19:58.427 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:19:58.427 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:19:58.427 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:19:58.431 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:19:58.431 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:19:58.432 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:19:58.448 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:19:58.448 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:19:58.454 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:19:58.454 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:19:58.457 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:19:58.457 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:19:58.515 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:19:58.520 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:19:58.523 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:19:58.591 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:19:58.597 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:19:58.598 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:19:58.655 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2024-09-21T03:19:58.656 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2024-09-21T03:19:58.661 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-09-21T03:19:58.663 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-09-21T03:19:58.664 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-21T03:19:58.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-21T03:19:58.882 INFO:teuthology.orchestra.run.smithi148.stdout:45 files removed 2024-09-21T03:19:58.887 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-09-21T03:19:58.889 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-21T03:19:58.909 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:19:58.914 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:19:58.916 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:19:59.451 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-21T03:19:59.453 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T03:19:59.470 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-21T03:19:59.743 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:19:59.745 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 104 kB/s | 24 kB 00:00 2024-09-21T03:19:59.746 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T03:20:00.006 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-21T03:20:00.018 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T03:20:00.029 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T03:20:00.513 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.3 MB 00:00 2024-09-21T03:20:00.813 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T03:20:02.554 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-21T03:20:03.189 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-21T03:20:05.849 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 20 MB 00:02 2024-09-21T03:20:08.015 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 6.5 MB 00:00 2024-09-21T03:20:10.033 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T03:20:10.265 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-21T03:20:11.045 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T03:20:11.726 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-21T03:20:12.522 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-21T03:20:16.392 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T03:20:17.811 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T03:20:18.552 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:18.553 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:18.564 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:20:18.564 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:20:18.565 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:20:18.566 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:20:18.568 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:20:18.570 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:20:18.571 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:20:18.633 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:20:18.646 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:20:18.647 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:20:18.648 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:20:18.649 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:20:18.650 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:20:18.651 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:20:18.652 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:18.653 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:20:18.654 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:20:18.655 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:20:18.656 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:20:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-09-21T03:20:18.658 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-09-21T03:20:18.659 INFO:teuthology.orchestra.run.smithi121.stdout:Install 149 Packages 2024-09-21T03:20:18.659 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 8 Packages 2024-09-21T03:20:18.659 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:20:18.659 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 228 M 2024-09-21T03:20:18.659 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-09-21T03:20:19.443 INFO:teuthology.orchestra.run.smithi121.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-21T03:20:19.660 INFO:teuthology.orchestra.run.smithi121.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.9 MB/s | 873 kB 00:00 2024-09-21T03:20:19.710 INFO:teuthology.orchestra.run.smithi121.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.9 MB/s | 148 kB 00:00 2024-09-21T03:20:19.961 INFO:teuthology.orchestra.run.smithi121.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 8.5 MB/s | 5.5 MB 00:00 2024-09-21T03:20:20.011 INFO:teuthology.orchestra.run.smithi121.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.6 MB/s | 2.3 MB 00:00 2024-09-21T03:20:20.041 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:20.042 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:20.055 INFO:teuthology.orchestra.run.smithi102.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:20:20.056 INFO:teuthology.orchestra.run.smithi102.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:20:20.057 INFO:teuthology.orchestra.run.smithi102.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:20:20.058 INFO:teuthology.orchestra.run.smithi102.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:20:20.060 INFO:teuthology.orchestra.run.smithi102.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:20:20.063 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:20:20.063 INFO:teuthology.orchestra.run.smithi102.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:20:20.101 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-21T03:20:20.103 INFO:teuthology.orchestra.run.smithi121.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-21T03:20:20.126 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:20:20.154 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:20:20.155 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:20:20.156 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:20:20.157 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:20:20.158 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:20:20.159 INFO:teuthology.orchestra.run.smithi102.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:20:20.160 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:20:20.161 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:20:20.162 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:20:20.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:20:20.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:20:20.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:20:20.166 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:Install 149 Packages 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 8 Packages 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 228 M 2024-09-21T03:20:20.167 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-21T03:20:20.486 INFO:teuthology.orchestra.run.smithi121.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T03:20:20.745 INFO:teuthology.orchestra.run.smithi121.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T03:20:20.795 INFO:teuthology.orchestra.run.smithi121.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 505 kB/s | 25 kB 00:00 2024-09-21T03:20:20.888 INFO:teuthology.orchestra.run.smithi102.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-09-21T03:20:21.195 INFO:teuthology.orchestra.run.smithi121.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 16 MB/s | 18 MB 00:01 2024-09-21T03:20:21.272 INFO:teuthology.orchestra.run.smithi102.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.2 MB/s | 873 kB 00:00 2024-09-21T03:20:21.321 INFO:teuthology.orchestra.run.smithi121.stdout:(11/157): ceph-radosgw-19.3.0-5120.g18432218.el 12 MB/s | 10 MB 00:00 2024-09-21T03:20:21.345 INFO:teuthology.orchestra.run.smithi121.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.5 MB/s | 226 kB 00:00 2024-09-21T03:20:21.347 INFO:teuthology.orchestra.run.smithi102.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T03:20:21.371 INFO:teuthology.orchestra.run.smithi121.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T03:20:21.396 INFO:teuthology.orchestra.run.smithi121.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 633 kB/s | 32 kB 00:00 2024-09-21T03:20:21.438 INFO:teuthology.orchestra.run.smithi121.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T03:20:21.463 INFO:teuthology.orchestra.run.smithi121.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T03:20:21.489 INFO:teuthology.orchestra.run.smithi121.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T03:20:21.531 INFO:teuthology.orchestra.run.smithi121.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T03:20:21.598 INFO:teuthology.orchestra.run.smithi121.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 676 kB/s | 45 kB 00:00 2024-09-21T03:20:21.690 INFO:teuthology.orchestra.run.smithi121.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.6 MB/s | 148 kB 00:00 2024-09-21T03:20:21.839 INFO:teuthology.orchestra.run.smithi121.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.3 MB 00:00 2024-09-21T03:20:21.865 INFO:teuthology.orchestra.run.smithi121.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 920 kB/s | 161 kB 00:00 2024-09-21T03:20:21.872 INFO:teuthology.orchestra.run.smithi102.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.4 MB/s | 2.3 MB 00:00 2024-09-21T03:20:21.899 INFO:teuthology.orchestra.run.smithi121.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.2 MB/s | 321 kB 00:00 2024-09-21T03:20:21.924 INFO:teuthology.orchestra.run.smithi121.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 5.1 MB/s | 307 kB 00:00 2024-09-21T03:20:21.950 INFO:teuthology.orchestra.run.smithi121.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:20:21.975 INFO:teuthology.orchestra.run.smithi121.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:20:22.022 INFO:teuthology.orchestra.run.smithi102.stdout:(5/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.2 MB/s | 5.5 MB 00:01 2024-09-21T03:20:22.034 INFO:teuthology.orchestra.run.smithi121.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.8 MB/s | 170 kB 00:00 2024-09-21T03:20:22.109 INFO:teuthology.orchestra.run.smithi121.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T03:20:22.134 INFO:teuthology.orchestra.run.smithi121.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 342 kB/s | 34 kB 00:00 2024-09-21T03:20:22.139 INFO:teuthology.orchestra.run.smithi102.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.7 MB/s | 1.5 MB 00:00 2024-09-21T03:20:22.168 INFO:teuthology.orchestra.run.smithi121.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T03:20:22.801 INFO:teuthology.orchestra.run.smithi121.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T03:20:22.902 INFO:teuthology.orchestra.run.smithi121.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.9 MB/s | 292 kB 00:00 2024-09-21T03:20:23.085 INFO:teuthology.orchestra.run.smithi102.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 4.7 MB/s | 5.0 MB 00:01 2024-09-21T03:20:23.293 INFO:teuthology.orchestra.run.smithi121.stdout:(33/157): ceph-test-19.3.0-5120.g18432218.el9.x 16 MB/s | 40 MB 00:02 2024-09-21T03:20:23.319 INFO:teuthology.orchestra.run.smithi121.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 118 kB/s | 49 kB 00:00 2024-09-21T03:20:23.344 INFO:teuthology.orchestra.run.smithi121.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T03:20:23.478 INFO:teuthology.orchestra.run.smithi121.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 11 MB/s | 14 MB 00:01 2024-09-21T03:20:23.503 INFO:teuthology.orchestra.run.smithi121.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 1.5 MB/s | 285 kB 00:00 2024-09-21T03:20:23.528 INFO:teuthology.orchestra.run.smithi121.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 368 kB/s | 18 kB 00:00 2024-09-21T03:20:23.562 INFO:teuthology.orchestra.run.smithi121.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.5 MB/s | 784 kB 00:00 2024-09-21T03:20:23.645 INFO:teuthology.orchestra.run.smithi121.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-21T03:20:23.648 INFO:teuthology.orchestra.run.smithi102.stdout:(8/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 12 MB/s | 18 MB 00:01 2024-09-21T03:20:23.682 INFO:teuthology.orchestra.run.smithi102.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 761 kB/s | 25 kB 00:00 2024-09-21T03:20:23.687 INFO:teuthology.orchestra.run.smithi121.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-21T03:20:23.729 INFO:teuthology.orchestra.run.smithi121.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-21T03:20:23.754 INFO:teuthology.orchestra.run.smithi121.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-21T03:20:23.780 INFO:teuthology.orchestra.run.smithi121.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T03:20:23.807 INFO:teuthology.orchestra.run.smithi121.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 135 kB 00:00 2024-09-21T03:20:23.833 INFO:teuthology.orchestra.run.smithi121.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.3 MB/s | 125 kB 00:00 2024-09-21T03:20:23.858 INFO:teuthology.orchestra.run.smithi121.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T03:20:23.949 INFO:teuthology.orchestra.run.smithi102.stdout:(10/157): ceph-common-19.3.0-5120.g18432218.el9 6.2 MB/s | 20 MB 00:03 2024-09-21T03:20:23.967 INFO:teuthology.orchestra.run.smithi121.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-09-21T03:20:23.999 INFO:teuthology.orchestra.run.smithi102.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T03:20:24.057 INFO:teuthology.orchestra.run.smithi102.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 465 kB/s | 27 kB 00:00 2024-09-21T03:20:24.067 INFO:teuthology.orchestra.run.smithi121.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-21T03:20:24.108 INFO:teuthology.orchestra.run.smithi102.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 636 kB/s | 32 kB 00:00 2024-09-21T03:20:24.117 INFO:teuthology.orchestra.run.smithi121.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T03:20:24.143 INFO:teuthology.orchestra.run.smithi121.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 609 kB/s | 107 kB 00:00 2024-09-21T03:20:24.185 INFO:teuthology.orchestra.run.smithi121.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-21T03:20:24.210 INFO:teuthology.orchestra.run.smithi121.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T03:20:24.235 INFO:teuthology.orchestra.run.smithi121.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T03:20:24.260 INFO:teuthology.orchestra.run.smithi121.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T03:20:24.286 INFO:teuthology.orchestra.run.smithi121.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T03:20:24.300 INFO:teuthology.orchestra.run.smithi102.stdout:(14/157): ceph-radosgw-19.3.0-5120.g18432218.el 8.6 MB/s | 10 MB 00:01 2024-09-21T03:20:24.311 INFO:teuthology.orchestra.run.smithi121.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T03:20:24.342 INFO:teuthology.orchestra.run.smithi102.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 3.2 MB/s | 766 kB 00:00 2024-09-21T03:20:24.367 INFO:teuthology.orchestra.run.smithi102.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T03:20:24.369 INFO:teuthology.orchestra.run.smithi121.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-21T03:20:24.392 INFO:teuthology.orchestra.run.smithi102.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T03:20:24.395 INFO:teuthology.orchestra.run.smithi121.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-21T03:20:24.420 INFO:teuthology.orchestra.run.smithi121.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T03:20:24.443 INFO:teuthology.orchestra.run.smithi102.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T03:20:24.454 INFO:teuthology.orchestra.run.smithi121.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-21T03:20:24.479 INFO:teuthology.orchestra.run.smithi121.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-21T03:20:24.504 INFO:teuthology.orchestra.run.smithi121.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T03:20:24.518 INFO:teuthology.orchestra.run.smithi102.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 603 kB/s | 45 kB 00:00 2024-09-21T03:20:24.529 INFO:teuthology.orchestra.run.smithi121.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-21T03:20:24.580 INFO:teuthology.orchestra.run.smithi121.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-21T03:20:24.601 INFO:teuthology.orchestra.run.smithi102.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.7 MB/s | 148 kB 00:00 2024-09-21T03:20:24.685 INFO:teuthology.orchestra.run.smithi102.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:20:24.688 INFO:teuthology.orchestra.run.smithi121.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.4 MB/s | 292 kB 00:00 2024-09-21T03:20:24.714 INFO:teuthology.orchestra.run.smithi121.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 209 kB/s | 38 kB 00:00 2024-09-21T03:20:24.785 INFO:teuthology.orchestra.run.smithi102.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.1 MB/s | 321 kB 00:00 2024-09-21T03:20:24.814 INFO:teuthology.orchestra.run.smithi121.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 21 MB/s | 4.9 MB 00:00 2024-09-21T03:20:24.864 INFO:teuthology.orchestra.run.smithi121.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T03:20:24.898 INFO:teuthology.orchestra.run.smithi121.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-21T03:20:24.923 INFO:teuthology.orchestra.run.smithi121.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T03:20:24.990 INFO:teuthology.orchestra.run.smithi121.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-21T03:20:25.024 INFO:teuthology.orchestra.run.smithi121.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-21T03:20:25.057 INFO:teuthology.orchestra.run.smithi121.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T03:20:25.150 INFO:teuthology.orchestra.run.smithi121.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-21T03:20:25.152 INFO:teuthology.orchestra.run.smithi102.stdout:(23/157): ceph-test-19.3.0-5120.g18432218.el9.x 27 MB/s | 40 MB 00:01 2024-09-21T03:20:25.175 INFO:teuthology.orchestra.run.smithi121.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 522 kB/s | 61 kB 00:00 2024-09-21T03:20:25.177 INFO:teuthology.orchestra.run.smithi102.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 782 kB/s | 307 kB 00:00 2024-09-21T03:20:25.200 INFO:teuthology.orchestra.run.smithi121.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-21T03:20:25.203 INFO:teuthology.orchestra.run.smithi102.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T03:20:25.225 INFO:teuthology.orchestra.run.smithi121.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T03:20:25.228 INFO:teuthology.orchestra.run.smithi102.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:20:25.250 INFO:teuthology.orchestra.run.smithi121.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-21T03:20:25.276 INFO:teuthology.orchestra.run.smithi121.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T03:20:25.301 INFO:teuthology.orchestra.run.smithi121.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T03:20:25.303 INFO:teuthology.orchestra.run.smithi102.stdout:(27/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.8 MB/s | 5.3 MB 00:00 2024-09-21T03:20:25.329 INFO:teuthology.orchestra.run.smithi102.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T03:20:25.354 INFO:teuthology.orchestra.run.smithi102.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 680 kB/s | 34 kB 00:00 2024-09-21T03:20:25.359 INFO:teuthology.orchestra.run.smithi121.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 417 kB/s | 35 kB 00:00 2024-09-21T03:20:25.388 INFO:teuthology.orchestra.run.smithi102.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.6 MB/s | 154 kB 00:00 2024-09-21T03:20:25.447 INFO:teuthology.orchestra.run.smithi102.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 13 MB/s | 3.1 MB 00:00 2024-09-21T03:20:25.477 INFO:teuthology.orchestra.run.smithi121.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-21T03:20:25.497 INFO:teuthology.orchestra.run.smithi102.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 5.7 MB/s | 292 kB 00:00 2024-09-21T03:20:25.502 INFO:teuthology.orchestra.run.smithi121.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-21T03:20:25.527 INFO:teuthology.orchestra.run.smithi121.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-09-21T03:20:25.539 INFO:teuthology.orchestra.run.smithi102.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 1.2 MB/s | 49 kB 00:00 2024-09-21T03:20:25.544 INFO:teuthology.orchestra.run.smithi121.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-09-21T03:20:25.561 INFO:teuthology.orchestra.run.smithi121.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 42 kB 00:00 2024-09-21T03:20:25.581 INFO:teuthology.orchestra.run.smithi102.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 397 kB/s | 16 kB 00:00 2024-09-21T03:20:25.628 INFO:teuthology.orchestra.run.smithi121.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-21T03:20:25.631 INFO:teuthology.orchestra.run.smithi102.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T03:20:25.654 INFO:teuthology.orchestra.run.smithi121.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-21T03:20:25.678 INFO:teuthology.orchestra.run.smithi121.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 2.0 MB/s | 269 kB 00:00 2024-09-21T03:20:25.698 INFO:teuthology.orchestra.run.smithi102.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T03:20:25.704 INFO:teuthology.orchestra.run.smithi121.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:20:25.729 INFO:teuthology.orchestra.run.smithi121.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:20:25.740 INFO:teuthology.orchestra.run.smithi102.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 442 kB/s | 18 kB 00:00 2024-09-21T03:20:25.762 INFO:teuthology.orchestra.run.smithi121.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T03:20:25.788 INFO:teuthology.orchestra.run.smithi121.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 710 kB/s | 42 kB 00:00 2024-09-21T03:20:25.813 INFO:teuthology.orchestra.run.smithi121.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-21T03:20:25.838 INFO:teuthology.orchestra.run.smithi121.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T03:20:25.840 INFO:teuthology.orchestra.run.smithi102.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 801 kB/s | 80 kB 00:00 2024-09-21T03:20:25.864 INFO:teuthology.orchestra.run.smithi121.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 715 kB/s | 36 kB 00:00 2024-09-21T03:20:25.889 INFO:teuthology.orchestra.run.smithi121.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-21T03:20:25.914 INFO:teuthology.orchestra.run.smithi121.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T03:20:25.940 INFO:teuthology.orchestra.run.smithi121.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T03:20:25.940 INFO:teuthology.orchestra.run.smithi102.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-21T03:20:25.965 INFO:teuthology.orchestra.run.smithi121.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T03:20:25.982 INFO:teuthology.orchestra.run.smithi102.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T03:20:25.990 INFO:teuthology.orchestra.run.smithi121.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:20:26.015 INFO:teuthology.orchestra.run.smithi121.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T03:20:26.066 INFO:teuthology.orchestra.run.smithi102.stdout:(41/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T03:20:26.091 INFO:teuthology.orchestra.run.smithi102.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-21T03:20:26.116 INFO:teuthology.orchestra.run.smithi121.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-09-21T03:20:26.133 INFO:teuthology.orchestra.run.smithi102.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T03:20:26.175 INFO:teuthology.orchestra.run.smithi102.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-21T03:20:26.217 INFO:teuthology.orchestra.run.smithi102.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T03:20:26.259 INFO:teuthology.orchestra.run.smithi102.stdout:(46/157): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-21T03:20:26.285 INFO:teuthology.orchestra.run.smithi102.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-21T03:20:26.341 INFO:teuthology.orchestra.run.smithi121.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-21T03:20:26.383 INFO:teuthology.orchestra.run.smithi121.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-21T03:20:26.433 INFO:teuthology.orchestra.run.smithi121.stdout:(107/157): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-09-21T03:20:26.459 INFO:teuthology.orchestra.run.smithi121.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-21T03:20:26.484 INFO:teuthology.orchestra.run.smithi121.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 197 kB/s | 19 kB 00:00 2024-09-21T03:20:26.509 INFO:teuthology.orchestra.run.smithi121.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-21T03:20:26.534 INFO:teuthology.orchestra.run.smithi121.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-21T03:20:26.535 INFO:teuthology.orchestra.run.smithi102.stdout:(48/157): ceph-mgr-dashboard-19.3.0-5120.g18432 12 MB/s | 14 MB 00:01 2024-09-21T03:20:26.560 INFO:teuthology.orchestra.run.smithi121.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T03:20:26.585 INFO:teuthology.orchestra.run.smithi121.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T03:20:26.593 INFO:teuthology.orchestra.run.smithi102.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-21T03:20:26.635 INFO:teuthology.orchestra.run.smithi121.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T03:20:26.660 INFO:teuthology.orchestra.run.smithi102.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-09-21T03:20:26.661 INFO:teuthology.orchestra.run.smithi121.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:20:26.677 INFO:teuthology.orchestra.run.smithi102.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-21T03:20:26.686 INFO:teuthology.orchestra.run.smithi121.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:20:26.711 INFO:teuthology.orchestra.run.smithi121.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-21T03:20:26.727 INFO:teuthology.orchestra.run.smithi102.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 555 kB/s | 107 kB 00:00 2024-09-21T03:20:26.736 INFO:teuthology.orchestra.run.smithi121.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T03:20:26.744 INFO:teuthology.orchestra.run.smithi102.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T03:20:26.762 INFO:teuthology.orchestra.run.smithi121.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T03:20:26.770 INFO:teuthology.orchestra.run.smithi102.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T03:20:26.787 INFO:teuthology.orchestra.run.smithi121.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:20:26.795 INFO:teuthology.orchestra.run.smithi102.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T03:20:26.812 INFO:teuthology.orchestra.run.smithi121.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:20:26.820 INFO:teuthology.orchestra.run.smithi102.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T03:20:26.838 INFO:teuthology.orchestra.run.smithi121.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:20:26.863 INFO:teuthology.orchestra.run.smithi121.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T03:20:26.879 INFO:teuthology.orchestra.run.smithi102.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T03:20:26.888 INFO:teuthology.orchestra.run.smithi121.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-21T03:20:26.904 INFO:teuthology.orchestra.run.smithi102.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T03:20:26.914 INFO:teuthology.orchestra.run.smithi121.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 706 kB/s | 18 kB 00:00 2024-09-21T03:20:26.930 INFO:teuthology.orchestra.run.smithi102.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-21T03:20:26.939 INFO:teuthology.orchestra.run.smithi121.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-21T03:20:26.964 INFO:teuthology.orchestra.run.smithi121.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-21T03:20:26.989 INFO:teuthology.orchestra.run.smithi121.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 796 kB/s | 20 kB 00:00 2024-09-21T03:20:27.055 INFO:teuthology.orchestra.run.smithi102.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-21T03:20:27.056 INFO:teuthology.orchestra.run.smithi121.stdout:(129/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-21T03:20:27.080 INFO:teuthology.orchestra.run.smithi102.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-21T03:20:27.082 INFO:teuthology.orchestra.run.smithi121.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:20:27.105 INFO:teuthology.orchestra.run.smithi102.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-21T03:20:27.107 INFO:teuthology.orchestra.run.smithi121.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:20:27.131 INFO:teuthology.orchestra.run.smithi102.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T03:20:27.132 INFO:teuthology.orchestra.run.smithi121.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:20:27.183 INFO:teuthology.orchestra.run.smithi121.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-21T03:20:27.198 INFO:teuthology.orchestra.run.smithi102.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-21T03:20:27.217 INFO:teuthology.orchestra.run.smithi121.stdout:(134/157): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-09-21T03:20:27.223 INFO:teuthology.orchestra.run.smithi102.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-21T03:20:27.242 INFO:teuthology.orchestra.run.smithi121.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-21T03:20:27.248 INFO:teuthology.orchestra.run.smithi102.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-21T03:20:27.267 INFO:teuthology.orchestra.run.smithi121.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-09-21T03:20:27.292 INFO:teuthology.orchestra.run.smithi121.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T03:20:27.318 INFO:teuthology.orchestra.run.smithi121.stdout:(138/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-09-21T03:20:27.343 INFO:teuthology.orchestra.run.smithi121.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-21T03:20:27.357 INFO:teuthology.orchestra.run.smithi102.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-21T03:20:27.368 INFO:teuthology.orchestra.run.smithi121.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T03:20:27.394 INFO:teuthology.orchestra.run.smithi121.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T03:20:27.419 INFO:teuthology.orchestra.run.smithi121.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T03:20:27.444 INFO:teuthology.orchestra.run.smithi121.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-21T03:20:27.469 INFO:teuthology.orchestra.run.smithi121.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T03:20:27.495 INFO:teuthology.orchestra.run.smithi121.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T03:20:27.520 INFO:teuthology.orchestra.run.smithi121.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-21T03:20:27.545 INFO:teuthology.orchestra.run.smithi121.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:20:27.571 INFO:teuthology.orchestra.run.smithi121.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T03:20:27.621 INFO:teuthology.orchestra.run.smithi121.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T03:20:27.649 INFO:teuthology.orchestra.run.smithi102.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-21T03:20:27.788 INFO:teuthology.orchestra.run.smithi121.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T03:20:27.824 INFO:teuthology.orchestra.run.smithi102.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-21T03:20:27.883 INFO:teuthology.orchestra.run.smithi102.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T03:20:27.958 INFO:teuthology.orchestra.run.smithi102.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 6.2 MB/s | 4.4 MB 00:00 2024-09-21T03:20:27.971 INFO:teuthology.orchestra.run.smithi121.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 7.9 MB/s | 3.2 MB 00:00 2024-09-21T03:20:28.025 INFO:teuthology.orchestra.run.smithi102.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.2 MB/s | 4.9 MB 00:00 2024-09-21T03:20:28.043 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:04 2024-09-21T03:20:28.063 INFO:teuthology.orchestra.run.smithi121.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 448 kB/s | 41 kB 00:00 2024-09-21T03:20:28.075 INFO:teuthology.orchestra.run.smithi102.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T03:20:28.126 INFO:teuthology.orchestra.run.smithi102.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-09-21T03:20:28.155 INFO:teuthology.orchestra.run.smithi121.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-21T03:20:28.167 INFO:teuthology.orchestra.run.smithi102.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T03:20:28.251 INFO:teuthology.orchestra.run.smithi102.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-21T03:20:28.255 INFO:teuthology.orchestra.run.smithi121.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.9 MB/s | 1.8 MB 00:00 2024-09-21T03:20:28.322 INFO:teuthology.orchestra.run.smithi121.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.3 MB/s | 2.3 MB 00:00 2024-09-21T03:20:28.335 INFO:teuthology.orchestra.run.smithi102.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-21T03:20:28.364 INFO:teuthology.orchestra.run.smithi121.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 6.5 MB/s | 1.4 MB 00:00 2024-09-21T03:20:28.377 INFO:teuthology.orchestra.run.smithi102.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-21T03:20:28.419 INFO:teuthology.orchestra.run.smithi102.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 460 kB/s | 19 kB 00:00 2024-09-21T03:20:28.502 INFO:teuthology.orchestra.run.smithi102.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T03:20:28.544 INFO:teuthology.orchestra.run.smithi102.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-21T03:20:28.845 INFO:teuthology.orchestra.run.smithi102.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 6.0 MB/s | 5.8 MB 00:00 2024-09-21T03:20:28.920 INFO:teuthology.orchestra.run.smithi102.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 7.1 MB/s | 6.0 MB 00:00 2024-09-21T03:20:28.962 INFO:teuthology.orchestra.run.smithi102.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-21T03:20:28.964 INFO:teuthology.orchestra.run.smithi121.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-21T03:20:28.971 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:20:28.974 INFO:teuthology.orchestra.run.smithi121.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T03:20:29.012 INFO:teuthology.orchestra.run.smithi102.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T03:20:29.062 INFO:teuthology.orchestra.run.smithi102.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-21T03:20:29.088 INFO:teuthology.orchestra.run.smithi102.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-09-21T03:20:29.138 INFO:teuthology.orchestra.run.smithi102.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-21T03:20:29.163 INFO:teuthology.orchestra.run.smithi102.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-09-21T03:20:29.214 INFO:teuthology.orchestra.run.smithi102.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:20:29.264 INFO:teuthology.orchestra.run.smithi102.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:20:29.348 INFO:teuthology.orchestra.run.smithi102.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.3 MB/s | 279 kB 00:00 2024-09-21T03:20:29.448 INFO:teuthology.orchestra.run.smithi102.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.6 MB/s | 5.1 MB 00:00 2024-09-21T03:20:29.465 INFO:teuthology.orchestra.run.smithi102.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-21T03:20:29.490 INFO:teuthology.orchestra.run.smithi102.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T03:20:29.519 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-21T03:20:29.532 INFO:teuthology.orchestra.run.smithi102.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 864 kB/s | 36 kB 00:00 2024-09-21T03:20:29.557 INFO:teuthology.orchestra.run.smithi102.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T03:20:29.574 INFO:teuthology.orchestra.run.smithi102.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T03:20:29.616 INFO:teuthology.orchestra.run.smithi102.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T03:20:29.666 INFO:teuthology.orchestra.run.smithi102.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T03:20:29.692 INFO:teuthology.orchestra.run.smithi102.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-21T03:20:29.709 INFO:teuthology.orchestra.run.smithi102.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-21T03:20:29.734 INFO:teuthology.orchestra.run.smithi102.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-09-21T03:20:29.751 INFO:teuthology.orchestra.run.smithi102.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 533 kB/s | 22 kB 00:00 2024-09-21T03:20:29.809 INFO:teuthology.orchestra.run.smithi102.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T03:20:29.835 INFO:teuthology.orchestra.run.smithi102.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T03:20:29.852 INFO:teuthology.orchestra.run.smithi102.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T03:20:29.969 INFO:teuthology.orchestra.run.smithi102.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-21T03:20:30.002 INFO:teuthology.orchestra.run.smithi102.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-21T03:20:30.019 INFO:teuthology.orchestra.run.smithi102.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-09-21T03:20:30.053 INFO:teuthology.orchestra.run.smithi102.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-21T03:20:30.070 INFO:teuthology.orchestra.run.smithi102.stdout:(112/157): liboath-2.6.7-2.el9.x86_64.rpm 722 kB/s | 49 kB 00:00 2024-09-21T03:20:30.095 INFO:teuthology.orchestra.run.smithi102.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-21T03:20:30.145 INFO:teuthology.orchestra.run.smithi102.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-21T03:20:30.162 INFO:teuthology.orchestra.run.smithi102.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T03:20:30.196 INFO:teuthology.orchestra.run.smithi102.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 960 kB/s | 32 kB 00:00 2024-09-21T03:20:30.226 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-09-21T03:20:30.226 INFO:teuthology.orchestra.run.smithi102.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.2 MB/s | 548 kB 00:00 2024-09-21T03:20:30.246 INFO:teuthology.orchestra.run.smithi102.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-21T03:20:30.280 INFO:teuthology.orchestra.run.smithi102.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-21T03:20:30.314 INFO:teuthology.orchestra.run.smithi102.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T03:20:30.339 INFO:teuthology.orchestra.run.smithi102.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-21T03:20:30.364 INFO:teuthology.orchestra.run.smithi102.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:20:30.366 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-09-21T03:20:30.366 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-09-21T03:20:30.398 INFO:teuthology.orchestra.run.smithi102.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:20:30.423 INFO:teuthology.orchestra.run.smithi102.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T03:20:30.449 INFO:teuthology.orchestra.run.smithi102.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 704 kB/s | 18 kB 00:00 2024-09-21T03:20:30.474 INFO:teuthology.orchestra.run.smithi102.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-21T03:20:30.499 INFO:teuthology.orchestra.run.smithi102.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-21T03:20:30.525 INFO:teuthology.orchestra.run.smithi102.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-21T03:20:30.583 INFO:teuthology.orchestra.run.smithi102.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T03:20:30.631 INFO:teuthology.orchestra.run.smithi102.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 988 kB/s | 46 kB 00:00 2024-09-21T03:20:30.648 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:01 2024-09-21T03:20:30.659 INFO:teuthology.orchestra.run.smithi102.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.8 MB/s | 79 kB 00:00 2024-09-21T03:20:30.693 INFO:teuthology.orchestra.run.smithi102.stdout:(132/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-21T03:20:30.709 INFO:teuthology.orchestra.run.smithi102.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-21T03:20:30.726 INFO:teuthology.orchestra.run.smithi102.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 990 kB/s | 16 kB 00:00 2024-09-21T03:20:30.752 INFO:teuthology.orchestra.run.smithi102.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T03:20:30.777 INFO:teuthology.orchestra.run.smithi102.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T03:20:30.794 INFO:teuthology.orchestra.run.smithi102.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 675 kB/s | 28 kB 00:00 2024-09-21T03:20:30.811 INFO:teuthology.orchestra.run.smithi102.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 919 kB/s | 31 kB 00:00 2024-09-21T03:20:30.828 INFO:teuthology.orchestra.run.smithi102.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-21T03:20:30.853 INFO:teuthology.orchestra.run.smithi102.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-21T03:20:30.870 INFO:teuthology.orchestra.run.smithi102.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-21T03:20:30.895 INFO:teuthology.orchestra.run.smithi102.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T03:20:30.929 INFO:teuthology.orchestra.run.smithi102.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-09-21T03:20:30.963 INFO:teuthology.orchestra.run.smithi102.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-21T03:20:30.980 INFO:teuthology.orchestra.run.smithi102.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-21T03:20:31.005 INFO:teuthology.orchestra.run.smithi102.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T03:20:31.031 INFO:teuthology.orchestra.run.smithi102.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:20:31.089 INFO:teuthology.orchestra.run.smithi102.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T03:20:31.306 INFO:teuthology.orchestra.run.smithi102.stdout:(149/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-09-21T03:20:31.373 INFO:teuthology.orchestra.run.smithi102.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.9 MB/s | 3.4 MB 00:00 2024-09-21T03:20:31.498 INFO:teuthology.orchestra.run.smithi102.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-09-21T03:20:31.549 INFO:teuthology.orchestra.run.smithi102.stdout:(152/157): librbd1-19.3.0-5120.g18432218.el9.x8 6.9 MB/s | 3.2 MB 00:00 2024-09-21T03:20:31.574 INFO:teuthology.orchestra.run.smithi102.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 544 kB/s | 41 kB 00:00 2024-09-21T03:20:31.616 INFO:teuthology.orchestra.run.smithi102.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 7.5 MB/s | 1.8 MB 00:00 2024-09-21T03:20:31.658 INFO:teuthology.orchestra.run.smithi102.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-21T03:20:31.725 INFO:teuthology.orchestra.run.smithi102.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-21T03:20:31.758 INFO:teuthology.orchestra.run.smithi102.stdout:(157/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.2 MB/s | 249 kB 00:00 2024-09-21T03:20:31.763 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:20:31.763 INFO:teuthology.orchestra.run.smithi102.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-21T03:20:32.183 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-09-21T03:20:32.184 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-09-21T03:20:33.011 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-21T03:20:33.165 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-21T03:20:33.165 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-21T03:20:35.378 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-21T03:20:35.379 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-21T03:20:36.112 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T03:20:38.272 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:38.273 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:20:38.284 INFO:teuthology.orchestra.run.smithi148.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:20:38.285 INFO:teuthology.orchestra.run.smithi148.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:20:38.286 INFO:teuthology.orchestra.run.smithi148.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:20:38.287 INFO:teuthology.orchestra.run.smithi148.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:20:38.289 INFO:teuthology.orchestra.run.smithi148.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:20:38.291 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:20:38.292 INFO:teuthology.orchestra.run.smithi148.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:20:38.355 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2024-09-21T03:20:38.374 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T03:20:38.374 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:20:38.375 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:20:38.376 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:20:38.377 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:20:38.378 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:20:38.379 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:20:38.380 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:20:38.381 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:20:38.382 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:20:38.383 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:20:38.384 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:20:38.385 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:20:38.386 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:======================================================================================= 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:Install 149 Packages 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 8 Packages 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:20:38.387 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 228 M 2024-09-21T03:20:38.388 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2024-09-21T03:20:38.565 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-09-21T03:20:38.701 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:20:38.739 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:20:38.801 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:20:38.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:20:38.860 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:20:38.903 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:20:39.238 INFO:teuthology.orchestra.run.smithi148.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-21T03:20:39.243 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:20:39.361 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:39.422 INFO:teuthology.orchestra.run.smithi148.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.7 MB/s | 873 kB 00:00 2024-09-21T03:20:39.504 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:39.514 INFO:teuthology.orchestra.run.smithi148.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T03:20:39.537 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:39.589 INFO:teuthology.orchestra.run.smithi148.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T03:20:39.613 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:39.642 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:20:39.672 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:20:39.681 INFO:teuthology.orchestra.run.smithi148.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T03:20:39.731 INFO:teuthology.orchestra.run.smithi148.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T03:20:39.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:20:39.881 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:20:39.909 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:39.956 INFO:teuthology.orchestra.run.smithi148.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 18 MB/s | 5.0 MB 00:00 2024-09-21T03:20:40.015 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:40.044 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:40.106 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:40.137 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:20:40.160 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:20:40.273 INFO:teuthology.orchestra.run.smithi148.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 17 MB/s | 20 MB 00:01 2024-09-21T03:20:40.315 INFO:teuthology.orchestra.run.smithi148.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 609 kB/s | 25 kB 00:00 2024-09-21T03:20:40.330 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:20:40.467 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:20:40.593 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:20:40.696 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:40.707 INFO:teuthology.orchestra.run.smithi148.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 18 MB/s | 18 MB 00:00 2024-09-21T03:20:40.766 INFO:teuthology.orchestra.run.smithi148.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T03:20:40.778 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:40.833 INFO:teuthology.orchestra.run.smithi148.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 406 kB/s | 27 kB 00:00 2024-09-21T03:20:40.950 INFO:teuthology.orchestra.run.smithi148.stdout:(13/157): ceph-radosgw-19.3.0-5120.g18432218.el 10 MB/s | 10 MB 00:00 2024-09-21T03:20:40.975 INFO:teuthology.orchestra.run.smithi148.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 224 kB/s | 32 kB 00:00 2024-09-21T03:20:40.998 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:41.025 INFO:teuthology.orchestra.run.smithi148.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 10 MB/s | 766 kB 00:00 2024-09-21T03:20:41.050 INFO:teuthology.orchestra.run.smithi148.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T03:20:41.084 INFO:teuthology.orchestra.run.smithi148.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.1 MB/s | 127 kB 00:00 2024-09-21T03:20:41.112 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:20:41.140 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:20:41.142 INFO:teuthology.orchestra.run.smithi148.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T03:20:41.176 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:20:41.184 INFO:teuthology.orchestra.run.smithi148.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 1.1 MB/s | 45 kB 00:00 2024-09-21T03:20:41.243 INFO:teuthology.orchestra.run.smithi148.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.5 MB/s | 148 kB 00:00 2024-09-21T03:20:41.250 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:20:41.302 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:20:41.310 INFO:teuthology.orchestra.run.smithi148.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.4 MB/s | 161 kB 00:00 2024-09-21T03:20:41.342 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:20:41.385 INFO:teuthology.orchestra.run.smithi148.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 4.2 MB/s | 321 kB 00:00 2024-09-21T03:20:41.386 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:20:41.418 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:20:41.446 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:20:41.460 INFO:teuthology.orchestra.run.smithi148.stdout:(23/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T03:20:41.486 INFO:teuthology.orchestra.run.smithi148.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T03:20:41.515 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:20:41.519 INFO:teuthology.orchestra.run.smithi148.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T03:20:41.545 INFO:teuthology.orchestra.run.smithi148.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T03:20:41.572 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:20:41.595 INFO:teuthology.orchestra.run.smithi148.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T03:20:41.602 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:20:41.638 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:20:41.654 INFO:teuthology.orchestra.run.smithi148.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 588 kB/s | 34 kB 00:00 2024-09-21T03:20:41.712 INFO:teuthology.orchestra.run.smithi148.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 16 MB/s | 3.1 MB 00:00 2024-09-21T03:20:41.720 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:20:41.737 INFO:teuthology.orchestra.run.smithi148.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.8 MB/s | 154 kB 00:00 2024-09-21T03:20:41.757 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:20:41.769 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-21T03:20:41.800 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:20:41.829 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:20:41.899 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:20:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:20:41.952 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:20:41.952 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:20:42.026 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:20:42.029 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:20:42.063 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:20:42.097 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:20:42.160 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:20:42.162 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:20:42.212 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:20:42.238 INFO:teuthology.orchestra.run.smithi148.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 21 MB/s | 40 MB 00:01 2024-09-21T03:20:42.296 INFO:teuthology.orchestra.run.smithi148.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T03:20:42.405 INFO:teuthology.orchestra.run.smithi148.stdout:(33/157): ceph-mgr-diskprediction-local-19.3.0- 11 MB/s | 7.4 MB 00:00 2024-09-21T03:20:42.430 INFO:teuthology.orchestra.run.smithi148.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 370 kB/s | 49 kB 00:00 2024-09-21T03:20:42.455 INFO:teuthology.orchestra.run.smithi148.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T03:20:42.489 INFO:teuthology.orchestra.run.smithi148.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 4.7 MB/s | 285 kB 00:00 2024-09-21T03:20:42.509 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:20:42.523 INFO:teuthology.orchestra.run.smithi148.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T03:20:42.548 INFO:teuthology.orchestra.run.smithi148.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 315 kB/s | 18 kB 00:00 2024-09-21T03:20:42.633 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:42.734 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:20:42.742 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:42.776 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:42.782 INFO:teuthology.orchestra.run.smithi148.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T03:20:42.807 INFO:teuthology.orchestra.run.smithi148.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 281 kB/s | 80 kB 00:00 2024-09-21T03:20:42.816 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:20:42.846 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:20:42.849 INFO:teuthology.orchestra.run.smithi148.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-21T03:20:42.867 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:42.875 INFO:teuthology.orchestra.run.smithi148.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-21T03:20:42.889 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:20:42.897 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:20:42.917 INFO:teuthology.orchestra.run.smithi148.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T03:20:42.927 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:20:42.927 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:20:42.942 INFO:teuthology.orchestra.run.smithi148.stdout:(44/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.8 MB/s | 253 kB 00:00 2024-09-21T03:20:42.967 INFO:teuthology.orchestra.run.smithi148.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T03:20:42.985 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:20:42.992 INFO:teuthology.orchestra.run.smithi148.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-21T03:20:43.034 INFO:teuthology.orchestra.run.smithi148.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-09-21T03:20:43.060 INFO:teuthology.orchestra.run.smithi148.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T03:20:43.104 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:20:43.138 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:20:43.161 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:20:43.188 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:20:43.189 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:43.193 INFO:teuthology.orchestra.run.smithi148.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-09-21T03:20:43.252 INFO:teuthology.orchestra.run.smithi148.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-21T03:20:43.269 INFO:teuthology.orchestra.run.smithi148.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-21T03:20:43.279 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:20:43.296 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:43.310 INFO:teuthology.orchestra.run.smithi148.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-21T03:20:43.323 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:43.327 INFO:teuthology.orchestra.run.smithi148.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T03:20:43.343 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:20:43.361 INFO:teuthology.orchestra.run.smithi148.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T03:20:43.369 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:43.392 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:20:43.411 INFO:teuthology.orchestra.run.smithi148.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-09-21T03:20:43.415 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:20:43.425 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:20:43.457 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:20:43.487 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:20:43.512 INFO:teuthology.orchestra.run.smithi148.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T03:20:43.533 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:20:43.562 INFO:teuthology.orchestra.run.smithi148.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T03:20:43.568 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:20:43.569 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:20:43.613 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:20:43.620 INFO:teuthology.orchestra.run.smithi148.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-09-21T03:20:43.654 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:20:43.746 INFO:teuthology.orchestra.run.smithi148.stdout:(59/157): flexiblas-openblas-openmp-3.0.4-8.el9 44 kB/s | 18 kB 00:00 2024-09-21T03:20:43.752 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:20:43.790 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:20:43.796 INFO:teuthology.orchestra.run.smithi148.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-21T03:20:43.832 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:20:43.846 INFO:teuthology.orchestra.run.smithi148.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-21T03:20:43.873 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:20:43.888 INFO:teuthology.orchestra.run.smithi148.stdout:(62/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-21T03:20:43.913 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:20:43.938 INFO:teuthology.orchestra.run.smithi148.stdout:(63/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.8 MB/s | 3.0 MB 00:00 2024-09-21T03:20:43.977 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:20:43.997 INFO:teuthology.orchestra.run.smithi148.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T03:20:44.022 INFO:teuthology.orchestra.run.smithi148.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-21T03:20:44.029 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:44.047 INFO:teuthology.orchestra.run.smithi148.stdout:(66/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-21T03:20:44.073 INFO:teuthology.orchestra.run.smithi148.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-21T03:20:44.090 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:20:44.108 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:44.290 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:20:44.323 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:20:44.335 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:20:44.339 INFO:teuthology.orchestra.run.smithi148.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 6.0 MB/s | 1.6 MB 00:00 2024-09-21T03:20:44.347 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:20:44.427 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:20:44.450 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:20:44.488 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:20:44.523 INFO:teuthology.orchestra.run.smithi148.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 4.9 MB/s | 910 kB 00:00 2024-09-21T03:20:44.530 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:20:44.550 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:20:44.573 INFO:teuthology.orchestra.run.smithi148.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-21T03:20:44.595 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:20:44.604 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:20:44.632 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:20:44.648 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:20:44.666 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:20:44.680 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:20:44.705 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:20:44.723 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:20:44.737 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:20:44.749 INFO:teuthology.orchestra.run.smithi148.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.8 MB/s | 4.9 MB 00:00 2024-09-21T03:20:44.757 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:20:44.767 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:20:44.784 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:20:44.801 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:20:44.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:20:44.853 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:20:44.876 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:20:44.906 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:20:44.911 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:20:44.924 INFO:teuthology.orchestra.run.smithi148.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-09-21T03:20:44.946 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:20:44.983 INFO:teuthology.orchestra.run.smithi148.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-09-21T03:20:44.988 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:20:44.989 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:20:45.008 INFO:teuthology.orchestra.run.smithi148.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T03:20:45.033 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:20:45.058 INFO:teuthology.orchestra.run.smithi148.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T03:20:45.064 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:20:45.070 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:20:45.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:20:45.117 INFO:teuthology.orchestra.run.smithi148.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T03:20:45.151 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:20:45.169 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:20:45.175 INFO:teuthology.orchestra.run.smithi148.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T03:20:45.180 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:20:45.224 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:20:45.226 INFO:teuthology.orchestra.run.smithi148.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T03:20:45.247 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:20:45.276 INFO:teuthology.orchestra.run.smithi148.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 384 kB/s | 19 kB 00:00 2024-09-21T03:20:45.294 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:20:45.335 INFO:teuthology.orchestra.run.smithi148.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T03:20:45.368 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:20:45.393 INFO:teuthology.orchestra.run.smithi148.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 596 kB/s | 35 kB 00:00 2024-09-21T03:20:45.508 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:20:45.564 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:20:45.610 INFO:teuthology.orchestra.run.smithi148.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 5.6 MB/s | 5.8 MB 00:01 2024-09-21T03:20:45.710 INFO:teuthology.orchestra.run.smithi148.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-09-21T03:20:45.794 INFO:teuthology.orchestra.run.smithi148.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-21T03:20:45.844 INFO:teuthology.orchestra.run.smithi148.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T03:20:45.895 INFO:teuthology.orchestra.run.smithi148.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-21T03:20:45.948 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:20:45.978 INFO:teuthology.orchestra.run.smithi148.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-21T03:20:45.996 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:20:46.029 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:20:46.036 INFO:teuthology.orchestra.run.smithi148.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-21T03:20:46.073 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:20:46.141 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:20:46.145 INFO:teuthology.orchestra.run.smithi148.stdout:(89/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.8 MB/s | 5.1 MB 00:00 2024-09-21T03:20:46.158 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:20:46.170 INFO:teuthology.orchestra.run.smithi148.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T03:20:46.194 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:20:46.196 INFO:teuthology.orchestra.run.smithi148.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T03:20:46.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:20:46.221 INFO:teuthology.orchestra.run.smithi148.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T03:20:46.231 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:20:46.240 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:20:46.269 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:20:46.288 INFO:teuthology.orchestra.run.smithi148.stdout:(93/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2024-09-21T03:20:46.312 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:20:46.313 INFO:teuthology.orchestra.run.smithi148.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-21T03:20:46.329 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:20:46.338 INFO:teuthology.orchestra.run.smithi148.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-21T03:20:46.359 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:20:46.372 INFO:teuthology.orchestra.run.smithi148.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T03:20:46.397 INFO:teuthology.orchestra.run.smithi148.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-09-21T03:20:46.423 INFO:teuthology.orchestra.run.smithi148.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T03:20:46.462 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:20:46.473 INFO:teuthology.orchestra.run.smithi148.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T03:20:46.498 INFO:teuthology.orchestra.run.smithi148.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.0 MB/s | 304 kB 00:00 2024-09-21T03:20:46.514 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:20:46.523 INFO:teuthology.orchestra.run.smithi148.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T03:20:46.543 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:20:46.549 INFO:teuthology.orchestra.run.smithi148.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:20:46.573 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:20:46.582 INFO:teuthology.orchestra.run.smithi148.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-09-21T03:20:46.604 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:20:46.642 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:20:46.649 INFO:teuthology.orchestra.run.smithi148.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 221 kB/s | 22 kB 00:00 2024-09-21T03:20:46.670 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:20:46.700 INFO:teuthology.orchestra.run.smithi148.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T03:20:46.725 INFO:teuthology.orchestra.run.smithi148.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T03:20:46.742 INFO:teuthology.orchestra.run.smithi148.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-21T03:20:46.742 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:20:46.775 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:20:46.809 INFO:teuthology.orchestra.run.smithi148.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-21T03:20:46.811 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:20:46.857 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:20:46.884 INFO:teuthology.orchestra.run.smithi148.stdout:(109/157): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-21T03:20:46.893 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:20:46.909 INFO:teuthology.orchestra.run.smithi148.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T03:20:46.935 INFO:teuthology.orchestra.run.smithi148.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-21T03:20:46.935 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:20:46.951 INFO:teuthology.orchestra.run.smithi148.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-21T03:20:46.977 INFO:teuthology.orchestra.run.smithi148.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.5 MB/s | 151 kB 00:00 2024-09-21T03:20:46.978 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:20:47.011 INFO:teuthology.orchestra.run.smithi148.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T03:20:47.036 INFO:teuthology.orchestra.run.smithi148.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:20:47.061 INFO:teuthology.orchestra.run.smithi148.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T03:20:47.095 INFO:teuthology.orchestra.run.smithi148.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-21T03:20:47.114 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:20:47.120 INFO:teuthology.orchestra.run.smithi148.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-21T03:20:47.155 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:20:47.170 INFO:teuthology.orchestra.run.smithi148.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-21T03:20:47.196 INFO:teuthology.orchestra.run.smithi148.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-21T03:20:47.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:20:47.221 INFO:teuthology.orchestra.run.smithi148.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:20:47.246 INFO:teuthology.orchestra.run.smithi148.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:20:47.280 INFO:teuthology.orchestra.run.smithi148.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-21T03:20:47.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:20:47.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:20:47.305 INFO:teuthology.orchestra.run.smithi148.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-21T03:20:47.330 INFO:teuthology.orchestra.run.smithi148.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-21T03:20:47.331 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:20:47.355 INFO:teuthology.orchestra.run.smithi148.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-21T03:20:47.381 INFO:teuthology.orchestra.run.smithi148.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-21T03:20:47.406 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:20:47.406 INFO:teuthology.orchestra.run.smithi148.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 783 kB/s | 20 kB 00:00 2024-09-21T03:20:47.465 INFO:teuthology.orchestra.run.smithi148.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.4 MB/s | 2.0 MB 00:00 2024-09-21T03:20:47.490 INFO:teuthology.orchestra.run.smithi148.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:20:47.515 INFO:teuthology.orchestra.run.smithi148.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:20:47.540 INFO:teuthology.orchestra.run.smithi148.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:20:47.559 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:20:47.574 INFO:teuthology.orchestra.run.smithi148.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-21T03:20:47.600 INFO:teuthology.orchestra.run.smithi148.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T03:20:47.625 INFO:teuthology.orchestra.run.smithi148.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T03:20:47.650 INFO:teuthology.orchestra.run.smithi148.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-21T03:20:47.675 INFO:teuthology.orchestra.run.smithi148.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:20:47.701 INFO:teuthology.orchestra.run.smithi148.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-21T03:20:47.726 INFO:teuthology.orchestra.run.smithi148.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:20:47.743 INFO:teuthology.orchestra.run.smithi148.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-21T03:20:47.768 INFO:teuthology.orchestra.run.smithi148.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-09-21T03:20:47.788 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:20:47.793 INFO:teuthology.orchestra.run.smithi148.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:20:47.813 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:20:47.819 INFO:teuthology.orchestra.run.smithi148.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:20:47.844 INFO:teuthology.orchestra.run.smithi148.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T03:20:47.869 INFO:teuthology.orchestra.run.smithi148.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 800 kB/s | 20 kB 00:00 2024-09-21T03:20:47.895 INFO:teuthology.orchestra.run.smithi148.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T03:20:47.902 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:20:47.920 INFO:teuthology.orchestra.run.smithi148.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:20:47.970 INFO:teuthology.orchestra.run.smithi148.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T03:20:48.031 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:20:48.070 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:20:48.107 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:20:48.149 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:20:48.162 INFO:teuthology.orchestra.run.smithi148.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T03:20:48.196 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:20:48.228 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:20:48.246 INFO:teuthology.orchestra.run.smithi148.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T03:20:48.261 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:20:48.296 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:20:48.337 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:20:48.346 INFO:teuthology.orchestra.run.smithi148.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-21T03:20:48.379 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:20:48.388 INFO:teuthology.orchestra.run.smithi148.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 982 kB/s | 41 kB 00:00 2024-09-21T03:20:48.422 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:20:48.438 INFO:teuthology.orchestra.run.smithi148.stdout:(153/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.4 MB/s | 1.8 MB 00:00 2024-09-21T03:20:48.463 INFO:teuthology.orchestra.run.smithi148.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T03:20:48.497 INFO:teuthology.orchestra.run.smithi148.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-21T03:20:48.508 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:20:48.552 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:20:48.555 INFO:teuthology.orchestra.run.smithi148.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-09-21T03:20:48.583 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:20:48.621 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:20:48.685 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:20:48.703 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:20:48.730 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:20:48.743 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:20:48.764 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:20:48.764 INFO:teuthology.orchestra.run.smithi148.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-09-21T03:20:48.769 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:20:48.769 INFO:teuthology.orchestra.run.smithi148.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T03:20:49.089 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:20:49.135 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:20:49.227 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:20:49.257 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:20:49.292 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:20:49.461 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:20:49.523 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:20:49.557 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:20:49.666 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:20:49.721 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:20:49.773 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:20:49.793 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:20:49.851 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:20:49.880 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:20:49.893 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:20:49.951 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:20:49.997 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2024-09-21T03:20:50.006 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:20:50.077 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:20:50.107 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:20:50.149 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2024-09-21T03:20:50.149 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2024-09-21T03:20:50.185 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:20:50.834 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:20:50.956 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:20:51.969 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2024-09-21T03:20:51.969 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2024-09-21T03:20:52.232 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:20:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:20:52.391 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:20:52.424 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:20:52.585 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:52.620 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:52.757 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:20:52.812 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:20:52.912 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:20:52.942 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:20:52.978 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:20:53.189 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:53.223 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:20:53.317 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:20:53.317 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:20:53.317 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:20:53.317 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:20:53.349 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:20:53.474 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:20:53.499 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:20:53.569 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:20:53.600 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:20:56.161 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:56.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:56.771 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:20:56.809 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:20:56.900 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:20:56.900 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:20:56.900 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:20:56.900 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:20:56.943 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:20:58.395 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2024-09-21T03:20:58.493 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:20:58.531 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:20:58.584 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:20:58.618 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:20:58.644 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:20:58.687 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:20:59.025 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:20:59.153 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:59.279 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:20:59.312 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:59.395 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:20:59.425 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:20:59.455 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:20:59.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:20:59.673 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:20:59.701 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:59.807 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:20:59.835 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:59.898 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:20:59.921 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:20:59.944 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:21:00.139 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:21:00.289 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:21:00.401 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:21:00.521 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:21:00.594 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:21:00.814 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:21:00.923 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:21:00.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:21:00.983 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:21:01.056 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:21:01.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:21:01.140 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:21:01.187 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:21:01.220 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:21:01.248 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:21:01.317 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:21:01.370 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:21:01.400 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:21:01.468 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:21:01.718 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:21:01.905 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:21:01.948 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:21:01.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:21:02.048 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:21:02.091 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:21:02.167 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:21:02.311 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:21:02.370 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:21:02.905 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:21:02.990 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:21:03.018 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:21:03.061 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:21:03.100 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:21:03.141 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:21:03.299 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:21:03.369 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:21:03.461 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:21:03.543 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:21:03.615 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:21:03.646 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:21:03.682 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:21:03.737 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:21:03.773 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:21:03.833 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:21:03.875 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:21:04.014 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:21:04.068 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:21:04.110 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:21:04.213 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:21:04.251 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:21:04.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:21:04.316 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:21:04.341 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:21:04.418 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:21:04.544 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:21:04.590 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:21:04.618 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:21:04.652 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:21:04.691 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:21:04.723 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:21:04.753 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:21:04.787 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:21:04.821 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:21:04.862 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:21:04.888 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:21:04.976 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:21:05.027 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:21:05.058 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:21:05.163 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-09-21T03:21:05.210 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:05.242 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:21:05.385 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:05.402 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:05.402 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:05.402 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:21:05.402 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:05.987 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:21:06.031 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:21:06.064 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:21:06.167 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:21:06.211 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:21:06.257 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:21:06.354 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:21:06.401 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:21:06.586 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:21:06.614 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:21:06.692 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:21:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:07.009 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:07.010 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:07.010 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:21:07.010 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:07.010 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:07.010 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:07.248 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:07.273 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:07.353 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:21:07.464 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:21:07.741 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:07.764 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:07.765 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:07.765 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:21:07.765 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:07.765 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:07.765 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:07.871 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:21:07.928 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:21:07.983 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:21:08.187 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:21:08.233 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:21:08.311 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:21:08.408 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:21:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:21:08.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:21:08.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:21:08.660 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:21:08.721 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:21:08.803 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:21:08.831 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:21:08.864 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:21:08.864 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:21:08.864 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-21T03:21:08.864 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-21T03:21:08.864 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-21T03:21:08.865 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-21T03:21:08.865 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-21T03:21:08.865 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-21T03:21:08.865 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-21T03:21:08.865 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:09.049 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:21:09.065 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:09.103 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:09.134 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:09.166 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:21:09.194 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:21:09.232 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:21:09.243 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:21:09.257 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:09.343 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:21:09.373 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:21:09.409 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:21:09.909 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:21:09.938 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:21:10.009 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:21:10.039 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:21:10.644 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:10.671 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:10.671 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:10.671 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:21:10.671 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:10.672 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:10.672 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:10.903 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:10.927 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:11.395 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:11.419 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:11.525 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:21:11.581 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:21:11.637 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:21:11.829 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:21:11.871 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:21:11.940 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:21:12.028 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:21:12.167 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:21:12.204 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:21:12.236 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:21:12.264 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:21:12.319 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:21:12.353 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:21:12.464 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:12.513 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:12.735 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:12.763 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:12.795 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:21:12.860 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:21:12.894 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:12.922 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:21:12.964 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:21:13.060 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:21:13.060 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:21:13.060 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:21:13.060 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:13.090 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:21:13.471 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:13.496 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:13.612 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:13.788 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:21:13.824 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:13.848 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:13.899 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:13.911 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:14.010 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:21:14.064 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:21:15.026 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:21:15.083 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:15.107 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:15.107 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:15.107 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:21:15.107 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:15.107 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:15.108 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:15.153 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:15.176 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:15.176 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:15.176 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:21:15.176 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:15.228 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:15.252 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:15.579 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:15.602 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:15.602 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:15.603 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:21:15.603 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:15.603 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:15.603 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:17.073 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:17.101 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:17.214 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:17.384 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:21:17.411 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:17.435 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:17.436 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:17.436 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:21:17.436 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:17.436 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:17.436 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:17.479 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:17.490 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:17.588 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:21:17.642 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:21:18.603 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:21:18.631 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:18.655 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:18.698 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:18.721 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:18.721 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:18.721 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:21:18.721 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:18.766 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:18.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:19.125 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:19.148 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:19.583 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:21:19.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:21:19.665 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:21:19.697 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:21:19.724 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:21:19.916 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:21:19.963 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:21:19.993 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:21:20.023 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:21:20.060 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:21:20.698 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:20.742 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:20.762 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:21.608 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:21:21.705 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:21:21.746 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:21:21.830 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:21:21.867 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:21:21.892 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:21:21.926 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:21:21.927 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:22.010 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:22.011 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:22.114 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:22.145 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:21:22.150 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:22.150 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:22.330 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:22.330 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:22.414 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:22.477 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:23.224 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:21:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:21:23.303 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:21:23.334 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:21:23.362 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:21:23.588 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:21:23.634 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:21:23.664 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:21:23.693 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:21:23.740 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:21:24.367 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:24.405 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:24.425 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:25.057 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:21:25.057 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2024-09-21T03:21:25.057 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2024-09-21T03:21:25.058 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:25.235 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:25.237 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:21:25.252 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:21:25.252 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:25.252 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:21:25.252 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:25.326 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:21:25.376 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:21:25.476 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:21:25.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:21:25.538 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:21:25.572 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:21:25.572 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:25.665 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:25.665 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:25.757 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:25.782 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:21:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:25.788 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:25.967 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:26.051 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:26.124 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:26.855 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:26.881 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:21:26.882 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:26.882 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:21:26.882 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:26.882 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:21:26.882 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:27.105 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:27.128 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:21:27.129 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:27.129 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:21:27.129 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:27.129 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:21:27.129 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:27.598 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:27.621 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:21:27.622 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:27.622 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:21:27.622 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:27.622 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:21:27.622 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:27.736 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:21:27.802 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:21:27.858 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:21:28.047 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:21:28.099 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:21:28.178 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:21:28.267 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:21:28.407 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:21:28.448 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:21:28.480 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:21:28.508 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:21:28.695 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:21:28.696 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:21:28.697 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:21:28.698 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:21:28.699 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:21:28.700 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:21:28.701 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:21:28.702 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:21:28.703 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:21:28.704 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:21:28.705 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:21:28.706 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:21:28.707 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:21:28.708 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:21:28.977 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:28.999 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:21:29.023 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:21:29.089 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:21:29.113 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:31.482 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.483 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.484 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:21:31.485 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:21:31.486 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:21:31.487 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:21:31.488 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:21:31.489 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:21:31.490 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:21:31.491 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:21:31.492 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:21:31.493 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:21:31.494 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-09-21T03:21:31.901 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:32.340 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:21:32.411 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:32.550 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:32.550 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:21:32.550 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:21:32.550 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:21:32.551 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:21:32.552 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:21:32.553 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:21:32.554 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:21:32.555 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:21:32.556 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:21:32.557 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:21:32.558 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:21:32.559 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:21:32.560 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:21:32.561 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:21:32.562 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:21:32.563 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:21:32.564 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:21:33.377 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:21:33.403 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:33.518 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:21:33.679 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:21:33.704 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:21:33.729 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:33.780 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:33.792 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:21:33.899 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:21:33.954 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:21:34.918 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:21:34.949 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:21:34.973 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:35.016 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:35.039 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:21:35.040 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:35.040 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:21:35.040 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:35.092 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:35.115 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:21:35.115 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:35.115 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:21:35.116 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:35.116 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:21:35.116 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:35.214 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:35.214 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-21T03:21:35.215 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.216 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.217 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.218 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:21:35.219 INFO:teuthology.orchestra.run.smithi102.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:21:35.220 INFO:teuthology.orchestra.run.smithi102.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:21:35.220 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:21:35.221 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:21:35.222 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:21:35.223 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:21:35.224 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:21:35.225 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:21:35.226 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:21:35.227 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:21:35.228 INFO:teuthology.orchestra.run.smithi102.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:21:35.228 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:21:35.228 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-21T03:21:35.434 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:21:35.458 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:35.671 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:39.438 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:21:39.479 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:21:39.529 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:21:39.560 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:21:39.588 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:21:39.772 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:21:39.818 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:21:39.848 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:21:39.878 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:21:39.924 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:21:40.496 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:40.530 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:40.551 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:21:41.417 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:21:41.493 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:21:41.534 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:21:41.616 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:21:41.646 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:21:41.671 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:21:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:21:41.697 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:41.789 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:21:41.789 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:41.882 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:21:41.907 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:21:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:41.913 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:42.100 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:21:42.100 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:42.185 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:21:42.248 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:48.612 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:48.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:21:48.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:21:48.612 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:21:48.613 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:21:48.614 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:21:48.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:21:48.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:21:48.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:21:48.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:21:48.615 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:21:48.628 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:21:48.629 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:21:48.630 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:21:48.631 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:21:48.632 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:21:48.633 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:21:48.634 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:21:48.635 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:21:48.636 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:21:48.637 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:21:48.638 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:21:48.639 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:21:51.200 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.201 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.202 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:21:51.203 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:21:51.204 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:21:51.205 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:21:51.206 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:21:51.207 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:21:51.208 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:21:51.209 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:21:51.210 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:21:51.211 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:21:51.212 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2024-09-21T03:21:51.630 DEBUG:teuthology.parallel:result is None 2024-09-21T03:21:51.631 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:51.775 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:21:51.801 INFO:teuthology.orchestra.run.smithi102.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:21:51.801 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:21:51.801 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:21:51.803 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:51.937 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:21:51.964 INFO:teuthology.orchestra.run.smithi121.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:21:51.964 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:21:51.965 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:21:51.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:52.109 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:21:52.138 INFO:teuthology.orchestra.run.smithi148.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:21:52.138 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:21:52.138 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:21:52.140 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:21:52.140 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:21:52.140 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:21:52.172 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:21:52.172 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:21:52.204 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:21:52.204 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:21:52.237 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:21:52.237 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:21:52.237 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:21:52.266 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:21:52.332 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:21:52.332 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:21:52.362 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:21:52.431 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:21:52.431 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:21:52.461 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:21:52.531 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:21:52.531 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:21:52.531 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:21:52.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:21:52.620 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:21:52.621 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:21:52.648 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:21:52.712 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:21:52.712 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:21:52.741 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:21:52.809 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:21:52.809 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:21:52.809 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:21:52.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:21:52.899 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:21:52.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:21:52.924 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:21:52.989 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:21:52.989 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:21:53.019 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:21:53.089 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T03:21:53.183 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client dirsize rbytes': False}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T03:21:53.183 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:53.184 INFO:tasks.cephadm:Cluster fsid is a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:21:53.184 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T03:21:53.184 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.102', 'mon.b': '172.21.15.121', 'mon.c': '172.21.15.148'} 2024-09-21T03:21:53.184 INFO:tasks.cephadm:First mon is mon.a on smithi102 2024-09-21T03:21:53.184 INFO:tasks.cephadm:First mgr is x 2024-09-21T03:21:53.185 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T03:21:53.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname $(hostname -s) 2024-09-21T03:21:53.216 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-09-21T03:21:53.250 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname $(hostname -s) 2024-09-21T03:21:53.287 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T03:21:53.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:53.437 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T03:21:53.594 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:21:53.596 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:21:53.596 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:21:53.596 DEBUG:teuthology.orchestra.run.smithi102:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:54.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:21 /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:54.144 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:54.685 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:21 /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:54.685 DEBUG:teuthology.orchestra.run.smithi148:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:55.246 INFO:teuthology.orchestra.run.smithi148.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:21 /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:55.246 DEBUG:teuthology.orchestra.run.smithi102:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:55.266 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:55.285 DEBUG:teuthology.orchestra.run.smithi148:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:21:55.319 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T03:21:55.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:21:55.322 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:21:55.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:21:56.958 INFO:teuthology.orchestra.run.smithi148.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:21:56.989 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:21:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout: "repo_digests": [ 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout: ] 2024-09-21T03:22:29.980 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "repo_digests": [ 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:22:45.737 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:22:55.132 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-09-21T03:22:55.133 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-21T03:22:55.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph 2024-09-21T03:22:55.190 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-09-21T03:22:55.217 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph 2024-09-21T03:22:55.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /etc/ceph 2024-09-21T03:22:55.278 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-09-21T03:22:55.303 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /etc/ceph 2024-09-21T03:22:55.332 INFO:tasks.cephadm:Writing seed config... 2024-09-21T03:22:55.333 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-21T03:22:55.333 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T03:22:55.333 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T03:22:55.334 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T03:22:55.335 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T03:22:55.335 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:22:55.336 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T03:22:55.352 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = a5dfbe26-77c8-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False [mds] mds_bal_replicate_threshold = 1 2024-09-21T03:22:55.352 DEBUG:teuthology.orchestra.run.smithi102:mon.a> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T03:22:55.395 DEBUG:teuthology.orchestra.run.smithi102:mgr.x> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T03:22:55.437 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T03:22:55.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.102 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:22:55.647 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:22:55.647 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.102', '--skip-admin-label'] 2024-09-21T03:22:55.648 INFO:teuthology.orchestra.run.smithi102.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T03:22:55.648 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying podman|docker is present... 2024-09-21T03:22:55.672 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:22:55.672 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying lvm2 is present... 2024-09-21T03:22:55.672 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying time synchronization is in place... 2024-09-21T03:22:55.680 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:22:55.680 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:22:55.686 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:22:55.687 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:22:55.693 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout enabled 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout active 2024-09-21T03:22:55.699 INFO:teuthology.orchestra.run.smithi102.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:22:55.700 INFO:teuthology.orchestra.run.smithi102.stdout:Repeating the final host check... 2024-09-21T03:22:55.722 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:22:55.722 INFO:teuthology.orchestra.run.smithi102.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T03:22:55.722 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl is present 2024-09-21T03:22:55.722 INFO:teuthology.orchestra.run.smithi102.stdout:lvcreate is present 2024-09-21T03:22:55.728 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:22:55.729 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:22:55.735 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:22:55.735 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:22:55.741 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout enabled 2024-09-21T03:22:55.747 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout active 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Host looks OK 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Cluster fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Acquiring lock 140662722742640 on /run/cephadm/a5dfbe26-77c8-11ef-baf5-efdc52797490.lock 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Lock 140662722742640 acquired on /run/cephadm/a5dfbe26-77c8-11ef-baf5-efdc52797490.lock 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying IP 172.21.15.102 port 3300 ... 2024-09-21T03:22:55.748 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying IP 172.21.15.102 port 6789 ... 2024-09-21T03:22:55.749 INFO:teuthology.orchestra.run.smithi102.stdout:Base mon IP(s) is [172.21.15.102:3300, 172.21.15.102:6789], mon addrv is [v2:172.21.15.102:3300,v1:172.21.15.102:6789] 2024-09-21T03:22:55.752 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.102 metric 100 2024-09-21T03:22:55.752 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.102 metric 100 2024-09-21T03:22:55.754 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T03:22:55.754 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-21T03:22:55.755 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-21T03:22:55.758 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T03:22:55.758 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:Mon IP `172.21.15.102` is in CIDR network `172.21.0.0/20` 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:Mon IP `172.21.15.102` is in CIDR network `172.21.0.0/20` 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T03:22:55.759 INFO:teuthology.orchestra.run.smithi102.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:22:59.073 INFO:teuthology.orchestra.run.smithi102.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T03:23:08.678 INFO:teuthology.orchestra.run.smithi102.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:23:08.678 INFO:teuthology.orchestra.run.smithi102.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:23:08.678 INFO:teuthology.orchestra.run.smithi102.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T03:23:09.725 INFO:teuthology.orchestra.run.smithi102.stdout:stat: stdout 167 167 2024-09-21T03:23:09.725 INFO:teuthology.orchestra.run.smithi102.stdout:Creating initial keys... 2024-09-21T03:23:10.639 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph-authtool: stdout AQAePO5mohQiBRAA8p7Rp90y2kQ/N11y9ksS7Q== 2024-09-21T03:23:11.612 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph-authtool: stdout AQAfPO5m9KYVABAA07ahHLBjLXlrC3ZnDPu03A== 2024-09-21T03:23:12.467 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph-authtool: stdout AQAfPO5mKFMDNxAAmkJsLpPAOj945yRMV93yyg== 2024-09-21T03:23:12.468 INFO:teuthology.orchestra.run.smithi102.stdout:Creating initial monmap... 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool for a [v2:172.21.15.102:3300,v1:172.21.15.102:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:23:13.299 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-09-21T03:23:13.300 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: set fsid to a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:13.300 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:23:13.300 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:23:13.300 INFO:teuthology.orchestra.run.smithi102.stdout:Creating mon... 2024-09-21T03:23:15.229 INFO:teuthology.orchestra.run.smithi102.stdout:create mon.a on 2024-09-21T03:23:15.478 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T03:23:15.638 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T03:23:15.819 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target. 2024-09-21T03:23:15.819 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target. 2024-09-21T03:23:16.072 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:23:16.073 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T03:23:16.238 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target.wants/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@.service. 2024-09-21T03:23:16.744 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:23:16.744 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout disabled 2024-09-21T03:23:16.751 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:23:16.751 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:23:16.751 INFO:teuthology.orchestra.run.smithi102.stdout:firewalld.service is not enabled 2024-09-21T03:23:16.752 INFO:teuthology.orchestra.run.smithi102.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:23:16.752 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mon to start... 2024-09-21T03:23:16.752 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mon... 2024-09-21T03:23:16.850 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:16 smithi102 systemd[1]: Started Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:23:17.740 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T03:23:17.740 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout id: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:17.740 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T03:23:17.740 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout services: 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.531843s) 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout data: 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:17.741 INFO:teuthology.orchestra.run.smithi102.stdout:mon is available 2024-09-21T03:23:17.742 INFO:teuthology.orchestra.run.smithi102.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T03:23:17.845 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:23:17.845 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: monmap epoch 1 2024-09-21T03:23:17.845 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: last_changed 2024-09-21T03:23:12.783323+0000 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: min_mon_release 19 (squid) 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: election_strategy: 1 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: fsmap 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: mgrmap e1: no daemons active 2024-09-21T03:23:17.846 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:17 smithi102 ceph-mon[31025]: from='client.? 172.21.15.102:0/2895163639' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T03:23:18.762 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout fsid = a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.102:3300,v1:172.21.15.102:6789] 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:23:18.763 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:23:18.764 INFO:teuthology.orchestra.run.smithi102.stdout:Generating new minimal ceph.conf... 2024-09-21T03:23:18.868 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:18 smithi102 ceph-mon[31025]: from='client.? 172.21.15.102:0/2932736630' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:23:18.868 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:18 smithi102 ceph-mon[31025]: from='client.? 172.21.15.102:0/2932736630' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T03:23:19.816 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:19 smithi102 ceph-mon[31025]: from='client.? 172.21.15.102:0/686717266' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:23:19.819 INFO:teuthology.orchestra.run.smithi102.stdout:Restarting the monitor... 2024-09-21T03:23:20.202 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:19 smithi102 systemd[1]: Stopping Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:23:20.500 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:20 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a[31021]: 2024-09-21T03:23:20.243+0000 7feb039f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:23:20.500 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:20 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a[31021]: 2024-09-21T03:23:20.243+0000 7feb039f7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T03:23:20.752 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:20 smithi102 podman[31268]: 2024-09-21 03:23:20.499375044 +0000 UTC m=+0.525596875 container died efb2af8fda8ec013f0d8d47ff37f41be6ab2e5915ce8e6ea2427d534d8e79059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:23:21.011 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:20 smithi102 podman[31268]: 2024-09-21 03:23:20.809234203 +0000 UTC m=+0.835456030 container cleanup efb2af8fda8ec013f0d8d47ff37f41be6ab2e5915ce8e6ea2427d534d8e79059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:23:21.011 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:20 smithi102 bash[31268]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:23:21.373 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 podman[31281]: 2024-09-21 03:23:21.010117567 +0000 UTC m=+0.505587071 container remove efb2af8fda8ec013f0d8d47ff37f41be6ab2e5915ce8e6ea2427d534d8e79059 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T03:23:21.373 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T03:23:21.373 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 systemd[1]: Stopped Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:23:21.373 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 systemd[1]: Starting Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:23:21.642 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 podman[31373]: 2024-09-21 03:23:21.274391588 +0000 UTC m=+0.015530614 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:23:21.642 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 podman[31373]: 2024-09-21 03:23:21.386047499 +0000 UTC m=+0.127186506 container create 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T03:23:21.643 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 podman[31373]: 2024-09-21 03:23:21.605008858 +0000 UTC m=+0.346147875 container init 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T03:23:21.643 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 podman[31373]: 2024-09-21 03:23:21.608142137 +0000 UTC m=+0.349281145 container start 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:23:21.719 INFO:teuthology.orchestra.run.smithi102.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T03:23:21.937 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:23:21.937 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:23:21.937 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: pidfile_write: ignore empty --pid-file 2024-09-21T03:23:21.937 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: load: jerasure load: lrc 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Git sha 0 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: DB SUMMARY 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: DB Session ID: DO1JDDZ6H3IKU6Y5P55W 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:23:21.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95344 ; 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:23:21.939 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.env: 0x55c4aa307d60 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.info_log: 0x55c4b05af360 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.statistics: (nil) 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.use_fsync: 0 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:23:21.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:23:21.941 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.db_log_dir: 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.wal_dir: 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:23:21.942 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.write_buffer_manager: 0x55c4b05b3d60 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:23:21.943 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.unordered_write: 0 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.row_cache: None 2024-09-21T03:23:21.944 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.wal_filter: None 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.wal_compression: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:23:21.945 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:23:21.946 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:23:21.948 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:23:21.948 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:23:21.948 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:23:21.949 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_open_files: -1 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Compression algorithms supported: 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kZSTD supported: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:23:21.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T03:23:21.951 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.merge_operator: 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_filter: None 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c4b05aefa0) 2024-09-21T03:23:21.952 INFO:journalctl@ceph.mon.a.smithi102.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: index_type: 0 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: data_block_index_type: 0 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: index_shortening: 1 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: checksum: 4 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: no_block_cache: 0 2024-09-21T03:23:21.953 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_cache: 0x55c4ac573610 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_cache_options: 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: capacity : 536870912 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: num_shard_bits : 4 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: strict_capacity_limit : 0 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_cache_compressed: (nil) 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: persistent_cache: (nil) 2024-09-21T03:23:21.954 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_size: 4096 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_size_deviation: 10 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_restart_interval: 16 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: index_block_restart_interval: 1 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: metadata_block_size: 4096 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: partition_filters: 0 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: use_delta_encoding: 1 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: filter_policy: bloomfilter 2024-09-21T03:23:21.955 INFO:journalctl@ceph.mon.a.smithi102.stdout: whole_key_filtering: 1 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: verify_compression: 0 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: format_version: 5 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: enable_index_compression: 1 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: block_align: 0 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: max_auto_readahead_size: 262144 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: prepopulate_block_cache: 0 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:23:21.956 INFO:journalctl@ceph.mon.a.smithi102.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression: NoCompression 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.num_levels: 7 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:23:21.957 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:23:21.958 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:23:21.959 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:23:21.960 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:23:21.961 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:23:21.962 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.ttl: 2592000 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:23:21.963 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:23:21.964 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b8468b80-3624-44de-88df-eb58ec51c28d 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889001644396, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889001645473, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91530, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89571, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11724, "raw_average_key_size": 48, "raw_value_size": 82927, "raw_average_value_size": 339, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726889001, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b8468b80-3624-44de-88df-eb58ec51c28d", "db_session_id": "DO1JDDZ6H3IKU6Y5P55W", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889001645567, "job": 1, "event": "recovery_finished"} 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T03:23:21.965 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c4b05d2a80 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: DB pointer 0x55c4b1378000 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: ** DB Stats ** 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:23:21.966 INFO:journalctl@ceph.mon.a.smithi102.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: L0 2/0 91.25 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: Sum 2/0 91.25 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.967 INFO:journalctl@ceph.mon.a.smithi102.stdout: ** Compaction Stats [default] ** 2024-09-21T03:23:21.968 INFO:journalctl@ceph.mon.a.smithi102.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:23:21.968 INFO:journalctl@ceph.mon.a.smithi102.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:23:21.968 INFO:journalctl@ceph.mon.a.smithi102.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:23:21.969 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.969 INFO:journalctl@ceph.mon.a.smithi102.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:23:21.969 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Cumulative compaction: 0.00 GB write, 26.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Interval compaction: 0.00 GB write, 26.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Block cache BinnedLRUCache@0x55c4ac573610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:23:21.970 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: starting mon.a rank 0 at public addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] at bind addrs [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???) e1 preinit fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).mds e1 new map 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).mds e1 print_map 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: e1 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: btime 2024-09-21T03:23:16:722520+0000 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: legacy client fscid: -1 2024-09-21T03:23:21.971 INFO:journalctl@ceph.mon.a.smithi102.stdout: 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout: No filesystems configured 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: monmap epoch 1 2024-09-21T03:23:21.972 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: last_changed 2024-09-21T03:23:12.783323+0000 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: min_mon_release 19 (squid) 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: election_strategy: 1 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: fsmap 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 ceph-mon[31392]: mgrmap e1: no daemons active 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 bash[31373]: 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 2024-09-21T03:23:21.973 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:21 smithi102 systemd[1]: Started Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:23:22.648 INFO:teuthology.orchestra.run.smithi102.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T03:23:22.670 INFO:teuthology.orchestra.run.smithi102.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:23:22.670 INFO:teuthology.orchestra.run.smithi102.stdout:Creating mgr... 2024-09-21T03:23:22.671 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T03:23:22.671 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T03:23:22.920 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:23:22.920 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Failed to reset failed state of unit ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T03:23:23.072 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490.target.wants/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@.service. 2024-09-21T03:23:23.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 systemd[1]: Starting Ceph mgr.x for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:23:23.525 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:23 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1471840684' entity='client.admin' 2024-09-21T03:23:23.526 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 podman[31605]: 2024-09-21 03:23:23.208494054 +0000 UTC m=+0.015415789 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:23:23.526 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 podman[31605]: 2024-09-21 03:23:23.313405529 +0000 UTC m=+0.120327260 container create 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T03:23:23.526 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 podman[31605]: 2024-09-21 03:23:23.524531737 +0000 UTC m=+0.331453471 container init 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T03:23:23.631 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:23:23.631 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout disabled 2024-09-21T03:23:23.638 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:23:23.638 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:23:23.638 INFO:teuthology.orchestra.run.smithi102.stdout:firewalld.service is not enabled 2024-09-21T03:23:23.638 INFO:teuthology.orchestra.run.smithi102.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:23:23.647 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:23:23.647 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout disabled 2024-09-21T03:23:23.654 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:23:23.654 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:23:23.654 INFO:teuthology.orchestra.run.smithi102.stdout:firewalld.service is not enabled 2024-09-21T03:23:23.655 INFO:teuthology.orchestra.run.smithi102.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T03:23:23.655 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mgr to start... 2024-09-21T03:23:23.655 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mgr... 2024-09-21T03:23:23.777 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 podman[31605]: 2024-09-21 03:23:23.527475858 +0000 UTC m=+0.334397583 container start 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T03:23:23.777 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 bash[31605]: 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 2024-09-21T03:23:23.777 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:23 smithi102 systemd[1]: Started Ceph mgr.x for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:23:24.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:24 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/352419315' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:23:24.661 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.662 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:23:24.663 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:24.663 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:23:24.663 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:23:24.663 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:23:24.667 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:23:24.667 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:23:24.667 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:23:24.668 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:23:16:722520+0000", 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:23:24.669 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:23:16.723471+0000", 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:24.670 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:23:24.671 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:23:24.671 INFO:teuthology.orchestra.run.smithi102.stdout:mgr not available, waiting (1/15)... 2024-09-21T03:23:27.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:27 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3161541688' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:23:27.830 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:27.830 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:23:27.830 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:27.831 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:23:27.832 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:23:27.833 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:23:16:722520+0000", 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:27.834 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:23:16.723471+0000", 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:23:27.835 INFO:teuthology.orchestra.run.smithi102.stdout:mgr not available, waiting (2/15)... 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: Activating manager daemon x 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: mgrmap e2: x(active, starting, since 0.00385545s) 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:23:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: Manager daemon x is now available 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' 2024-09-21T03:23:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:28 smithi102 ceph-mon[31392]: from='mgr.14100 172.21.15.102:0/2143466541' entity='mgr.x' 2024-09-21T03:23:30.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:30 smithi102 ceph-mon[31392]: mgrmap e3: x(active, since 1.00758s) 2024-09-21T03:23:30.950 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:30 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2531980899' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:23:31.090 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:31.090 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:23:31.090 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:23:31.090 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:31.091 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:31.092 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:23:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:23:16:722520+0000", 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:23:31.097 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:23:16.723471+0000", 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:23:31.098 INFO:teuthology.orchestra.run.smithi102.stdout:mgr is available 2024-09-21T03:23:31.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:31 smithi102 ceph-mon[31392]: mgrmap e4: x(active, since 2s) 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout fsid = a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.102:3300,v1:172.21.15.102:6789] 2024-09-21T03:23:32.290 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:23:32.291 INFO:teuthology.orchestra.run.smithi102.stdout:Enabling cephadm module... 2024-09-21T03:23:32.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:32 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2725488935' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:23:33.923 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:33 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3479129640' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T03:23:33.924 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:33 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setuser ceph since I am not root 2024-09-21T03:23:33.924 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:33 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setgroup ceph since I am not root 2024-09-21T03:23:34.874 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:34 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3479129640' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T03:23:34.874 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:34 smithi102 ceph-mon[31392]: mgrmap e5: x(active, since 5s) 2024-09-21T03:23:35.407 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for the mgr to restart... 2024-09-21T03:23:35.408 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mgr epoch 5... 2024-09-21T03:23:35.659 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:35 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2420079201' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: Active manager daemon x restarted 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: Activating manager daemon x 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: mgrmap e6: x(active, starting, since 0.00394727s) 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:23:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:38 smithi102 ceph-mon[31392]: Manager daemon x is now available 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: Found migration_current of "None". Setting to last migration. 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: mgrmap e7: x(active, since 1.00604s) 2024-09-21T03:23:40.253 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:40 smithi102 ceph-mon[31392]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:23:39.995+0000 7fbfbf4b3640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:23:39] ENGINE Error in HTTPServer.serve 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Traceback (most recent call last): 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._connections.run(self.expiration_interval) 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._run(expiration_interval) 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:23:40.254 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s = self.context.wrap_socket( 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: return self.sslsocket_class._create( 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self.do_handshake() 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._sslobj.do_handshake() 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:23:40.255 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:mgr epoch 5 is available 2024-09-21T03:23:40.256 INFO:teuthology.orchestra.run.smithi102.stdout:Verifying orchestrator module is enabled... 2024-09-21T03:23:41.375 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: [21/Sep/2024:03:23:39] ENGINE Bus STARTING 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: [21/Sep/2024:03:23:39] ENGINE Serving on https://172.21.15.102:7150 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: [21/Sep/2024:03:23:39] ENGINE Error in HTTPServer.serve 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: Traceback (most recent call last): 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._run(expiration_interval) 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:23:41.376 INFO:journalctl@ceph.mon.a.smithi102.stdout: s = self.context.wrap_socket( 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: return self.sslsocket_class._create( 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: self.do_handshake() 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._sslobj.do_handshake() 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: [21/Sep/2024:03:23:40] ENGINE Serving on http://172.21.15.102:8765 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: [21/Sep/2024:03:23:40] ENGINE Bus STARTED 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:23:41.377 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:41 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2501810666' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T03:23:41.603 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T03:23:41.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting orchestrator backend to cephadm... 2024-09-21T03:23:42.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:42 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2501810666' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T03:23:42.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:42 smithi102 ceph-mon[31392]: mgrmap e8: x(active, since 2s) 2024-09-21T03:23:43.414 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:43 smithi102 ceph-mon[31392]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:43.414 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:43 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:43.414 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:43 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:23:43.990 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T03:23:43.990 INFO:teuthology.orchestra.run.smithi102.stdout:Generating ssh key... 2024-09-21T03:23:44.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-mon[31392]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:45.010 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Generating public/private rsa key pair. 2024-09-21T03:23:45.010 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Your identification has been saved in /tmp/tmpbllailkf/key 2024-09-21T03:23:45.010 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Your public key has been saved in /tmp/tmpbllailkf/key.pub 2024-09-21T03:23:45.010 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: The key fingerprint is: 2024-09-21T03:23:45.010 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: SHA256:XTmDWYD174kJhbCEtxRJCasxQdaoaPlup4D6TLTi+/Q ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: The key's randomart image is: 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: +---[RSA 3072]----+ 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: | .+o.+=*o.. | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: | ...oo*o * . | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: | ...o .o..+ B | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |.o. + .. o + | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |. o . S o . | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |.. o . + . | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |o.+. o o | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |o+oo.. | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: |.+*ooE | 2024-09-21T03:23:45.011 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: +----[SHA256]-----+ 2024-09-21T03:23:45.514 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:45 smithi102 ceph-mon[31392]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:45.514 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:45 smithi102 ceph-mon[31392]: Generating ssh key... 2024-09-21T03:23:45.514 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:45 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:45.514 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:45 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:46.428 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:23:46.428 INFO:teuthology.orchestra.run.smithi102.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:23:46.428 INFO:teuthology.orchestra.run.smithi102.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T03:23:46.437 INFO:teuthology.orchestra.run.smithi102.stdout:Adding host smithi102... 2024-09-21T03:23:47.087 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:46 smithi102 ceph-mon[31392]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:47.783 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:47 smithi102 ceph-mon[31392]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi102", "addr": "172.21.15.102", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:49.202 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:48 smithi102 ceph-mon[31392]: Deploying cephadm binary to smithi102 2024-09-21T03:23:50.813 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout Added host 'smithi102' with addr '172.21.15.102' 2024-09-21T03:23:50.813 INFO:teuthology.orchestra.run.smithi102.stdout:Deploying unmanaged mon service... 2024-09-21T03:23:51.366 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:51 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:51.366 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:51 smithi102 ceph-mon[31392]: Added host smithi102 2024-09-21T03:23:51.366 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:51 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:23:52.459 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T03:23:52.459 INFO:teuthology.orchestra.run.smithi102.stdout:Deploying unmanaged mgr service... 2024-09-21T03:23:52.859 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:52 smithi102 ceph-mon[31392]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:52.859 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:52 smithi102 ceph-mon[31392]: Saving service mon spec with placement count:5 2024-09-21T03:23:52.859 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:52 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:54.202 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:53 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:54.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:53 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:54.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:53 smithi102 ceph-mon[31392]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:23:54.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:53 smithi102 ceph-mon[31392]: Saving service mgr spec with placement count:2 2024-09-21T03:23:54.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:53 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:54.655 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T03:23:55.288 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:55 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:56.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:56 smithi102 ceph-mon[31392]: from='mgr.14118 172.21.15.102:0/3733599043' entity='mgr.x' 2024-09-21T03:23:56.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:56 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2218707701' entity='client.admin' 2024-09-21T03:23:57.061 INFO:teuthology.orchestra.run.smithi102.stdout:Enabling the dashboard module... 2024-09-21T03:23:57.637 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:57 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3915296273' entity='client.admin' 2024-09-21T03:23:58.516 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:58 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3091377605' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T03:23:58.836 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setuser ceph since I am not root 2024-09-21T03:23:58.836 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:23:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setgroup ceph since I am not root 2024-09-21T03:23:59.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:59 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3091377605' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T03:23:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:23:59 smithi102 ceph-mon[31392]: mgrmap e9: x(active, since 19s) 2024-09-21T03:24:00.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:24:00.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T03:24:00.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:24:00.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:24:00.304 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:24:00.305 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:24:00.305 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for the mgr to restart... 2024-09-21T03:24:00.305 INFO:teuthology.orchestra.run.smithi102.stdout:Waiting for mgr epoch 9... 2024-09-21T03:24:00.595 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:00 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3530538334' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:24:03.921 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: Active manager daemon x restarted 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: Activating manager daemon x 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: mgrmap e10: x(active, starting, since 0.00607139s) 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:24:03.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:03 smithi102 ceph-mon[31392]: Manager daemon x is now available 2024-09-21T03:24:04.761 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-mon[31392]: mgrmap e11: x(active, since 1.00776s) 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-mon[31392]: [21/Sep/2024:03:24:04] ENGINE Bus STARTING 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:24:04.676+0000 7fdc3cec1640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:24:04] ENGINE Error in HTTPServer.serve 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Traceback (most recent call last): 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:24:04.762 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._connections.run(self.expiration_interval) 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._run(expiration_interval) 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s = self.context.wrap_socket( 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: return self.sslsocket_class._create( 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self.do_handshake() 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._sslobj.do_handshake() 2024-09-21T03:24:04.763 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:24:04.764 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:mgr epoch 9 is available 2024-09-21T03:24:05.381 INFO:teuthology.orchestra.run.smithi102.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T03:24:05.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:05 smithi102 ceph-mon[31392]: [21/Sep/2024:03:24:04] ENGINE Serving on https://172.21.15.102:7150 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:05 smithi102 ceph-mon[31392]: [21/Sep/2024:03:24:04] ENGINE Error in HTTPServer.serve 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: Traceback (most recent call last): 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._run(expiration_interval) 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:24:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout: s = self.context.wrap_socket( 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: return self.sslsocket_class._create( 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: self.do_handshake() 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._sslobj.do_handshake() 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:05 smithi102 ceph-mon[31392]: [21/Sep/2024:03:24:04] ENGINE Serving on http://172.21.15.102:8765 2024-09-21T03:24:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:05 smithi102 ceph-mon[31392]: [21/Sep/2024:03:24:04] ENGINE Bus STARTED 2024-09-21T03:24:06.891 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:06 smithi102 ceph-mon[31392]: mgrmap e12: x(active, since 2s) 2024-09-21T03:24:06.892 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:06 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:06.892 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:06 smithi102 ceph-mon[31392]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:06.892 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:06 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:08.301 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFETCCAvmgAwIBAgIUdDUdaEvZ6+xRWXc+qm0QYc3/uDUwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAzMjQwN1oXDTM0\nMDkyMjAzMjQwN1owGDEWMBQGA1UEAwwNMTcyLjIxLjE1LjEwMjCCAiIwDQYJKoZI\nhvcNAQEBBQADggIPADCCAgoCggIBAK8w+24y9KOHfmPzEHorRrOVYu+uviK1v2f9\nUMhP8qg3T6R1Kir7/qEISBtJlOMeH9bfPeoHaUyrwUMAH1dmipa5mSTA6v0HEvUy\nuL5a4d3yT06TlX5P9OIRHFrvBURKN5Aq4fiAH9rSgSUNtO5ZcygGOWB54dPD+sY1\nQ9D4tDKENfRNPtDxdvNn0fjwsbKmaFzLjchUbG3QSSDvb21Ee9biCuXUUtNHwxx4\ncWf7bh3mL4+Lgu3xjCg/0W2WM8BZ/ZqmO0bnyR5BijuURwQclMBZOUwCguiOe2yN\nlM17EcyAx9QGeQrZ1kNEHbqx7jt9EZRF1S1m10a1VMio9psLZSPFYVAa/fs/20me\n7UhdUuV804vaSaK5mN2GX6ETRgotSucuVUZJz0owr3ce852P1gs3aO/EXyaceXNc\nUjHxTZ8EIFa9fkADj5l6nrWqwDCwu0J9ZeLtpWQRHB0dAUtESiDQCkmGEbEU5dse\n+BsqRTseZLnFmJCSarIIl0GwwfEMMz/VL5myB738JtbFs+jK9gtz1ZJIA8BOpFyw\nPVxb97cggoUwrbk1GFYv/1bSPcq02wJxfyr5Wh2Mx+qr1k0MYunXt+9ZG6+mrUiR\ndGzOwQKZsCgtKmYcFnDU7XeQspNmACJdjuNtuD82zPK/pcIFQqfpFiXwywxSeryC\nftonR4ptAgMBAAGjVDBSMEIGA1UdEQQ7MDmCHnNtaXRoaTEwMi5mcm9udC5zZXBp\nYS5jZXBoLmNvbYIRZGFzaGJvYXJkX3NlcnZlcnOHBKwVD2YwDAYDVR0TAQH/BAIw\nADANBgkqhkiG9w0BAQsFAAOCAgEAa4BVtU+r1D0ETOkCPLbJwe9lIYlGT00lhcbM\nXdvW2T1jXRltRn6XK90Rs4FVfg9DbsAaFba8M0EAd5zYX9vWC5APaBukHYf20IMI\nW005G6xX1OKjkRkeLmnyGmWvnxHaqpOz2FluwH8G0dahuSxbHmpOPxOfjPGa2M09\n60GWmKVYbUv3G7zQzOPvYyvNw3dqP8ONitK40TSSicT/HFXjG9GOCkM0l4rmYLXA\nVk3Dz6mx0/KRBZS0TEkiuoNgBRhFYx9BIWn4x17gonjOmg+WxlvseglrpQ4M2lin\nkFJsTJNWQNfdAbNHJKMdvWpJxdjbRkHCT0swg01S7BzTzjLCYaGLXqOLohy8wgqM\n2tN0J8zByxvSCde6tgIaxnG0QbL8q4+zMFTeKrzadx+mXyPUzQb9IWlamA49vbO5\ni5i6fhOBIVs9hqUp75rC6ZrEjN9FiIeQlvcybYnu8iCcm8laMmJjGcyXJiw5Dy31\n41h4rvh501B25CLJhcqoDhuuQwscb1N4gYzCsW+UDXjIzj6nzYVJMzA1L2plKuBq\n9aqGYki8URKMJX+uLqL2n3L38BNwz6eBHoexmHUHm8R4zhfsSJ6Tz3LxManRW+5b\noezGnuQl0Wu1UiLLKSOtfPxDzqb0ANWuyLDEqbNjygBbX4TIefp+WES70J7rene1\nZGbV4JQ=\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJJwIBAAKCAgEArzD7bjL0o4d+Y/MQeitGs5Vi766+IrW/Z/1QyE/yqDdPpHUq\nKvv+oQhIG0mU4x4f1t896gdpTKvBQwAfV2aKlrmZJMDq/QcS9TK4vlrh3fJPTpOV\nfk/04hEcWu8FREo3kCrh+IAf2tKBJQ207llzKAY5YHnh08P6xjVD0Pi0MoQ19E0+\n0PF282fR+PCxsqZoXMuNyFRsbdBJIO9vbUR71uIK5dRS00fDHHhxZ/tuHeYvj4uC\n7fGMKD/RbZYzwFn9mqY7RufJHkGKO5RHBByUwFk5TAKC6I57bI2UzXsRzIDH1AZ5\nCtnWQ0QdurHuO30RlEXVLWbXRrVUyKj2mwtlI8VhUBr9+z/bSZ7tSF1S5XzTi9pJ\normY3YZfoRNGCi1K5y5VRknPSjCvdx7znY/WCzdo78RfJpx5c1xSMfFNnwQgVr1+\nQAOPmXqetarAMLC7Qn1l4u2lZBEcHR0BS0RKINAKSYYRsRTl2x74GypFOx5kucWY\nkJJqsgiXQbDB8QwzP9UvmbIHvfwm1sWz6Mr2C3PVkkgDwE6kXLA9XFv3tyCChTCt\nuTUYVi//VtI9yrTbAnF/KvlaHYzH6qvWTQxi6de371kbr6atSJF0bM7BApmwKC0q\nZhwWcNTtd5Cyk2YAIl2O4224PzbM8r+lwgVCp+kWJfDLDFJ6vIJ+2idHim0CAwEA\nAQKCAgAeAfRXLFg1+HvgL96XJnl+QizHpDVCKcJm0/91yCfmw06be0wlP7OeLpZ3\nQhPEEUFf4y4uO2XAcbzxNoCnzlMXvSOrpXW6sG8BW9ZEGLoOc7Y83c+h6p0l6ctj\nEgTjbRj2UzoQgBW0vBDN4Xqnxt+QL/y89zOEu9FlCPOcRDVNX9MEDQUg8fMvfw16\np/OwB4vhtSYMddV6u84C27BI1Y2mwWIfes5TDTww0LqQFoOGkIp9+mYLTq/0pvW+\n4RbtMBzd0/JcU1BiI9TDHsNJQ4IBLmc/i0CUB+/BKMEfryBd2IMh4Jf0EVr/e5fi\nBh8pxmLv9EQu+ioOnPmwQyy2Yu3IObawzGe1p6yfnx3a6hl9Xjlz3Sqzk9xVRVMM\n7wTnBg1PqmXwCf1px7c0FEs1R2xURc5CEEt03iu8WcIn7YXGSOe3qLW5fdB3ywah\nfI0xoyl8tB0kGUUg1IYxucTM7t6RYWkjKX4whJye8dqGwqYwCN4w8HQM7K7IieNF\n9M18UxJ118bN4Gy8xNgo3k6nTEAaQAr5lcGtjuqic/mm9HIjrYDalOwu1wm98ML4\na5uVbFx18auZDoGzYTITB5tMxSc0ixcW54kvFTwaDgYKYheMM2O6kft/A5YAPbFR\ngFDC1p3DirBxQWqSVXxiqfIR5ri9RYIYbHXEHVTcdzDiO60vwQKCAQEA1Epu6xNL\nwsvEgKWMmzPSvmU6QJK2SpABIgQivVYWHQ2RB7MA8g8NYB5/2WJkKu8RgQ9iS0/B\nD5wRGCaVwLVoWvP9sgT5fU34l+OvdNlHZI6em9459vzDk5hylk/UJKZbJbfXVNc9\nbSlp8lfNpoUAQxC2dshhuyX96kCr86PncWW7fDtGf80FksoYzqFGSy/GXhRWmbO2\nsQzeUVI9U4gi6U5tceIx8fvtCW3tkdu70QY9yTEpmZB/Mv0LN9ogsYCIxwnp8Z0d\nWa+O1OJ+DW63K0W8Hco8nHpXNTZ23HLxOHSWR6XN4FoaYwvEIOnb2MRrLWRYNfJa\nN6N19uo2Bm7q4QKCAQEA00MWWA3CMQKg2A1UHA5S0lgPEEEstXWMLrZSIE2dCi1b\nRBKzuMEHkq9HWjMPTdroMd+jjvylpx9koHOXLhTWSCjnHJGjZdb0YC8Ok275b38v\nzNOKHxk8n2zVF8p0ivAyuGpPYI1zfRwngKzsQf5EbwViigb2we3pzE/oE0Pv2Epj\nj0ARq+1E+D0VY8MQoLIzhYp2pmHAAnRx6qewEmk2p2p1XaZw612z3EgzxX88mrKK\nwILxSF9E3Yz5b3wi25MgZOtSWKKCgo5t8Mq1VwoQWCu7Qf2EqRSp8TsTI5m41nMb\nmZOoNz9uUNA91cH1F9nnKY/Nd2JhavHe/zfKmW49DQKCAQBaGYk//j2OXHt2+kxV\n5sXQBxiVJW927+17KXQxFaNnC0X9lYyWL6tGm0s50RegXTz5oLTgL+ZJoLxkmqO+\nWYAD8kA/WPsmonwawwjJuBoj5KAOmV/Sou7C6tXfU9w+/df7hy4+FOg+N3B+6aMf\nxJ0a2bIHcf6Atpww2ufgDTWCnGHZVTMTtMljxqCGuk4iRRGVBl7G905XkJWewB/F\nHydqC95Jkm4OPRUahmxpFnB9Q3/frxzvzzMdSeaD+vEbROlISL3gzQUS9n7RfZtw\nSgg1tnAj2Jym8QmoTQhfge09P8Y0fHuHd9ZxKSJBsd+b/albZ5ZEtypxKNA9TqRF\nULghAoIBAF8tvGVTXYfjHT/5UUmKknm9vpueIVxnZw6siXeQQA4TvSiAHIRCQv0t\nBsJ2epCi7TV7Ah8raB5RIG7BZP0X2iqMcwMGAk2heFvVF4YI20wGSyzGqVW1cwCI\nccDUL4lhChjXnIdtcviMtKdeQNrCiWZTUL/Kv2VDoK+x2GbFlsslSJGDVfLVZNtJ\n+dcGTPl5D4k8hpQTOgRhHemQPt0slbj7V4EnuXvwrVWzGdACsPUpNyXgWIA4m7gN\nCVvW24V9VXziICland3f+Vwgl25tVEvE+AqVAy2B58aMzOSfHw1OssKQKZsqcrLp\n/tHNHnTucRzicrk0k5sw+TyWkCpr5gkCggEAIjALYX5nYj8c2xfBLxNLx48RM/5k\nmQsIY0j8JB7as9R5fVrNBnC5HGl++VG0+9rdyH36Uf8zoPS5nasariuUsCHuNxQU\nNKX1hIOvV2LctZQH64Zlp4FAeBM4h6Lh18wPgFBmDtdii3KsE2EsOJfGEh6jpv5F\niiSa1NkqLJIhKy7nzt4+2zxNOd7C5Ld5DF3goIyGXvpCupa3r67P3bvKg9loTYd5\ng2q1icL/yubJAEJFTwM/d6tdSabJhrALXsAt2YKxkQ1ji+gzawOpZ0lk7GMtSi55\np2PKCus22Dvpcn8xnuGy2eOr+tJ3x2jNlL270iNXF9iI8b1xc26C6PvmbA==\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T03:24:09.466 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T03:24:10.102 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:09 smithi102 ceph-mon[31392]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:10.103 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:09 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:10.683 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T03:24:10.683 INFO:teuthology.orchestra.run.smithi102.stdout:Creating initial admin user... 2024-09-21T03:24:11.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:11 smithi102 ceph-mon[31392]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:11.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:11 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:12.129 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$FWJpNEc7gBosE9OlNEhjA.f156PaPbr66CwFfVRr9OaViRe6EOuSq", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726889051, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T03:24:12.129 INFO:teuthology.orchestra.run.smithi102.stdout:Fetching dashboard port number... 2024-09-21T03:24:12.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:12 smithi102 ceph-mon[31392]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:12.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:12 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:13.285 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T03:24:13.295 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:24:13.295 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout disabled 2024-09-21T03:24:13.302 INFO:teuthology.orchestra.run.smithi102.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:24:13.302 INFO:teuthology.orchestra.run.smithi102.stdout:systemctl: stdout inactive 2024-09-21T03:24:13.302 INFO:teuthology.orchestra.run.smithi102.stdout:firewalld.service is not enabled 2024-09-21T03:24:13.302 INFO:teuthology.orchestra.run.smithi102.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T03:24:13.304 INFO:teuthology.orchestra.run.smithi102.stdout:Ceph Dashboard is now available at: 2024-09-21T03:24:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: URL: https://smithi102.front.sepia.ceph.com:8443/ 2024-09-21T03:24:13.304 INFO:teuthology.orchestra.run.smithi102.stdout: User: admin 2024-09-21T03:24:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: Password: tlszjkkuw4 2024-09-21T03:24:13.305 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:13.305 INFO:teuthology.orchestra.run.smithi102.stdout:Saving cluster configuration to /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config directory 2024-09-21T03:24:13.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/560633850' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T03:24:14.666 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T03:24:14.666 INFO:teuthology.orchestra.run.smithi102.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T03:24:14.666 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: ceph telemetry on 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout:For more information see: 2024-09-21T03:24:14.667 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.668 INFO:teuthology.orchestra.run.smithi102.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T03:24:14.668 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:14.668 INFO:teuthology.orchestra.run.smithi102.stdout:Bootstrap complete. 2024-09-21T03:24:14.713 INFO:tasks.cephadm:Fetching config... 2024-09-21T03:24:14.714 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:14.714 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T03:24:14.730 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T03:24:14.731 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:14.731 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T03:24:14.786 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T03:24:14.786 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:14.787 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T03:24:14.851 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T03:24:14.851 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:14.851 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T03:24:14.907 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T03:24:14.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:24:14.983 INFO:teuthology.orchestra.run.smithi102.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:14.995 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:24:15.036 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:15.048 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:24:15.090 INFO:teuthology.orchestra.run.smithi148.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDD7f13SaZhI1uuVpBkEo85GPWO2PRkUf29+58iu91fbgVvuLjbC9gOSWMAWvvj9ov3dB5IiISpfbiG6JUBfDmU3iEb8lkFjhHNhSIxsUhe2adptY1/cjydV0uWI/h37VzwF0iYZbFbXY29HErDAHkT+b1wpU5jJcTpHNVezMW4SUs1a8e1rz/qyNpwTfht4ddFmgrG2SNFs9jCdrTFjnD7U9coiLTvfo1uJkWZNd4vy5U9emz+1H6l12e1l/QJrEbpFOt2vG9mZmxRa2APYsPlAusqWW/hvfvcc8CE/KOkJHvigscuZilTWugp5x7Al/Rrr52J8pnPnVz3rSQS2ufcAqRn+mOVrTTIGtLYsRtBdmNT/LhXzkvkofmEtSLpRagbCTDO03pM0+mFHzELW8fg7KvSy5ldwk5emyNmX9Rf3GFrBWbUxqJCQPnfAOHAwXDFpsKppHwpQRxCcNOu0glb1LYU5vO4UNvOhNx65BF9v8DrqIom1f/bGVOuZYTSuUM= ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:15.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T03:24:15.350 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:15.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:15 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/85591132' entity='client.admin' 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: mgrmap e13: x(active, since 12s) 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3452436445' entity='client.admin' 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"} : dispatch 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:17.275 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:17 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:17.276 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T03:24:17.276 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T03:24:17.543 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:19.390 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:19.390 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:19.390 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:19.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:19 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:19.418 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi121 2024-09-21T03:24:19.418 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:24:19.419 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:24:19.438 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:24:19.438 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:19.497 INFO:tasks.cephadm:Adding host smithi121 to orchestrator... 2024-09-21T03:24:19.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch host add smithi121 2024-09-21T03:24:19.738 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:20.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:20 smithi102 ceph-mon[31392]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:24:21.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:21 smithi102 ceph-mon[31392]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:22.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:22 smithi102 ceph-mon[31392]: Deploying cephadm binary to smithi121 2024-09-21T03:24:23.431 INFO:teuthology.orchestra.run.smithi102.stdout:Added host 'smithi121' with addr '172.21.15.121' 2024-09-21T03:24:24.106 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:24:24.342 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: Added host smithi121 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:24 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:25.037 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:25.037 INFO:teuthology.orchestra.run.smithi102.stdout:[{"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}] 2024-09-21T03:24:25.688 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi148 2024-09-21T03:24:25.688 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:24:25.689 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:24:25.709 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:24:25.709 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:25.767 INFO:tasks.cephadm:Adding host smithi148 to orchestrator... 2024-09-21T03:24:25.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch host add smithi148 2024-09-21T03:24:25.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:25 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:25.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:25 smithi102 ceph-mon[31392]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:24:25.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:25 smithi102 ceph-mon[31392]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:26.004 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: Deploying cephadm binary to smithi148 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:24:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:28.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:28 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:29.711 INFO:teuthology.orchestra.run.smithi102.stdout:Added host 'smithi148' with addr '172.21.15.148' 2024-09-21T03:24:29.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:29 smithi102 ceph-mon[31392]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:29.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:29 smithi102 ceph-mon[31392]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:29.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:29 smithi102 ceph-mon[31392]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:24:30.318 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:24:30.566 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:30.817 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:30 smithi102 ceph-mon[31392]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:30.817 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:30 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:30.817 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:30 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:30.818 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:30 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:30.818 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:30 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:31.210 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:24:31.210 INFO:teuthology.orchestra.run.smithi102.stdout:[{"addr": "172.21.15.102", "hostname": "smithi102", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}, {"addr": "172.21.15.148", "hostname": "smithi148", "labels": [], "status": ""}] 2024-09-21T03:24:31.807 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:31 smithi102 ceph-mon[31392]: Added host smithi148 2024-09-21T03:24:31.807 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:31 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:31.833 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T03:24:31.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T03:24:32.070 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:32.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:32 smithi102 ceph-mon[31392]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:24:32.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:32 smithi102 ceph-mon[31392]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:33.560 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-09-21T03:24:33.938 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:33 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/279625054' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:24:34.293 INFO:tasks.cephadm:Adding mon.a on smithi102 2024-09-21T03:24:34.293 INFO:tasks.cephadm:Adding mon.b on smithi121 2024-09-21T03:24:34.293 INFO:tasks.cephadm:Adding mon.c on smithi148 2024-09-21T03:24:34.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c' 2024-09-21T03:24:34.532 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/279625054' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:34.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:34 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:35.125 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mon update... 2024-09-21T03:24:35.746 DEBUG:teuthology.orchestra.run.smithi121:mon.b> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T03:24:35.749 DEBUG:teuthology.orchestra.run.smithi148:mon.c> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T03:24:35.752 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:24:35.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:24:35.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:35 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:36 smithi102 ceph-mon[31392]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:36 smithi102 ceph-mon[31392]: Saving service mon spec with placement smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c;count:3 2024-09-21T03:24:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:36 smithi102 ceph-mon[31392]: Deploying daemon mon.c on smithi148 2024-09-21T03:24:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:36 smithi102 ceph-mon[31392]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:37.253 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:38.524 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:24:38.525 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":1,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","modified":"2024-09-21T03:23:12.783323Z","created":"2024-09-21T03:23:12.783323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T03:24:38.525 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 1 2024-09-21T03:24:38.844 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:38 smithi148 systemd[1]: Starting Ceph mon.c for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:24:38.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:38 smithi102 ceph-mon[31392]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:38.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2748443791' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:39.405 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 podman[34632]: 2024-09-21 03:24:39.319348925 +0000 UTC m=+0.096284566 container create 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T03:24:39.406 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 podman[34632]: 2024-09-21 03:24:39.238903602 +0000 UTC m=+0.015839236 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:24:39.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 podman[34632]: 2024-09-21 03:24:39.496769692 +0000 UTC m=+0.273705329 container init 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 podman[34632]: 2024-09-21 03:24:39.499914045 +0000 UTC m=+0.276849681 container start 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pidfile_write: ignore empty --pid-file 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: load: jerasure load: lrc 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Git sha 0 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: DB SUMMARY 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: DB Session ID: HGNFQODIX8J52TLJ319T 2024-09-21T03:24:39.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.env: 0x55870f1fed60 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:24:39.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.info_log: 0x558714bcd360 2024-09-21T03:24:39.997 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.statistics: (nil) 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.use_fsync: 0 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:24:39.998 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.db_log_dir: 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.wal_dir: 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:24:39.999 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.write_buffer_manager: 0x558714bd1d60 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:24:40.000 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.unordered_write: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.row_cache: None 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.wal_filter: None 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.wal_compression: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:24:40.001 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:24:40.002 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_open_files: -1 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Compression algorithms supported: 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kZSTD supported: 0 2024-09-21T03:24:40.003 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.merge_operator: 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_filter: None 2024-09-21T03:24:40.004 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558714bccfa0) 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_type: 0 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: data_block_index_type: 0 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_shortening: 1 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: checksum: 4 2024-09-21T03:24:40.005 INFO:journalctl@ceph.mon.c.smithi148.stdout: no_block_cache: 0 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache: 0x558710b91610 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_options: 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: capacity : 536870912 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: num_shard_bits : 4 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: strict_capacity_limit : 0 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_cache_compressed: (nil) 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: persistent_cache: (nil) 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_size: 4096 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_size_deviation: 10 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_restart_interval: 16 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: index_block_restart_interval: 1 2024-09-21T03:24:40.006 INFO:journalctl@ceph.mon.c.smithi148.stdout: metadata_block_size: 4096 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: partition_filters: 0 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: use_delta_encoding: 1 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: filter_policy: bloomfilter 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: whole_key_filtering: 1 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: verify_compression: 0 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: format_version: 5 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: enable_index_compression: 1 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: block_align: 0 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: max_auto_readahead_size: 262144 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: prepopulate_block_cache: 0 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:24:40.007 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression: NoCompression 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.num_levels: 7 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:24:40.008 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:24:40.009 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:24:40.010 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:24:40.011 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.ttl: 2592000 2024-09-21T03:24:40.012 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:24:40.013 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d8d56abc-83c8-4677-a253-8cde06127ab2 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889079537710, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889079538121, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726889079, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d8d56abc-83c8-4677-a253-8cde06127ab2", "db_session_id": "HGNFQODIX8J52TLJ319T", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726889079538216, "job": 1, "event": "recovery_finished"} 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558714bf0a80 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: DB pointer 0x558715996000 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** DB Stats ** 2024-09-21T03:24:40.014 INFO:journalctl@ceph.mon.c.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:24:40.015 INFO:journalctl@ceph.mon.c.smithi148.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** Compaction Stats [default] ** 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:24:40.016 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: Block cache BinnedLRUCache@0x558710b91610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: using public_addr v2:172.21.15.148:0/0 -> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: starting mon.c rank -1 at public addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] at bind addrs [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:40.017 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(???) e0 preinit fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: e1 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: btime 2024-09-21T03:23:16:722520+0000 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: legacy client fscid: -1 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout: No filesystems configured 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:24:40.018 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi148", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Deploying cephadm binary to smithi148 2024-09-21T03:24:40.019 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:24:40.020 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Added host smithi148 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/279625054' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/279625054' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.021 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:40.022 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Saving service mon spec with placement smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c;count:3 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: Deploying daemon mon.c on smithi148 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2748443791' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 ceph-mon[34651]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 bash[34632]: 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 2024-09-21T03:24:40.023 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:39 smithi148 systemd[1]: Started Ceph mon.c for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:24:40.106 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:24:40.106 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:24:40.354 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: mon.a calling monitor election 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: mon.c calling monitor election 2024-09-21T03:24:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: monmap epoch 2 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: last_changed 2024-09-21T03:24:39.565621+0000 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: min_mon_release 19 (squid) 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: election_strategy: 1 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T03:24:44.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: fsmap 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: mgrmap e13: x(active, since 41s) 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: overall HEALTH_OK 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:44.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:44 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: mon.a calling monitor election 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: mon.c calling monitor election 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: monmap epoch 2 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: last_changed 2024-09-21T03:24:39.565621+0000 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: min_mon_release 19 (squid) 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: election_strategy: 1 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: fsmap 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: mgrmap e13: x(active, since 41s) 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: overall HEALTH_OK 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:44.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:44 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:45.425 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:24:45.425 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","modified":"2024-09-21T03:24:39.565621Z","created":"2024-09-21T03:23:12.783323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:24:45.425 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 2 2024-09-21T03:24:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:45 smithi148 ceph-mon[34651]: Deploying daemon mon.b on smithi121 2024-09-21T03:24:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/3186749720' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:45 smithi148 ceph-mon[34651]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:45 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:45.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:45 smithi102 ceph-mon[31392]: Deploying daemon mon.b on smithi121 2024-09-21T03:24:45.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/3186749720' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:45.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:45 smithi102 ceph-mon[31392]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:45.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:45 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:47.098 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:24:47.099 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:24:47.366 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:24:47.723 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:47 smithi148 ceph-mon[34651]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:47.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:47 smithi102 ceph-mon[31392]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:48.075 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:24:48.075 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":2,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","modified":"2024-09-21T03:24:39.565621Z","created":"2024-09-21T03:23:12.783323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:24:48.075 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 2 2024-09-21T03:24:48.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:48 smithi121 systemd[1]: Started Ceph mon.b for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:24:49.688 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:24:49.688 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:24:49.945 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: mon.a calling monitor election 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: mon.c calling monitor election 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: mon.b calling monitor election 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: monmap epoch 3 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: last_changed 2024-09-21T03:24:48.098346+0000 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: min_mon_release 19 (squid) 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: election_strategy: 1 2024-09-21T03:24:53.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: fsmap 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: mgrmap e13: x(active, since 49s) 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: overall HEALTH_OK 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:53 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: mon.a calling monitor election 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: mon.c calling monitor election 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: mon.b calling monitor election 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: monmap epoch 3 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: last_changed 2024-09-21T03:24:48.098346+0000 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: min_mon_release 19 (squid) 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: election_strategy: 1 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: fsmap 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: mgrmap e13: x(active, since 49s) 2024-09-21T03:24:53.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: overall HEALTH_OK 2024-09-21T03:24:53.496 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.496 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.496 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.496 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:53 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:24:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: mon.a calling monitor election 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: mon.c calling monitor election 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: mon.b calling monitor election 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: monmap epoch 3 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: last_changed 2024-09-21T03:24:48.098346+0000 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: created 2024-09-21T03:23:12.783323+0000 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: min_mon_release 19 (squid) 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: election_strategy: 1 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: 0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: 1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.c 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: fsmap 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: mgrmap e13: x(active, since 49s) 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: overall HEALTH_OK 2024-09-21T03:24:53.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:53 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:53.671 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:24:53.671 INFO:teuthology.orchestra.run.smithi148.stdout:{"epoch":3,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","modified":"2024-09-21T03:24:48.098346Z","created":"2024-09-21T03:23:12.783323Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:3300","nonce":0},{"type":"v1","addr":"172.21.15.102:6789","nonce":0}]},"addr":"172.21.15.102:6789/0","public_addr":"172.21.15.102:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:3300","nonce":0},{"type":"v1","addr":"172.21.15.148:6789","nonce":0}]},"addr":"172.21.15.148:6789/0","public_addr":"172.21.15.148:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T03:24:53.672 INFO:teuthology.orchestra.run.smithi148.stderr:dumped monmap epoch 3 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/4200528509' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:54 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/4200528509' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:54 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/4200528509' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:24:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:54 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:54.872 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T03:24:54.873 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:24:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:55.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:55.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:55 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:55 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:55.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:55 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:55.588 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:56.185 INFO:teuthology.orchestra.run.smithi102.stdout:# minimal ceph.conf for a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:56.186 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-21T03:24:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:24:56.186 INFO:teuthology.orchestra.run.smithi102.stdout: mon_host = [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2024-09-21T03:24:56.338 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:56 smithi102 ceph-mon[31392]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:24:56.338 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:56 smithi102 ceph-mon[31392]: Reconfiguring daemon mon.a on smithi102 2024-09-21T03:24:56.338 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:56 smithi102 ceph-mon[31392]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:56.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:56 smithi148 ceph-mon[34651]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:24:56.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:56 smithi148 ceph-mon[34651]: Reconfiguring daemon mon.a on smithi102 2024-09-21T03:24:56.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:56 smithi148 ceph-mon[34651]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:56 smithi121 ceph-mon[34316]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:24:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:56 smithi121 ceph-mon[34316]: Reconfiguring daemon mon.a on smithi102 2024-09-21T03:24:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:56 smithi121 ceph-mon[34316]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:57.154 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T03:24:57.155 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:57.155 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:24:57.182 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:24:57.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:57.247 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:24:57.248 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:24:57.275 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:24:57.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:57.339 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:24:57.339 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:24:57.374 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:24:57.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:24:57.411 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3961496031' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.411 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.411 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.411 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:24:57.412 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:57.412 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:57.412 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.412 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:57 smithi102 ceph-mon[31392]: Reconfiguring daemon mon.b on smithi121 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3961496031' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.440 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:57 smithi148 ceph-mon[34651]: Reconfiguring daemon mon.b on smithi121 2024-09-21T03:24:57.444 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T03:24:57.444 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T03:24:57.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3961496031' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:57.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:24:57.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:57.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:57.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:57.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:57 smithi121 ceph-mon[34316]: Reconfiguring daemon mon.b on smithi121 2024-09-21T03:24:57.689 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:24:58.404 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:58.404 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.404 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.404 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:58.405 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:58.405 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:58 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:58.445 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:58.445 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.446 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.446 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:58.446 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:58.446 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:58 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:58.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:24:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:24:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:24:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:58 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: Reconfiguring daemon mon.c on smithi148 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:59.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:59.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:59.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-mon[31392]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.454 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setuser ceph since I am not root 2024-09-21T03:24:59.454 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:24:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ignoring --setgroup ceph since I am not root 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: Reconfiguring daemon mon.c on smithi148 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:24:59 smithi148 ceph-mon[34651]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: Reconfiguring daemon mon.c on smithi148 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:24:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:24:59 smithi121 ceph-mon[34316]: from='mgr.14152 172.21.15.102:0/2429126309' entity='mgr.x' 2024-09-21T03:24:59.831 INFO:tasks.cephadm:Adding mgr.x on smithi102 2024-09-21T03:24:59.831 INFO:tasks.cephadm:Adding mgr.y on smithi121 2024-09-21T03:24:59.831 INFO:tasks.cephadm:Adding mgr.z on smithi148 2024-09-21T03:24:59.832 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi102=x;smithi121=y;smithi148=z' 2024-09-21T03:25:00.077 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:25:00.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:00 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:25:00.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:00 smithi102 ceph-mon[31392]: mgrmap e14: x(active, since 55s) 2024-09-21T03:25:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:00 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:25:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:00 smithi148 ceph-mon[34651]: mgrmap e14: x(active, since 55s) 2024-09-21T03:25:00.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:00 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1716713665' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T03:25:00.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:00 smithi121 ceph-mon[34316]: mgrmap e14: x(active, since 55s) 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: Active manager daemon x restarted 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: Activating manager daemon x 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: mgrmap e15: x(active, starting, since 0.00517897s) 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:25:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:25:04.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:25:04.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:25:04.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:04 smithi102 ceph-mon[31392]: Manager daemon x is now available 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: Active manager daemon x restarted 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: Activating manager daemon x 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: mgrmap e15: x(active, starting, since 0.00517897s) 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:25:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:04 smithi148 ceph-mon[34651]: Manager daemon x is now available 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: Active manager daemon x restarted 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: Activating manager daemon x 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: mgrmap e15: x(active, starting, since 0.00517897s) 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:25:04.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:25:04.526 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:25:04.526 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:04 smithi121 ceph-mon[34316]: Manager daemon x is now available 2024-09-21T03:25:05.149 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mgr update... 2024-09-21T03:25:05.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:25:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:25:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-mon[31392]: mgrmap e16: x(active, since 1.00894s) 2024-09-21T03:25:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:25:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:25:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:05 smithi148 ceph-mon[34651]: mgrmap e16: x(active, since 1.00894s) 2024-09-21T03:25:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:25:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:25:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:05 smithi121 ceph-mon[34316]: mgrmap e16: x(active, since 1.00894s) 2024-09-21T03:25:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:05.812 DEBUG:teuthology.orchestra.run.smithi121:mgr.y> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T03:25:05.814 DEBUG:teuthology.orchestra.run.smithi148:mgr.z> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T03:25:05.817 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T03:25:05.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T03:25:05.819 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T03:25:05.819 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T03:25:05.862 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T03:25:05.862 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T03:25:05.904 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:25:05.904 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T03:25:05.947 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:25:05.947 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T03:25:05.991 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T03:25:05.991 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T03:25:06.034 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:25:06.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T03:25:06.079 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T03:25:06.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T03:25:06.123 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T03:25:06.123 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:25:05.951+0000 7fbfe8d97640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:25:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: Traceback (most recent call last): 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._connections.run(self.expiration_interval) 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._run(expiration_interval) 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:25:06.124 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: s = self.context.wrap_socket( 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: return self.sslsocket_class._create( 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self.do_handshake() 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: self._sslobj.do_handshake() 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:25:06.125 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:25:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:25:06.170 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T03:25:06.170 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T03:25:06.211 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:06.212 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T03:25:06.212 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T03:25:06.263 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T03:25:06.263 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T03:25:06.269 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:06.271 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T03:25:06.271 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T03:25:06.316 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:25:06.316 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T03:25:06.368 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:25:06.368 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T03:25:06.387 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:06 smithi102 ceph-mon[31392]: Saving service mgr spec with placement smithi102=x;smithi121=y;smithi148=z;count:3 2024-09-21T03:25:06.387 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.387 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.387 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.387 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.399 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T03:25:06.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T03:25:06.451 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:25:06.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T03:25:06.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:06 smithi148 ceph-mon[34651]: Saving service mgr spec with placement smithi102=x;smithi121=y;smithi148=z;count:3 2024-09-21T03:25:06.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.497 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:25:06.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:25:06.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:06 smithi121 ceph-mon[34316]: Saving service mgr spec with placement smithi102=x;smithi121=y;smithi148=z;count:3 2024-09-21T03:25:06.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:06.546 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:25:06.546 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:25:06.596 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:25:06.596 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T03:25:06.643 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T03:25:06.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T03:25:06.685 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T03:25:06.685 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T03:25:06.730 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T03:25:06.730 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T03:25:06.777 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T03:25:06.778 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T03:25:06.828 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T03:25:06.828 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T03:25:06.878 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T03:25:06.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T03:25:06.929 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T03:25:06.929 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T03:25:06.981 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:25:06.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:25:07.030 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:25:07.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T03:25:07.079 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:25:07.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T03:25:07.120 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T03:25:07.121 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi102') 2024-09-21T03:25:07.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: [21/Sep/2024:03:25:05] ENGINE Bus STARTING 2024-09-21T03:25:07.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: [21/Sep/2024:03:25:05] ENGINE Serving on http://172.21.15.102:8765 2024-09-21T03:25:07.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: [21/Sep/2024:03:25:05] ENGINE Serving on https://172.21.15.102:7150 2024-09-21T03:25:07.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: [21/Sep/2024:03:25:05] ENGINE Bus STARTED 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: [21/Sep/2024:03:25:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: Traceback (most recent call last): 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._run(expiration_interval) 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:25:07.455 INFO:journalctl@ceph.mon.a.smithi102.stdout: s = self.context.wrap_socket( 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: return self.sslsocket_class._create( 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: self.do_handshake() 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: self._sslobj.do_handshake() 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: mgrmap e17: x(active, since 2s) 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.456 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:07.457 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:07.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: [21/Sep/2024:03:25:05] ENGINE Bus STARTING 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: [21/Sep/2024:03:25:05] ENGINE Serving on http://172.21.15.102:8765 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: [21/Sep/2024:03:25:05] ENGINE Serving on https://172.21.15.102:7150 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: [21/Sep/2024:03:25:05] ENGINE Bus STARTED 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: [21/Sep/2024:03:25:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: Traceback (most recent call last): 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._run(expiration_interval) 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:25:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: s = self.context.wrap_socket( 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: return self.sslsocket_class._create( 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: self.do_handshake() 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._sslobj.do_handshake() 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: mgrmap e17: x(active, since 2s) 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:07.538 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: [21/Sep/2024:03:25:05] ENGINE Bus STARTING 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: [21/Sep/2024:03:25:05] ENGINE Serving on http://172.21.15.102:8765 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: [21/Sep/2024:03:25:05] ENGINE Serving on https://172.21.15.102:7150 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: [21/Sep/2024:03:25:05] ENGINE Bus STARTED 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: [21/Sep/2024:03:25:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: Traceback (most recent call last): 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: self._run(expiration_interval) 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:25:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: s = self.context.wrap_socket( 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: return self.sslsocket_class._create( 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: self.do_handshake() 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: self._sslobj.do_handshake() 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: mgrmap e17: x(active, since 2s) 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi102", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi148", "name": "osd_memory_target"} : dispatch 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:07.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:08.251 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:08.499 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='client.? ' entity='client.admin' 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1446758127' entity='client.admin' 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:08.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:08.583 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='client.? ' entity='client.admin' 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.584 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1446758127' entity='client.admin' 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:08.585 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:08.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi102:/etc/ceph/ceph.conf 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi121:/etc/ceph/ceph.conf 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi148:/etc/ceph/ceph.conf 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: Updating smithi148:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='client.? ' entity='client.admin' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1446758127' entity='client.admin' 2024-09-21T03:25:08.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:08.608 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:08.914 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi102') 2024-09-21T03:25:08.938 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:09 smithi102 ceph-mon[31392]: Deploying daemon mgr.z on smithi148 2024-09-21T03:25:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:09 smithi121 ceph-mon[34316]: Deploying daemon mgr.z on smithi148 2024-09-21T03:25:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.629 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.630 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.633 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.633 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.639 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.639 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.645 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.645 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.646 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.649 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.665 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.668 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.670 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Updating smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.670 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Updating smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.670 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:25:09.670 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Updating smithi102:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:25:09.670 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Updating smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:25:09.671 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:09 smithi148 ceph-mon[34651]: Deploying daemon mgr.z on smithi148 2024-09-21T03:25:09.672 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.672 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.672 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.678 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:09.994 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:09 smithi148 systemd[1]: Starting Ceph mgr.z for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:25:10.323 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 podman[36615]: 2024-09-21 03:25:10.036622348 +0000 UTC m=+0.097533803 container create 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T03:25:10.323 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 podman[36615]: 2024-09-21 03:25:09.954899423 +0000 UTC m=+0.015810877 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:25:10.323 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 podman[36615]: 2024-09-21 03:25:10.238715687 +0000 UTC m=+0.299627142 container init 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T03:25:10.324 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 podman[36615]: 2024-09-21 03:25:10.241487061 +0000 UTC m=+0.302398518 container start 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T03:25:10.324 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mgr[36634]: -- 172.21.15.148:0/1050376914 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617873070e0 con 0x561787325a80 2024-09-21T03:25:10.693 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 bash[36615]: 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 2024-09-21T03:25:10.693 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:25:10 smithi148 systemd[1]: Started Ceph mgr.z for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/119711451' entity='client.admin' 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:10.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:10.925 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/119711451' entity='client.admin' 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/119711451' entity='client.admin' 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:10.995 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:11.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:11 smithi102 ceph-mon[31392]: Deploying daemon mgr.y on smithi121 2024-09-21T03:25:11.922 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:11 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3528293131' entity='client.admin' 2024-09-21T03:25:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:11 smithi148 ceph-mon[34651]: Deploying daemon mgr.y on smithi121 2024-09-21T03:25:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:11 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3528293131' entity='client.admin' 2024-09-21T03:25:12.017 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:11 smithi121 ceph-mon[34316]: Deploying daemon mgr.y on smithi121 2024-09-21T03:25:12.018 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:11 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3528293131' entity='client.admin' 2024-09-21T03:25:12.286 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 systemd[1]: Starting Ceph mgr.y for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:25:12.687 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 podman[35833]: 2024-09-21 03:25:12.425824476 +0000 UTC m=+0.112773368 container create d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:25:12.687 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 podman[35833]: 2024-09-21 03:25:12.32832309 +0000 UTC m=+0.015271983 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:25:12.687 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 podman[35833]: 2024-09-21 03:25:12.628160882 +0000 UTC m=+0.315109775 container init d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T03:25:12.687 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 podman[35833]: 2024-09-21 03:25:12.630975564 +0000 UTC m=+0.317924466 container start d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:25:12.688 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 ceph-mgr[35852]: -- 172.21.15.121:0/3373309741 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd76ced0e0 con 0x55dd76d0ba80 2024-09-21T03:25:12.688 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 bash[35833]: d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 2024-09-21T03:25:12.961 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:13.035 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:25:12 smithi121 systemd[1]: Started Ceph mgr.y for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2368093711' entity='client.admin' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2353922323' entity='client.admin' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2368093711' entity='client.admin' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2353922323' entity='client.admin' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2368093711' entity='client.admin' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2353922323' entity='client.admin' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:13.885 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:25:15.148 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: Reconfiguring daemon mgr.x on smithi102 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/259448803' entity='client.admin' 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.149 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1942938460' entity='client.admin' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: Reconfiguring daemon mgr.x on smithi102 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/259448803' entity='client.admin' 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1942938460' entity='client.admin' 2024-09-21T03:25:15.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: Reconfiguring daemon mgr.x on smithi102 2024-09-21T03:25:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/259448803' entity='client.admin' 2024-09-21T03:25:15.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:15.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1942938460' entity='client.admin' 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4de003fb70 msgr2=0x7f4de0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4de003fb70 0x7f4de0042080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009a60 tx=0x7f4de8005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df8108d70 msgr2=0x7f4df819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df8108d70 0x7f4df819fc20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005cc0 tx=0x7f4df0033000 comp rx=0 tx=0).stop 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 shutdown_connections 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4de003fb70 0x7f4de0042080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4df8108d70 0x7f4df819fc20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4df8108420 0x7f4df819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 --2- 172.21.15.102:0/297737260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4df8102ae0 0x7f4df819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 >> 172.21.15.102:0/297737260 conn(0x7f4df8079770 msgr2=0x7f4df8101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 shutdown_connections 2024-09-21T03:25:15.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:15.717+0000 7f4dfe307640 1 -- 172.21.15.102:0/297737260 wait complete. 2024-09-21T03:25:16.004 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: Standby manager daemon z started 2024-09-21T03:25:16.004 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:25:16.005 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:16.005 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:25:16.005 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:16.005 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:15 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/297737260' entity='client.admin' 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: Standby manager daemon z started 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:16.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:15 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/297737260' entity='client.admin' 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.256+0000 7f31b0ef6640 1 -- 172.21.15.102:0/132416490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1084c0 msgr2=0x7f31ac10ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.256+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/132416490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1084c0 0x7f31ac10ecf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f31a4009ca0 tx=0x7f31a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 -- 172.21.15.102:0/132416490 shutdown_connections 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/132416490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac1084c0 0x7f31ac10ecf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/132416490 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac107b70 0x7f31ac107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/132416490 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac102230 0x7f31ac102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 -- 172.21.15.102:0/132416490 >> 172.21.15.102:0/132416490 conn(0x7f31ac079e10 msgr2=0x7f31ac07a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 -- 172.21.15.102:0/132416490 shutdown_connections 2024-09-21T03:25:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.257+0000 7f31b0ef6640 1 -- 172.21.15.102:0/132416490 wait complete. 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 Processor -- start 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 -- start start 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac102230 0x7f31ac198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac1084c0 0x7f31ac1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac113ae0 con 0x7f31ac107b70 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac113960 con 0x7f31ac1084c0 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31b0ef6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f31ac113c60 con 0x7f31ac102230 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42730/0 (socket says 172.21.15.102:42730) 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 -- 172.21.15.102:0/3940160206 learned_addr learned my addr 172.21.15.102:0/3940160206 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31aa59c640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac102230 0x7f31ac198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31aad9d640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac1084c0 0x7f31ac1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 -- 172.21.15.102:0/3940160206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac102230 msgr2=0x7f31ac198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac102230 0x7f31ac198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 -- 172.21.15.102:0/3940160206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac1084c0 msgr2=0x7f31ac1a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac1084c0 0x7f31ac1a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.258+0000 7f31a9d9b640 1 -- 172.21.15.102:0/3940160206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31ac199da0 con 0x7f31ac107b70 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f31a9d9b640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017070 con 0x7f31ac107b70 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f31a0009c30 con 0x7f31ac107b70 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00047a0 con 0x7f31ac107b70 2024-09-21T03:25:16.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31ac1a0670 con 0x7f31ac107b70 2024-09-21T03:25:16.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.259+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31ac1a0bb0 con 0x7f31ac107b70 2024-09-21T03:25:16.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.260+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31ac102640 con 0x7f31ac107b70 2024-09-21T03:25:16.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.261+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 103195+0+0 (secure 0 0 0) 0x7f31a0004020 con 0x7f31ac107b70 2024-09-21T03:25:16.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.262+0000 7f319b7fe640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 0x7f319407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.262+0000 7f31aa59c640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 0x7f319407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.262+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f31a009c930 con 0x7f31ac107b70 2024-09-21T03:25:16.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.262+0000 7f31aa59c640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 0x7f319407d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31ac10eb60 tx=0x7f319c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.266+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31a0020020 con 0x7f31ac107b70 2024-09-21T03:25:16.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: Standby manager daemon z started 2024-09-21T03:25:16.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:25:16.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:16.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:25:16.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.148:0/1613121205' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:16.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:15 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/297737260' entity='client.admin' 2024-09-21T03:25:16.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.456+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f31ac1a0ed0 con 0x7f31ac107b70 2024-09-21T03:25:16.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.460+0000 7f319b7fe640 1 -- 172.21.15.102:0/3940160206 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f31a0069340 con 0x7f31ac107b70 2024-09-21T03:25:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 msgr2=0x7f319407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 0x7f319407d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31ac10eb60 tx=0x7f319c005f90 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 msgr2=0x7f31ac1994f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 shutdown_connections 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f319407b020 0x7f319407d530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f31ac107b70 0x7f31ac1994f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31ac1084c0 0x7f31ac1a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 --2- 172.21.15.102:0/3940160206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31ac102230 0x7f31ac198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 >> 172.21.15.102:0/3940160206 conn(0x7f31ac079e10 msgr2=0x7f31ac103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 shutdown_connections 2024-09-21T03:25:16.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.462+0000 7f31b0ef6640 1 -- 172.21.15.102:0/3940160206 wait complete. 2024-09-21T03:25:16.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 -- 172.21.15.102:0/156216603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958108cf0 msgr2=0x7fd95810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 --2- 172.21.15.102:0/156216603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958108cf0 0x7fd95810f520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd950009ca0 tx=0x7fd95002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 -- 172.21.15.102:0/156216603 shutdown_connections 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 --2- 172.21.15.102:0/156216603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958108cf0 0x7fd95810f520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 --2- 172.21.15.102:0/156216603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 0x7fd9581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 --2- 172.21.15.102:0/156216603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958102a60 0x7fd958102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 -- 172.21.15.102:0/156216603 >> 172.21.15.102:0/156216603 conn(0x7fd958079730 msgr2=0x7fd958079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 -- 172.21.15.102:0/156216603 shutdown_connections 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.884+0000 7fd95e489640 1 -- 172.21.15.102:0/156216603 wait complete. 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 Processor -- start 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 -- start start 2024-09-21T03:25:16.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 0x7fd95819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958108cf0 0x7fd95819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581129b0 con 0x7fd958102a60 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd958112830 con 0x7fd958108cf0 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd95e489640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd958112b30 con 0x7fd9581083a0 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd957fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd957fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42766/0 (socket says 172.21.15.102:42766) 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.886+0000 7fd957fff640 1 -- 172.21.15.102:0/184630715 learned_addr learned my addr 172.21.15.102:0/184630715 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd9577fe640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 0x7fd95819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd95ca26640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958108cf0 0x7fd95819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 -- 172.21.15.102:0/184630715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 msgr2=0x7fd95819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 0x7fd95819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 -- 172.21.15.102:0/184630715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958108cf0 msgr2=0x7fd95819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958108cf0 0x7fd95819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 -- 172.21.15.102:0/184630715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9581a6510 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd957fff640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd94800e9f0 tx=0x7fd94800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94800cd80 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fd9480108e0 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.887+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9581a6800 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.888+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948018900 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.888+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9581a6d40 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.889+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958102e70 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.889+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 103195+0+0 (secure 0 0 0) 0x7fd948018aa0 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.890+0000 7fd9557fa640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 0x7fd94007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.890+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd94809d1f0 con 0x7fd958102a60 2024-09-21T03:25:16.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.890+0000 7fd9577fe640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 0x7fd94007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:16.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.891+0000 7fd9577fe640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 0x7fd94007d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd958105ec0 tx=0x7fd94c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:16.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.894+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd948069c40 con 0x7fd958102a60 2024-09-21T03:25:17.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.092+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fd95810aae0 con 0x7fd958102a60 2024-09-21T03:25:17.095 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:16 smithi102 ceph-mon[31392]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T03:25:17.095 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:16 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:25:17.095 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:16 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3940160206' entity='client.admin' 2024-09-21T03:25:17.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.093+0000 7fd9557fa640 1 -- 172.21.15.102:0/184630715 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v20)=0 v20) ==== 108+0+0 (secure 0 0 0) 0x7fd94806eaf0 con 0x7fd958102a60 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 msgr2=0x7fd94007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 0x7fd94007d530 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd958105ec0 tx=0x7fd94c00b390 comp rx=0 tx=0).stop 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 msgr2=0x7fd95819b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd94800e9f0 tx=0x7fd94800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 shutdown_connections 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd94007b020 0x7fd94007d530 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd958108cf0 0x7fd95819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd9581083a0 0x7fd95819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 --2- 172.21.15.102:0/184630715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd958102a60 0x7fd95819b200 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 >> 172.21.15.102:0/184630715 conn(0x7fd958079730 msgr2=0x7fd958104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 shutdown_connections 2024-09-21T03:25:17.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.097+0000 7fd95e489640 1 -- 172.21.15.102:0/184630715 wait complete. 2024-09-21T03:25:17.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:16 smithi148 ceph-mon[34651]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T03:25:17.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:16 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:25:17.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:16 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3940160206' entity='client.admin' 2024-09-21T03:25:17.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:16 smithi121 ceph-mon[34316]: mgrmap e18: x(active, since 11s), standbys: z 2024-09-21T03:25:17.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:16 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:25:17.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:16 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3940160206' entity='client.admin' 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 -- 172.21.15.102:0/3228151256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358102ae0 msgr2=0x7f7358102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 --2- 172.21.15.102:0/3228151256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358102ae0 0x7f7358102ef0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7350009900 tx=0x7f735002a410 comp rx=0 tx=0).stop 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 -- 172.21.15.102:0/3228151256 shutdown_connections 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 --2- 172.21.15.102:0/3228151256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7358108d20 0x7f735810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 --2- 172.21.15.102:0/3228151256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f73581083d0 0x7f73581087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 --2- 172.21.15.102:0/3228151256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358102ae0 0x7f7358102ef0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 -- 172.21.15.102:0/3228151256 >> 172.21.15.102:0/3228151256 conn(0x7f7358079790 msgr2=0x7f7358079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 -- 172.21.15.102:0/3228151256 shutdown_connections 2024-09-21T03:25:17.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.616+0000 7f735d4a0640 1 -- 172.21.15.102:0/3228151256 wait complete. 2024-09-21T03:25:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 Processor -- start 2024-09-21T03:25:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 -- start start 2024-09-21T03:25:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7358102ae0 0x7f735819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73581083d0 0x7f735819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7358112a20 con 0x7f7358108d20 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f73581128a0 con 0x7f73581083d0 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f735d4a0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7358112ba0 con 0x7f7358102ae0 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42796/0 (socket says 172.21.15.102:42796) 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 -- 172.21.15.102:0/2948431805 learned_addr learned my addr 172.21.15.102:0/2948431805 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73567fc640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73581083d0 0x7f735819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f7356ffd640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7358102ae0 0x7f735819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 -- 172.21.15.102:0/2948431805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7358102ae0 msgr2=0x7f735819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7358102ae0 0x7f735819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 -- 172.21.15.102:0/2948431805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73581083d0 msgr2=0x7f735819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73581083d0 0x7f735819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.617+0000 7f73577fe640 1 -- 172.21.15.102:0/2948431805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73581a0450 con 0x7f7358108d20 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f73577fe640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f734800eaa0 tx=0x7f734800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7348004d20 con 0x7f7358108d20 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7348005020 con 0x7f7358108d20 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73581a0740 con 0x7f7358108d20 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480116d0 con 0x7f7358108d20 2024-09-21T03:25:17.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.618+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73581a6ea0 con 0x7f7358108d20 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.619+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7358102ef0 con 0x7f7358108d20 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.620+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 103195+0+0 (secure 0 0 0) 0x7f734800caf0 con 0x7f7358108d20 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.620+0000 7f733ffff640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 0x7f734007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.620+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f734809cef0 con 0x7f7358108d20 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.620+0000 7f7356ffd640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 0x7f734007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:17.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.621+0000 7f7356ffd640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 0x7f734007d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f73500058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:17.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.625+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7348016030 con 0x7f7358108d20 2024-09-21T03:25:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.810+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f73581a7130 con 0x7f7358108d20 2024-09-21T03:25:17.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.814+0000 7f733ffff640 1 -- 172.21.15.102:0/2948431805 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f734800cde0 con 0x7f7358108d20 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 msgr2=0x7f734007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 0x7f734007d530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7350006010 tx=0x7f73500058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 msgr2=0x7f735819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f734800eaa0 tx=0x7f734800eea0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 shutdown_connections 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f734007b020 0x7f734007d530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7358108d20 0x7f735819fd20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f73581083d0 0x7f735819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 --2- 172.21.15.102:0/2948431805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7358102ae0 0x7f735819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 >> 172.21.15.102:0/2948431805 conn(0x7f7358079790 msgr2=0x7f7358101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 shutdown_connections 2024-09-21T03:25:17.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.816+0000 7f735d4a0640 1 -- 172.21.15.102:0/2948431805 wait complete. 2024-09-21T03:25:18.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 -- 172.21.15.102:0/752244801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc1086f0 msgr2=0x7fe0fc108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 --2- 172.21.15.102:0/752244801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc108b00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009900 tx=0x7fe0ec02a410 comp rx=0 tx=0).stop 2024-09-21T03:25:18.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 -- 172.21.15.102:0/752244801 shutdown_connections 2024-09-21T03:25:18.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 --2- 172.21.15.102:0/752244801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc102730 0x7fe0fc110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 --2- 172.21.15.102:0/752244801 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 --2- 172.21.15.102:0/752244801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc108b00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 -- 172.21.15.102:0/752244801 >> 172.21.15.102:0/752244801 conn(0x7fe0fc077c60 msgr2=0x7fe0fc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 -- 172.21.15.102:0/752244801 shutdown_connections 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.816+0000 7fe101ae4640 1 -- 172.21.15.102:0/752244801 wait complete. 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.817+0000 7fe101ae4640 1 Processor -- start 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.817+0000 7fe101ae4640 1 -- start start 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc113af0 con 0x7fe0fc102730 2024-09-21T03:25:18.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc113970 con 0x7fe0fc1086f0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe101ae4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc113c70 con 0x7fe0fc101de0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe0faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42750/0 (socket says 172.21.15.102:42750) 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe0faffd640 1 -- 172.21.15.102:0/1541749398 learned_addr learned my addr 172.21.15.102:0/1541749398 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe0fb7fe640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.818+0000 7fe0fbfff640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 -- 172.21.15.102:0/1541749398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 msgr2=0x7fe0fc19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 -- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 msgr2=0x7fe0fc19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 -- 172.21.15.102:0/1541749398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc1a0450 con 0x7fe0fc101de0 2024-09-21T03:25:18.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fbfff640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0faffd640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0fb7fe640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc19a4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec02a930 tx=0x7fe0ec004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec03f070 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7fe0ec005530 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc1a06e0 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec035030 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.819+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a6ea0 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.820+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc06ab50 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.821+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 18) ==== 103195+0+0 (secure 0 0 0) 0x7fe0ec042070 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.822+0000 7fe0f8ff9640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 0x7fe0e407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.822+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe0ec0bd570 con 0x7fe0fc101de0 2024-09-21T03:25:18.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.822+0000 7fe0faffd640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 0x7fe0e407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.822+0000 7fe0faffd640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 0x7fe0e407d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc1060d0 tx=0x7fe0f000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:16.827+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0ec089f00 con 0x7fe0fc101de0 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.019+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fe0fc10bb70 con 0x7fe0fc101de0 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.026+0000 7fe0f8ff9640 1 -- 172.21.15.102:0/1541749398 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v20)=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fe0ec08edb0 con 0x7fe0fc101de0 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.028+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 msgr2=0x7fe0e407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.028+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 0x7fe0e407d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc1060d0 tx=0x7fe0f000b410 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 msgr2=0x7fe0fc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc19a4e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec02a930 tx=0x7fe0ec004f70 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 shutdown_connections 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0e407b020 0x7fe0e407d530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0fc102730 0x7fe0fc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0fc1086f0 0x7fe0fc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 --2- 172.21.15.102:0/1541749398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0fc101de0 0x7fe0fc19a4e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 >> 172.21.15.102:0/1541749398 conn(0x7fe0fc077c60 msgr2=0x7fe0fc107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 shutdown_connections 2024-09-21T03:25:18.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.029+0000 7fe101ae4640 1 -- 172.21.15.102:0/1541749398 wait complete. 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='client.? ' entity='client.admin' 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: Standby manager daemon y started 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:18.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:18 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2948431805' entity='client.admin' 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='client.? ' entity='client.admin' 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: Standby manager daemon y started 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:18.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:18 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2948431805' entity='client.admin' 2024-09-21T03:25:18.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='client.? ' entity='client.admin' 2024-09-21T03:25:18.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: Standby manager daemon y started 2024-09-21T03:25:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:25:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:25:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:25:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='mgr.? 172.21.15.121:0/2530416830' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:25:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:18 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2948431805' entity='client.admin' 2024-09-21T03:25:18.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 -- 172.21.15.102:0/99989967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888109df0 msgr2=0x7f5888110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 --2- 172.21.15.102:0/99989967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888109df0 0x7f5888110620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5880009ca0 tx=0x7f588002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 -- 172.21.15.102:0/99989967 shutdown_connections 2024-09-21T03:25:18.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 --2- 172.21.15.102:0/99989967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5888109df0 0x7f5888110620 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 --2- 172.21.15.102:0/99989967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58881094a0 0x7f58881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 --2- 172.21.15.102:0/99989967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 0x7f5888103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 -- 172.21.15.102:0/99989967 >> 172.21.15.102:0/99989967 conn(0x7f588807b850 msgr2=0x7f588807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 -- 172.21.15.102:0/99989967 shutdown_connections 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.947+0000 7f589005b640 1 -- 172.21.15.102:0/99989967 wait complete. 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 Processor -- start 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 -- start start 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 0x7f588819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5888109df0 0x7f58881a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113ab0 con 0x7f58881094a0 2024-09-21T03:25:18.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113930 con 0x7f5888109df0 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f589005b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5888113c30 con 0x7f5888103b60 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f588d5f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f588d5f6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42828/0 (socket says 172.21.15.102:42828) 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f588d5f6640 1 -- 172.21.15.102:0/3169042522 learned_addr learned my addr 172.21.15.102:0/3169042522 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f588e5f8640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5888109df0 0x7f58881a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.948+0000 7f588ddf7640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 0x7f588819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 -- 172.21.15.102:0/3169042522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 msgr2=0x7f588819c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 0x7f588819c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 -- 172.21.15.102:0/3169042522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5888109df0 msgr2=0x7f58881a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5888109df0 0x7f58881a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 -- 172.21.15.102:0/3169042522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58881a2590 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f588d5f6640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e9f0 tx=0x7f587c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c00ccc0 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f587c0108e0 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58881a2880 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587c018890 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.949+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58881a8fe0 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.950+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5888103f70 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.951+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 18) ==== 103195+0+0 (secure 0 0 0) 0x7f587c010430 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.952+0000 7f587affd640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 0x7f587407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.952+0000 7f588ddf7640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 0x7f587407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.952+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f587c09d190 con 0x7f58881094a0 2024-09-21T03:25:18.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.952+0000 7f588ddf7640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 0x7f587407d530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58840058c0 tx=0x7f588400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:17.956+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f587c069b20 con 0x7f58881094a0 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.031+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f587c061360 con 0x7f58881094a0 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.143+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f58881a91b0 con 0x7f58881094a0 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.147+0000 7f587affd640 1 -- 172.21.15.102:0/3169042522 <== mon.0 v2:172.21.15.102:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v22)=0 v22) ==== 108+0+0 (secure 0 0 0) 0x7f587c0b5f40 con 0x7f58881094a0 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 msgr2=0x7f587407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 0x7f587407d530 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f58840058c0 tx=0x7f588400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 msgr2=0x7f588819cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e9f0 tx=0x7f587c00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 shutdown_connections 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f587407b020 0x7f587407d530 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58881094a0 0x7f588819cbc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5888109df0 0x7f58881a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 --2- 172.21.15.102:0/3169042522 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5888103b60 0x7f588819c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 >> 172.21.15.102:0/3169042522 conn(0x7f588807b850 msgr2=0x7f5888105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 shutdown_connections 2024-09-21T03:25:18.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:18.149+0000 7f589005b640 1 -- 172.21.15.102:0/3169042522 wait complete. 2024-09-21T03:25:19.339 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:19 smithi102 ceph-mon[31392]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T03:25:19.339 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:25:19.339 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:19 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3169042522' entity='client.admin' 2024-09-21T03:25:19.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:19 smithi148 ceph-mon[34651]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T03:25:19.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:25:19.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:19 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3169042522' entity='client.admin' 2024-09-21T03:25:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:19 smithi121 ceph-mon[34316]: mgrmap e19: x(active, since 13s), standbys: z, y 2024-09-21T03:25:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:25:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:19 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3169042522' entity='client.admin' 2024-09-21T03:25:21.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 -- 172.21.15.102:0/3715090818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb68108d00 msgr2=0x7feb6810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 --2- 172.21.15.102:0/3715090818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb68108d00 0x7feb6810f530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7feb60009900 tx=0x7feb6002a410 comp rx=0 tx=0).stop 2024-09-21T03:25:21.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 -- 172.21.15.102:0/3715090818 shutdown_connections 2024-09-21T03:25:21.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 --2- 172.21.15.102:0/3715090818 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb68108d00 0x7feb6810f530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 --2- 172.21.15.102:0/3715090818 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb681083b0 0x7feb681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 --2- 172.21.15.102:0/3715090818 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 -- 172.21.15.102:0/3715090818 >> 172.21.15.102:0/3715090818 conn(0x7feb68079710 msgr2=0x7feb68079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 -- 172.21.15.102:0/3715090818 shutdown_connections 2024-09-21T03:25:21.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.222+0000 7feb6eec5640 1 -- 172.21.15.102:0/3715090818 wait complete. 2024-09-21T03:25:21.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 Processor -- start 2024-09-21T03:25:21.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 -- start start 2024-09-21T03:25:21.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb68108d00 0x7feb6819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb681129c0 con 0x7feb681083b0 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feb68112840 con 0x7feb68108d00 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.223+0000 7feb6eec5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb68112b40 con 0x7feb68102a70 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42840/0 (socket says 172.21.15.102:42840) 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 -- 172.21.15.102:0/2163565955 learned_addr learned my addr 172.21.15.102:0/2163565955 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb6d462640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb68108d00 0x7feb6819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb6cc61640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 -- 172.21.15.102:0/2163565955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 msgr2=0x7feb68199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 -- 172.21.15.102:0/2163565955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb68108d00 msgr2=0x7feb6819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb68108d00 0x7feb6819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 -- 172.21.15.102:0/2163565955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6819f1c0 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb6cc61640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb67fff640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d740 tx=0x7feb5000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50017070 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6819f4b0 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7feb5000de50 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.224+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5000f620 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.225+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb681a5cd0 con 0x7feb681083b0 2024-09-21T03:25:21.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.225+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb68103cf0 con 0x7feb681083b0 2024-09-21T03:25:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.227+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7feb5001a070 con 0x7feb681083b0 2024-09-21T03:25:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.227+0000 7feb65ffb640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 0x7feb540b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.228+0000 7feb6cc61640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 0x7feb540b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.228+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feb500e5110 con 0x7feb681083b0 2024-09-21T03:25:21.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.228+0000 7feb6cc61640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 0x7feb540b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb58007e70 tx=0x7feb58007850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:21.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.231+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb500ad5a0 con 0x7feb681083b0 2024-09-21T03:25:21.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.418+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7feb6810aaf0 con 0x7feb681083b0 2024-09-21T03:25:21.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.422+0000 7feb65ffb640 1 -- 172.21.15.102:0/2163565955 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7feb500b1980 con 0x7feb681083b0 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 msgr2=0x7feb540b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 0x7feb540b8a10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb58007e70 tx=0x7feb58007850 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 msgr2=0x7feb681998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d740 tx=0x7feb5000dc00 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 shutdown_connections 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb540b6500 0x7feb540b8a10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb681083b0 0x7feb681998b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb68108d00 0x7feb6819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 --2- 172.21.15.102:0/2163565955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb68102a70 0x7feb68199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 >> 172.21.15.102:0/2163565955 conn(0x7feb68079710 msgr2=0x7feb68106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 shutdown_connections 2024-09-21T03:25:21.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.426+0000 7feb6eec5640 1 -- 172.21.15.102:0/2163565955 wait complete. 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 -- 172.21.15.102:0/3578703995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954103160 msgr2=0x7f7954103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 --2- 172.21.15.102:0/3578703995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954103160 0x7f7954103570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7944009900 tx=0x7f794402a410 comp rx=0 tx=0).stop 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 -- 172.21.15.102:0/3578703995 shutdown_connections 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 --2- 172.21.15.102:0/3578703995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105ac0 0x7f795410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 --2- 172.21.15.102:0/3578703995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954105170 0x7f7954105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 --2- 172.21.15.102:0/3578703995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954103160 0x7f7954103570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 -- 172.21.15.102:0/3578703995 >> 172.21.15.102:0/3578703995 conn(0x7f7954077c60 msgr2=0x7f79540780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 -- 172.21.15.102:0/3578703995 shutdown_connections 2024-09-21T03:25:21.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.456+0000 7f795a0f0640 1 -- 172.21.15.102:0/3578703995 wait complete. 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 Processor -- start 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 -- start start 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 0x7f795419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 0x7f795419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f79541129c0 con 0x7f7954105ac0 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7954112840 con 0x7f7954105170 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f795a0f0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7954112b40 con 0x7f7954103160 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f7953fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 0x7f795419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f7952ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f79537fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 0x7f795419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f7952ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:51242/0 (socket says 172.21.15.102:51242) 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f7953fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 0x7f795419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42868/0 (socket says 172.21.15.102:42868) 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.457+0000 7f7952ffd640 1 -- 172.21.15.102:0/1822242415 learned_addr learned my addr 172.21.15.102:0/1822242415 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 -- 172.21.15.102:0/1822242415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 msgr2=0x7f795419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 -- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 msgr2=0x7f795419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 0x7f795419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 -- 172.21.15.102:0/1822242415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79541a0450 con 0x7f7954103160 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f7952ffd640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:21.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f79537fe640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 0x7f795419a4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7944009230 tx=0x7f79440042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794403e030 con 0x7f7954103160 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f7944003aa0 con 0x7f7954103160 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79541a06e0 con 0x7f7954103160 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.458+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7944035070 con 0x7f7954103160 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.459+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79540fecc0 con 0x7f7954103160 2024-09-21T03:25:21.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.459+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7954103ee0 con 0x7f7954103160 2024-09-21T03:25:21.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.461+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f7944041030 con 0x7f7954103160 2024-09-21T03:25:21.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.462+0000 7f7950ff9640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 0x7f793c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:21.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.462+0000 7f7952ffd640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 0x7f793c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:21.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.462+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f79441057b0 con 0x7f7954103160 2024-09-21T03:25:21.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.462+0000 7f7952ffd640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 0x7f793c0b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7954106270 tx=0x7f794800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:21.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.465+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79440d2000 con 0x7f7954103160 2024-09-21T03:25:21.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.650+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f795410ba60 con 0x7f7954103160 2024-09-21T03:25:21.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.658+0000 7f7950ff9640 1 -- 172.21.15.102:0/1822242415 <== mon.1 v2:172.21.15.148:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f79440d6f40 con 0x7f7954103160 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 msgr2=0x7f793c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 0x7f793c0b89e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7954106270 tx=0x7f794800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 msgr2=0x7f795419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 0x7f795419a4e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7944009230 tx=0x7f79440042f0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 shutdown_connections 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f793c0b64d0 0x7f793c0b89e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7954105ac0 0x7f795419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7954105170 0x7f795419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 --2- 172.21.15.102:0/1822242415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7954103160 0x7f795419a4e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:21.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 >> 172.21.15.102:0/1822242415 conn(0x7f7954077c60 msgr2=0x7f7954107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:21.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 shutdown_connections 2024-09-21T03:25:21.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:21.661+0000 7f795a0f0640 1 -- 172.21.15.102:0/1822242415 wait complete. 2024-09-21T03:25:22.599 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2163565955' entity='client.admin' 2024-09-21T03:25:22.599 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:22 smithi102 ceph-mon[31392]: from='client.? ' entity='client.admin' 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 -- 172.21.15.102:0/2347488140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd4109df0 msgr2=0x7f4bd4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2347488140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd4109df0 0x7f4bd4110620 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009ca0 tx=0x7f4bcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 -- 172.21.15.102:0/2347488140 shutdown_connections 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2347488140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd4109df0 0x7f4bd4110620 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2347488140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd41094a0 0x7f4bd41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2347488140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 -- 172.21.15.102:0/2347488140 >> 172.21.15.102:0/2347488140 conn(0x7f4bd407b850 msgr2=0x7f4bd407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 -- 172.21.15.102:0/2347488140 shutdown_connections 2024-09-21T03:25:22.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.597+0000 7f4bdb391640 1 -- 172.21.15.102:0/2347488140 wait complete. 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 Processor -- start 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 -- start start 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd4109df0 0x7f4bd419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4113ab0 con 0x7f4bd41094a0 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4113930 con 0x7f4bd4109df0 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.598+0000 7f4bdb391640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4113c30 con 0x7f4bd4103b60 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42886/0 (socket says 172.21.15.102:42886) 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 -- 172.21.15.102:0/2232608696 learned_addr learned my addr 172.21.15.102:0/2232608696 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd992e640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd4109df0 0x7f4bd419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd912d640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:22.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 -- 172.21.15.102:0/2232608696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 msgr2=0x7f4bd419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 -- 172.21.15.102:0/2232608696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd4109df0 msgr2=0x7f4bd419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd4109df0 0x7f4bd419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 -- 172.21.15.102:0/2232608696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd41a02f0 con 0x7f4bd41094a0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd912d640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bd892c640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c8c0 tx=0x7f4bc800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8007bb0 con 0x7f4bd41094a0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4bc8007d50 con 0x7f4bd41094a0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd41a05e0 con 0x7f4bd41094a0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8018790 con 0x7f4bd41094a0 2024-09-21T03:25:22.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.599+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd41a6e00 con 0x7f4bd41094a0 2024-09-21T03:25:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.600+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd4103f70 con 0x7f4bd41094a0 2024-09-21T03:25:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.603+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f4bc800f450 con 0x7f4bd41094a0 2024-09-21T03:25:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.603+0000 7f4bc67fc640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 0x7f4bc00b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:22.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.604+0000 7f4bd912d640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 0x7f4bc00b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:22.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.606+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4bc80e5740 con 0x7f4bd41094a0 2024-09-21T03:25:22.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.606+0000 7f4bd912d640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 0x7f4bc00b8a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000abe0 tx=0x7f4bd000a5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:22.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.609+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bc8014030 con 0x7f4bd41094a0 2024-09-21T03:25:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2163565955' entity='client.admin' 2024-09-21T03:25:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:22 smithi148 ceph-mon[34651]: from='client.? ' entity='client.admin' 2024-09-21T03:25:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2163565955' entity='client.admin' 2024-09-21T03:25:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:22 smithi121 ceph-mon[34316]: from='client.? ' entity='client.admin' 2024-09-21T03:25:22.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.792+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4bd410bbe0 con 0x7f4bd41094a0 2024-09-21T03:25:22.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.798+0000 7f4bc67fc640 1 -- 172.21.15.102:0/2232608696 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v25)=0 v25) ==== 120+0+0 (secure 0 0 0) 0x7f4bc80adbd0 con 0x7f4bd41094a0 2024-09-21T03:25:22.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 msgr2=0x7f4bc00b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:22.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 0x7f4bc00b8a90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000abe0 tx=0x7f4bd000a5c0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 msgr2=0x7f4bd419a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4bc800c8c0 tx=0x7f4bc800cd80 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 shutdown_connections 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4bc00b6580 0x7f4bc00b8a90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4bd41094a0 0x7f4bd419a9e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4bd4109df0 0x7f4bd419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 --2- 172.21.15.102:0/2232608696 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4bd4103b60 0x7f4bd419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 >> 172.21.15.102:0/2232608696 conn(0x7f4bd407b850 msgr2=0x7f4bd4107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 shutdown_connections 2024-09-21T03:25:22.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:22.800+0000 7f4bdb391640 1 -- 172.21.15.102:0/2232608696 wait complete. 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 -- 172.21.15.102:0/956641006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 msgr2=0x7f5ad81142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/956641006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81142c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009900 tx=0x7f5ac802a410 comp rx=0 tx=0).stop 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 -- 172.21.15.102:0/956641006 shutdown_connections 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/956641006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81142c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/956641006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 0x7f5ad811b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/956641006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 0x7f5ad810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 -- 172.21.15.102:0/956641006 >> 172.21.15.102:0/956641006 conn(0x7f5ad810a3c0 msgr2=0x7f5ad810c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 -- 172.21.15.102:0/956641006 shutdown_connections 2024-09-21T03:25:23.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.361+0000 7f5adf6c8640 1 -- 172.21.15.102:0/956641006 wait complete. 2024-09-21T03:25:23.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 Processor -- start 2024-09-21T03:25:23.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 -- start start 2024-09-21T03:25:23.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 0x7f5ad81a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 0x7f5ad81aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad811e4c0 con 0x7f5ad8113eb0 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad811e340 con 0x7f5ad8114800 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adf6c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad811e640 con 0x7f5ad810e5c0 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adcc63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adcc63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42898/0 (socket says 172.21.15.102:42898) 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5adcc63640 1 -- 172.21.15.102:0/2115563890 learned_addr learned my addr 172.21.15.102:0/2115563890 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5add464640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 0x7f5ad81a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.362+0000 7f5addc65640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 0x7f5ad81aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 -- 172.21.15.102:0/2115563890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 msgr2=0x7f5ad81a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 0x7f5ad81a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 -- 172.21.15.102:0/2115563890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 msgr2=0x7f5ad81aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 0x7f5ad81aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 -- 172.21.15.102:0/2115563890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad81aae00 con 0x7f5ad8113eb0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adcc63640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8005940 tx=0x7f5ac80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac803f030 con 0x7f5ad8113eb0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad81ab090 con 0x7f5ad8113eb0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f5ac8003aa0 con 0x7f5ad8113eb0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad81b1850 con 0x7f5ad8113eb0 2024-09-21T03:25:23.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.363+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8049060 con 0x7f5ad8113eb0 2024-09-21T03:25:23.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.364+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad810e9d0 con 0x7f5ad8113eb0 2024-09-21T03:25:23.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.366+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f5ac8042030 con 0x7f5ad8113eb0 2024-09-21T03:25:23.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.366+0000 7f5ace7fc640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 0x7f5ac40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:23.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.367+0000 7f5add464640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 0x7f5ac40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:23.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.367+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5ac8105f60 con 0x7f5ad8113eb0 2024-09-21T03:25:23.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.367+0000 7f5add464640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 0x7f5ac40b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40058c0 tx=0x7f5ad400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:23.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.370+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ac80d27d0 con 0x7f5ad8113eb0 2024-09-21T03:25:23.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.553+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f5ad81165f0 con 0x7f5ad8113eb0 2024-09-21T03:25:23.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.558+0000 7f5ace7fc640 1 -- 172.21.15.102:0/2115563890 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v26)=0 v26) ==== 116+0+0 (secure 0 0 0) 0x7f5ac80d7710 con 0x7f5ad8113eb0 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 msgr2=0x7f5ac40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 0x7f5ac40b89e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40058c0 tx=0x7f5ad400a250 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 msgr2=0x7f5ad81a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8005940 tx=0x7f5ac80042f0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 shutdown_connections 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ac40b64d0 0x7f5ac40b89e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ad8113eb0 0x7f5ad81a5430 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ad8114800 0x7f5ad81aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 --2- 172.21.15.102:0/2115563890 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ad810e5c0 0x7f5ad81a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:23.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 >> 172.21.15.102:0/2115563890 conn(0x7f5ad810a3c0 msgr2=0x7f5ad81134c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:23.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 shutdown_connections 2024-09-21T03:25:23.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:23.561+0000 7f5adf6c8640 1 -- 172.21.15.102:0/2115563890 wait complete. 2024-09-21T03:25:23.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:23 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2232608696' entity='client.admin' 2024-09-21T03:25:23.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:23 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2115563890' entity='client.admin' 2024-09-21T03:25:24.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:23 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2232608696' entity='client.admin' 2024-09-21T03:25:24.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:23 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2115563890' entity='client.admin' 2024-09-21T03:25:24.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:23 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2232608696' entity='client.admin' 2024-09-21T03:25:24.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:23 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2115563890' entity='client.admin' 2024-09-21T03:25:24.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.401+0000 7f45557b8640 1 -- 172.21.15.102:0/187090545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550103b90 msgr2=0x7f4550103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:24.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.401+0000 7f45557b8640 1 --2- 172.21.15.102:0/187090545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550103b90 0x7f4550103fa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4540009900 tx=0x7f454002a410 comp rx=0 tx=0).stop 2024-09-21T03:25:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 -- 172.21.15.102:0/187090545 shutdown_connections 2024-09-21T03:25:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 --2- 172.21.15.102:0/187090545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550109e20 0x7f4550110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 --2- 172.21.15.102:0/187090545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f45501098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 --2- 172.21.15.102:0/187090545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550103b90 0x7f4550103fa0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 -- 172.21.15.102:0/187090545 >> 172.21.15.102:0/187090545 conn(0x7f45500ff5e0 msgr2=0x7f4550101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:24.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 -- 172.21.15.102:0/187090545 shutdown_connections 2024-09-21T03:25:24.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.402+0000 7f45557b8640 1 -- 172.21.15.102:0/187090545 wait complete. 2024-09-21T03:25:24.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.403+0000 7f45557b8640 1 Processor -- start 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.403+0000 7f45557b8640 1 -- start start 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.403+0000 7f45557b8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550103b90 0x7f455019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.403+0000 7f45557b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f455019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.403+0000 7f45557b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45557b8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4550113ae0 con 0x7f4550109e20 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45557b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4550113960 con 0x7f45501094d0 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45557b8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4550113c60 con 0x7f4550103b90 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34106/0 (socket says 172.21.15.102:34106) 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 -- 172.21.15.102:0/2100917916 learned_addr learned my addr 172.21.15.102:0/2100917916 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45467fc640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f455019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454effd640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550103b90 0x7f455019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:24.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 -- 172.21.15.102:0/2100917916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550103b90 msgr2=0x7f455019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550103b90 0x7f455019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 -- 172.21.15.102:0/2100917916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 msgr2=0x7f455019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f455019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 -- 172.21.15.102:0/2100917916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45501a0420 con 0x7f4550109e20 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45467fc640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f455019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454f7fe640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f454800eaa0 tx=0x7f454800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454800cdb0 con 0x7f4550109e20 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f4548005020 con 0x7f4550109e20 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.404+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45501a0710 con 0x7f4550109e20 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.405+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45480116d0 con 0x7f4550109e20 2024-09-21T03:25:24.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.405+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45501a6e70 con 0x7f4550109e20 2024-09-21T03:25:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.406+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4550103fa0 con 0x7f4550109e20 2024-09-21T03:25:24.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.407+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f4548005560 con 0x7f4550109e20 2024-09-21T03:25:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.408+0000 7f454cff9640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 0x7f453c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.408+0000 7f454effd640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 0x7f453c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.408+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f45480e5c90 con 0x7f4550109e20 2024-09-21T03:25:24.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.409+0000 7f454effd640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 0x7f453c0b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4540006010 tx=0x7f45400058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:24.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.411+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4548016030 con 0x7f4550109e20 2024-09-21T03:25:24.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.595+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f455019b5e0 con 0x7f4550109e20 2024-09-21T03:25:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.599+0000 7f454cff9640 1 -- 172.21.15.102:0/2100917916 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f455019b5e0 con 0x7f4550109e20 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 msgr2=0x7f453c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 0x7f453c0b89e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4540006010 tx=0x7f45400058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 msgr2=0x7f455019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f454800eaa0 tx=0x7f454800ef60 comp rx=0 tx=0).stop 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 shutdown_connections 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f453c0b64d0 0x7f453c0b89e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4550109e20 0x7f455019fcf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f45501094d0 0x7f455019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 --2- 172.21.15.102:0/2100917916 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4550103b90 0x7f455019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 >> 172.21.15.102:0/2100917916 conn(0x7f45500ff5e0 msgr2=0x7f4550101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 shutdown_connections 2024-09-21T03:25:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:24.602+0000 7f45557b8640 1 -- 172.21.15.102:0/2100917916 wait complete. 2024-09-21T03:25:24.914 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:24 smithi102 ceph-mon[31392]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:24.914 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:24 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2100917916' entity='client.admin' 2024-09-21T03:25:25.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:24 smithi148 ceph-mon[34651]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:25.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:24 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2100917916' entity='client.admin' 2024-09-21T03:25:25.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:24 smithi121 ceph-mon[34316]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:25.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:24 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2100917916' entity='client.admin' 2024-09-21T03:25:25.992 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 -- 172.21.15.102:0/833529796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac108d20 msgr2=0x7f37ac10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 --2- 172.21.15.102:0/833529796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac108d20 0x7f37ac10f550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f379c009900 tx=0x7f379c02a410 comp rx=0 tx=0).stop 2024-09-21T03:25:26.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 -- 172.21.15.102:0/833529796 shutdown_connections 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 --2- 172.21.15.102:0/833529796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac108d20 0x7f37ac10f550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 --2- 172.21.15.102:0/833529796 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac1083d0 0x7f37ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 --2- 172.21.15.102:0/833529796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 0x7f37ac102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 -- 172.21.15.102:0/833529796 >> 172.21.15.102:0/833529796 conn(0x7f37ac079750 msgr2=0x7f37ac079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 -- 172.21.15.102:0/833529796 shutdown_connections 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.382+0000 7f37b1059640 1 -- 172.21.15.102:0/833529796 wait complete. 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 Processor -- start 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 -- start start 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 0x7f37ac1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac108d20 0x7f37ac19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac112990 con 0x7f37ac1083d0 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac112810 con 0x7f37ac102a90 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37b1059640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37ac112b10 con 0x7f37ac108d20 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37aa59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37aa59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34122/0 (socket says 172.21.15.102:34122) 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37aa59c640 1 -- 172.21.15.102:0/3863160638 learned_addr learned my addr 172.21.15.102:0/3863160638 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.383+0000 7f37aad9d640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 0x7f37ac1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37ab59e640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac108d20 0x7f37ac19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 -- 172.21.15.102:0/3863160638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac108d20 msgr2=0x7f37ac19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac108d20 0x7f37ac19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 -- 172.21.15.102:0/3863160638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 msgr2=0x7f37ac1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 0x7f37ac1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 -- 172.21.15.102:0/3863160638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ac19f310 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37aa59c640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f379400d770 tx=0x7f379400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3794017070 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ac19f600 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(26 keys) ==== 1104+0+0 (secure 0 0 0) 0x7f3794009c30 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f379400f620 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.384+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ac1a5d60 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.385+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ac103d10 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.387+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f379401a070 con 0x7f37ac1083d0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.387+0000 7f37a3fff640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 0x7f37980b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.387+0000 7f37aad9d640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 0x7f37980b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:26.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.387+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f37940e50e0 con 0x7f37ac1083d0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.388+0000 7f37aad9d640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 0x7f37980b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37a4005fd0 tx=0x7f37a4009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.390+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3794009de0 con 0x7f37ac1083d0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.593+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f37ac102ea0 con 0x7f37ac1083d0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.597+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v28)=0 v28) ==== 123+0+0 (secure 0 0 0) 0x7f37ac102ea0 con 0x7f37ac1083d0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.598+0000 7f37a3fff640 1 -- 172.21.15.102:0/3863160638 <== mon.0 v2:172.21.15.102:3300/0 8 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37940aca30 con 0x7f37ac1083d0 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.599+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 msgr2=0x7f37980b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.599+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 0x7f37980b89e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37a4005fd0 tx=0x7f37a4009680 comp rx=0 tx=0).stop 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.599+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 msgr2=0x7f37ac199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.599+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f379400d770 tx=0x7f379400dc30 comp rx=0 tx=0).stop 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 shutdown_connections 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37980b64d0 0x7f37980b89e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37ac1083d0 0x7f37ac199940 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37ac108d20 0x7f37ac19ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 --2- 172.21.15.102:0/3863160638 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37ac102a90 0x7f37ac1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 >> 172.21.15.102:0/3863160638 conn(0x7f37ac079750 msgr2=0x7f37ac104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 shutdown_connections 2024-09-21T03:25:26.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.600+0000 7f37b1059640 1 -- 172.21.15.102:0/3863160638 wait complete. 2024-09-21T03:25:26.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:26 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3863160638' entity='client.admin' 2024-09-21T03:25:26.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:26 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3948098310' entity='client.admin' 2024-09-21T03:25:26.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:26 smithi102 ceph-mon[31392]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:26.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:26 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3863160638' entity='client.admin' 2024-09-21T03:25:26.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:26 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3948098310' entity='client.admin' 2024-09-21T03:25:26.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:26 smithi148 ceph-mon[34651]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:27.028 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:26 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3863160638' entity='client.admin' 2024-09-21T03:25:27.028 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:26 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3948098310' entity='client.admin' 2024-09-21T03:25:27.028 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:26 smithi121 ceph-mon[34316]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:28.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.487+0000 7f430e17f640 1 -- 172.21.15.102:0/2921164590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308102ae0 msgr2=0x7f4308102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.487+0000 7f430e17f640 1 --2- 172.21.15.102:0/2921164590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308102ae0 0x7f4308102ef0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009900 tx=0x7f42f802a410 comp rx=0 tx=0).stop 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 -- 172.21.15.102:0/2921164590 shutdown_connections 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 --2- 172.21.15.102:0/2921164590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308108d70 0x7f430810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 --2- 172.21.15.102:0/2921164590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 0x7f4308108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 --2- 172.21.15.102:0/2921164590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308102ae0 0x7f4308102ef0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 -- 172.21.15.102:0/2921164590 >> 172.21.15.102:0/2921164590 conn(0x7f4308079770 msgr2=0x7f4308079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 -- 172.21.15.102:0/2921164590 shutdown_connections 2024-09-21T03:25:28.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 -- 172.21.15.102:0/2921164590 wait complete. 2024-09-21T03:25:28.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.488+0000 7f430e17f640 1 Processor -- start 2024-09-21T03:25:28.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 -- start start 2024-09-21T03:25:28.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308102ae0 0x7f4308199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:28.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 0x7f4308199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4308112b70 con 0x7f4308108d70 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43081129f0 con 0x7f4308108420 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f430e17f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4308112cf0 con 0x7f4308102ae0 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f4307fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f4307fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34156/0 (socket says 172.21.15.102:34156) 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f4307fff640 1 -- 172.21.15.102:0/4080248131 learned_addr learned my addr 172.21.15.102:0/4080248131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f43077fe640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308102ae0 0x7f4308199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.489+0000 7f42feffd640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 0x7f4308199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 -- 172.21.15.102:0/4080248131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308102ae0 msgr2=0x7f4308199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308102ae0 0x7f4308199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 -- 172.21.15.102:0/4080248131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 msgr2=0x7f4308199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:28.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 0x7f4308199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 -- 172.21.15.102:0/4080248131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430819f400 con 0x7f4308108d70 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f4307fff640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f430000ebb0 tx=0x7f4300007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300007ca0 con 0x7f4308108d70 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4300007e40 con 0x7f4308108d70 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430819f690 con 0x7f4308108d70 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300005870 con 0x7f4308108d70 2024-09-21T03:25:28.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.490+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430806bb60 con 0x7f4308108d70 2024-09-21T03:25:28.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.491+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4308103d60 con 0x7f4308108d70 2024-09-21T03:25:28.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.493+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f4300004a40 con 0x7f4308108d70 2024-09-21T03:25:28.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.494+0000 7f43057fa640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 0x7f42f40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:28.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.494+0000 7f43077fe640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 0x7f42f40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:28.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.494+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f43000e70c0 con 0x7f4308108d70 2024-09-21T03:25:28.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.494+0000 7f43077fe640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 0x7f42f40b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009230 tx=0x7f42f80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:28.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.497+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43000b3930 con 0x7f4308108d70 2024-09-21T03:25:28.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi102') 2024-09-21T03:25:28.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.682+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f4308102ef0 con 0x7f4308108d70 2024-09-21T03:25:28.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.686+0000 7f43057fa640 1 -- 172.21.15.102:0/4080248131 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v30)=0 v30) ==== 127+0+0 (secure 0 0 0) 0x7f43000b8870 con 0x7f4308108d70 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.688+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 msgr2=0x7f42f40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.688+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 0x7f42f40b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009230 tx=0x7f42f80058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.688+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 msgr2=0x7f430819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.688+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f430000ebb0 tx=0x7f4300007590 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 shutdown_connections 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42f40b64d0 0x7f42f40b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4308108d70 0x7f430819ecd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4308108420 0x7f4308199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 --2- 172.21.15.102:0/4080248131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4308102ae0 0x7f4308199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 >> 172.21.15.102:0/4080248131 conn(0x7f4308079770 msgr2=0x7f43081063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:28.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 shutdown_connections 2024-09-21T03:25:28.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.689+0000 7f430e17f640 1 -- 172.21.15.102:0/4080248131 wait complete. 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 -- 172.21.15.102:0/3850285826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf0102a60 msgr2=0x7f4cf0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/3850285826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf0102a60 0x7f4cf0102e70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009900 tx=0x7f4ce002a410 comp rx=0 tx=0).stop 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 -- 172.21.15.102:0/3850285826 shutdown_connections 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/3850285826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf0108cf0 0x7f4cf010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/3850285826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf01083a0 0x7f4cf01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/3850285826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf0102a60 0x7f4cf0102e70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 -- 172.21.15.102:0/3850285826 >> 172.21.15.102:0/3850285826 conn(0x7f4cf0079730 msgr2=0x7f4cf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 -- 172.21.15.102:0/3850285826 shutdown_connections 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.917+0000 7f4cf5e21640 1 -- 172.21.15.102:0/3850285826 wait complete. 2024-09-21T03:25:29.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.918+0000 7f4cf5e21640 1 Processor -- start 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.918+0000 7f4cf5e21640 1 -- start start 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.918+0000 7f4cf5e21640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf0102a60 0x7f4cf0199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf0108cf0 0x7f4cf019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0112a80 con 0x7f4cf01083a0 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0112900 con 0x7f4cf0108cf0 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0112c00 con 0x7f4cf0102a60 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34174/0 (socket says 172.21.15.102:34174) 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 -- 172.21.15.102:0/65360341 learned_addr learned my addr 172.21.15.102:0/65360341 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cef7fe640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf0102a60 0x7f4cf0199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:29.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 -- 172.21.15.102:0/65360341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf0102a60 msgr2=0x7f4cf0199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf0102a60 0x7f4cf0199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 -- 172.21.15.102:0/65360341 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf0108cf0 msgr2=0x7f4cf019ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf0108cf0 0x7f4cf019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 -- 172.21.15.102:0/65360341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf019f2e0 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ce7fff640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c970 tx=0x7f4cd800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8007bb0 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4cd8007d50 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf019f5d0 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800f450 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.919+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf006ae60 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.920+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf0103ce0 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.923+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f4cd80046c0 con 0x7f4cf01083a0 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.923+0000 7f4ced7fa640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 0x7f4cdc0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:29.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.923+0000 7f4cef7fe640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 0x7f4cdc0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.923+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4cd80e57d0 con 0x7f4cf01083a0 2024-09-21T03:25:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.924+0000 7f4cef7fe640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 0x7f4cdc0b8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0000c00 tx=0x7f4ce0005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:29.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:28.927+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cd8014030 con 0x7f4cf01083a0 2024-09-21T03:25:29.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.109+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f4cf0102e70 con 0x7f4cf01083a0 2024-09-21T03:25:29.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.114+0000 7f4ced7fa640 1 -- 172.21.15.102:0/65360341 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v31)=0 v31) ==== 115+0+0 (secure 0 0 0) 0x7f4cf0102e70 con 0x7f4cf01083a0 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 msgr2=0x7f4cdc0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 0x7f4cdc0b8a90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0000c00 tx=0x7f4ce0005d50 comp rx=0 tx=0).stop 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 msgr2=0x7f4cf01999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800c970 tx=0x7f4cd800ce30 comp rx=0 tx=0).stop 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 shutdown_connections 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4cdc0b6580 0x7f4cdc0b8a90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4cf01083a0 0x7f4cf01999d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4cf0108cf0 0x7f4cf019ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 --2- 172.21.15.102:0/65360341 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4cf0102a60 0x7f4cf0199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 >> 172.21.15.102:0/65360341 conn(0x7f4cf0079730 msgr2=0x7f4cf0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 shutdown_connections 2024-09-21T03:25:29.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:29.116+0000 7f4cf5e21640 1 -- 172.21.15.102:0/65360341 wait complete. 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:29.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:29 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4080248131' entity='client.admin' 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:29 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4080248131' entity='client.admin' 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:29.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:29 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4080248131' entity='client.admin' 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 -- 172.21.15.102:0/2354365725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c102a80 msgr2=0x7f448c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 --2- 172.21.15.102:0/2354365725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c102a80 0x7f448c102e90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4480009900 tx=0x7f448002a410 comp rx=0 tx=0).stop 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 -- 172.21.15.102:0/2354365725 shutdown_connections 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 --2- 172.21.15.102:0/2354365725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 --2- 172.21.15.102:0/2354365725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c1083c0 0x7f448c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 --2- 172.21.15.102:0/2354365725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c102a80 0x7f448c102e90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 -- 172.21.15.102:0/2354365725 >> 172.21.15.102:0/2354365725 conn(0x7f448c079740 msgr2=0x7f448c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 -- 172.21.15.102:0/2354365725 shutdown_connections 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.834+0000 7f4493e71640 1 -- 172.21.15.102:0/2354365725 wait complete. 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 Processor -- start 2024-09-21T03:25:30.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 -- start start 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 0x7f448c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f448c113bc0 con 0x7f448c1083c0 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f448c113a40 con 0x7f448c102a80 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.835+0000 7f4493e71640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f448c113d40 con 0x7f448c108d10 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34134/0 (socket says 172.21.15.102:34134) 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 -- 172.21.15.102:0/3948098310 learned_addr learned my addr 172.21.15.102:0/3948098310 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449240e640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f4491c0d640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 0x7f448c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 -- 172.21.15.102:0/3948098310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 msgr2=0x7f448c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:30.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 -- 172.21.15.102:0/3948098310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 msgr2=0x7f448c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 0x7f448c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 -- 172.21.15.102:0/3948098310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448c1a04a0 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449240e640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f4491c0d640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 0x7f448c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f449140c640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4488005fd0 tx=0x7f448800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488017070 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448c1a0790 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4488009c30 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488003de0 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.836+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f448c1a6ef0 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.837+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448c103d00 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.839+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f4488003f80 con 0x7f448c1083c0 2024-09-21T03:25:30.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.840+0000 7f447effd640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 0x7f44780b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.840+0000 7f4491c0d640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 0x7f44780b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.840+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f44880e5c60 con 0x7f448c1083c0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.840+0000 7f4491c0d640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 0x7f44780b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f4480032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:25.844+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4488020030 con 0x7f448c1083c0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.043+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f448c102e90 con 0x7f448c1083c0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.048+0000 7f447effd640 1 -- 172.21.15.102:0/3948098310 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7f4488009de0 con 0x7f448c1083c0 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 msgr2=0x7f44780b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 0x7f44780b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4480000c00 tx=0x7f4480032c70 comp rx=0 tx=0).stop 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 msgr2=0x7f448c19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4488005fd0 tx=0x7f448800dde0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 shutdown_connections 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44780b64d0 0x7f44780b89e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f448c1083c0 0x7f448c19aad0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f448c108d10 0x7f448c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 --2- 172.21.15.102:0/3948098310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f448c102a80 0x7f448c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:30.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.050+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 >> 172.21.15.102:0/3948098310 conn(0x7f448c079740 msgr2=0x7f448c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:30.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.051+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 shutdown_connections 2024-09-21T03:25:30.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:26.051+0000 7f4493e71640 1 -- 172.21.15.102:0/3948098310 wait complete. 2024-09-21T03:25:30.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:30 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/65360341' entity='client.admin' 2024-09-21T03:25:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:30 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/65360341' entity='client.admin' 2024-09-21T03:25:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:30.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:30 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/65360341' entity='client.admin' 2024-09-21T03:25:30.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:31.371 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:31 smithi102 ceph-mon[31392]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:31.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:31 smithi148 ceph-mon[34651]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:31 smithi121 ceph-mon[34316]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:32.765 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:32.765 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:32.767 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:32.767 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:32.811 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi102') 2024-09-21T03:25:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi102') 2024-09-21T03:25:32.812 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.308 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:33.309 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:33.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.343 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi102') 2024-09-21T03:25:33.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:33 smithi102 ceph-mon[31392]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:33 smithi148 ceph-mon[34651]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:33.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:33 smithi121 ceph-mon[34316]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:33.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 -- 172.21.15.102:0/710722166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d81083a0 msgr2=0x7f19d81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 --2- 172.21.15.102:0/710722166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d81083a0 0x7f19d81087b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009900 tx=0x7f19cc02a410 comp rx=0 tx=0).stop 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 -- 172.21.15.102:0/710722166 shutdown_connections 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 --2- 172.21.15.102:0/710722166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d81083a0 0x7f19d81087b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 --2- 172.21.15.102:0/710722166 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d8108cf0 0x7f19d810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 --2- 172.21.15.102:0/710722166 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 0x7f19d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 -- 172.21.15.102:0/710722166 >> 172.21.15.102:0/710722166 conn(0x7f19d8079730 msgr2=0x7f19d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 -- 172.21.15.102:0/710722166 shutdown_connections 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.806+0000 7f19dfa46640 1 -- 172.21.15.102:0/710722166 wait complete. 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 Processor -- start 2024-09-21T03:25:33.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 -- start start 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 0x7f19d81050e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d81083a0 0x7f19d8105620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8112b60 con 0x7f19d8108cf0 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19d81129e0 con 0x7f19d8102a60 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dfa46640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8112ce0 con 0x7f19d81083a0 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19ddfe3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19ddfe3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34194/0 (socket says 172.21.15.102:34194) 2024-09-21T03:25:33.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19ddfe3640 1 -- 172.21.15.102:0/3550021078 learned_addr learned my addr 172.21.15.102:0/3550021078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dd7e2640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 0x7f19d81050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.807+0000 7f19dcfe1640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d81083a0 0x7f19d8105620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 -- 172.21.15.102:0/3550021078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d81083a0 msgr2=0x7f19d8105620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d81083a0 0x7f19d8105620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 -- 172.21.15.102:0/3550021078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 msgr2=0x7f19d81050e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 0x7f19d81050e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 -- 172.21.15.102:0/3550021078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81a89b0 con 0x7f19d8108cf0 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19ddfe3640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009fd0 tx=0x7f19c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c8011830 con 0x7f19d8108cf0 2024-09-21T03:25:33.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f19c8016070 con 0x7f19d8108cf0 2024-09-21T03:25:33.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81a8ca0 con 0x7f19d8108cf0 2024-09-21T03:25:33.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800f2e0 con 0x7f19d8108cf0 2024-09-21T03:25:33.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.808+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81a9160 con 0x7f19d8108cf0 2024-09-21T03:25:33.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.809+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8102ef0 con 0x7f19d8108cf0 2024-09-21T03:25:33.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.812+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f19c80119d0 con 0x7f19d8108cf0 2024-09-21T03:25:33.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.812+0000 7f19d67fc640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 0x7f19c00b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:33.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.813+0000 7f19dd7e2640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 0x7f19c00b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:33.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.813+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f19c80e5310 con 0x7f19d8108cf0 2024-09-21T03:25:33.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.813+0000 7f19dd7e2640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 0x7f19c00b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19d8106b30 tx=0x7f19d000d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:33.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:33.816+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19c80ad7a0 con 0x7f19d8108cf0 2024-09-21T03:25:34.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.001+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f19d81063e0 con 0x7f19d8108cf0 2024-09-21T03:25:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.006+0000 7f19d67fc640 1 -- 172.21.15.102:0/3550021078 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f19d81063e0 con 0x7f19d8108cf0 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 msgr2=0x7f19c00b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 0x7f19c00b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f19d8106b30 tx=0x7f19d000d040 comp rx=0 tx=0).stop 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 msgr2=0x7f19d8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009fd0 tx=0x7f19c800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 shutdown_connections 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19c00b64d0 0x7f19c00b89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f19d8108cf0 0x7f19d8105b60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f19d81083a0 0x7f19d8105620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 --2- 172.21.15.102:0/3550021078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19d8102a60 0x7f19d81050e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 >> 172.21.15.102:0/3550021078 conn(0x7f19d8079730 msgr2=0x7f19d80ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 shutdown_connections 2024-09-21T03:25:34.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.008+0000 7f19dfa46640 1 -- 172.21.15.102:0/3550021078 wait complete. 2024-09-21T03:25:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 -- 172.21.15.102:0/552182465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c103b60 msgr2=0x7f8a0c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 --2- 172.21.15.102:0/552182465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c103b60 0x7f8a0c103f70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009900 tx=0x7f8a0802a410 comp rx=0 tx=0).stop 2024-09-21T03:25:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 -- 172.21.15.102:0/552182465 shutdown_connections 2024-09-21T03:25:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 --2- 172.21.15.102:0/552182465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c109df0 0x7f8a0c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 --2- 172.21.15.102:0/552182465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c1094a0 0x7f8a0c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 --2- 172.21.15.102:0/552182465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c103b60 0x7f8a0c103f70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 -- 172.21.15.102:0/552182465 >> 172.21.15.102:0/552182465 conn(0x7f8a0c07b850 msgr2=0x7f8a0c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 -- 172.21.15.102:0/552182465 shutdown_connections 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.637+0000 7f8a1461a640 1 -- 172.21.15.102:0/552182465 wait complete. 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 Processor -- start 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 -- start start 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c103b60 0x7f8a0c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c1094a0 0x7f8a0c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c113bf0 con 0x7f8a0c109df0 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c113a70 con 0x7f8a0c1094a0 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a1461a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8a0c113d70 con 0x7f8a0c103b60 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a12bb7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a12bb7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35978/0 (socket says 172.21.15.102:35978) 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a12bb7640 1 -- 172.21.15.102:0/4006263920 learned_addr learned my addr 172.21.15.102:0/4006263920 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a123b6640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c103b60 0x7f8a0c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.638+0000 7f8a11bb5640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c1094a0 0x7f8a0c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 -- 172.21.15.102:0/4006263920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c103b60 msgr2=0x7f8a0c19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c103b60 0x7f8a0c19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 -- 172.21.15.102:0/4006263920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c1094a0 msgr2=0x7f8a0c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c1094a0 0x7f8a0c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 -- 172.21.15.102:0/4006263920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a0c1a0570 con 0x7f8a0c109df0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a12bb7640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009fd0 tx=0x7f8a0400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04017070 con 0x7f8a0c109df0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8a04003e40 con 0x7f8a0c109df0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0c1a0860 con 0x7f8a0c109df0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04004820 con 0x7f8a0c109df0 2024-09-21T03:25:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.639+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0c1a6fc0 con 0x7f8a0c109df0 2024-09-21T03:25:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.640+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a0c103f70 con 0x7f8a0c109df0 2024-09-21T03:25:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.641+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f8a04003970 con 0x7f8a0c109df0 2024-09-21T03:25:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.642+0000 7f89ff7fe640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 0x7f89f80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.642+0000 7f8a123b6640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 0x7f89f80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.642+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8a040e5490 con 0x7f8a0c109df0 2024-09-21T03:25:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.643+0000 7f8a123b6640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 0x7f89f80b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009230 tx=0x7f8a080058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:34.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.645+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a04003c60 con 0x7f8a0c109df0 2024-09-21T03:25:34.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.828+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f8a0c19b730 con 0x7f8a0c109df0 2024-09-21T03:25:34.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.833+0000 7f89ff7fe640 1 -- 172.21.15.102:0/4006263920 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f8a0c19b730 con 0x7f8a0c109df0 2024-09-21T03:25:34.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 msgr2=0x7f89f80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 0x7f89f80b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009230 tx=0x7f8a080058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 msgr2=0x7f8a0c19fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009fd0 tx=0x7f8a0400b260 comp rx=0 tx=0).stop 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 shutdown_connections 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f89f80b64d0 0x7f89f80b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a0c109df0 0x7f8a0c19fe40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8a0c1094a0 0x7f8a0c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 --2- 172.21.15.102:0/4006263920 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8a0c103b60 0x7f8a0c19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:34.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 >> 172.21.15.102:0/4006263920 conn(0x7f8a0c07b850 msgr2=0x7f8a0c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:34.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 shutdown_connections 2024-09-21T03:25:34.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:34.836+0000 7f8a1461a640 1 -- 172.21.15.102:0/4006263920 wait complete. 2024-09-21T03:25:35.084 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:35 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3550021078' entity='client.admin' 2024-09-21T03:25:35.084 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:35 smithi102 ceph-mon[31392]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:35.084 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:35 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4006263920' entity='client.admin' 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 -- 172.21.15.102:0/1797167262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec102a60 msgr2=0x7f0bec102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 --2- 172.21.15.102:0/1797167262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec102a60 0x7f0bec102e70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009900 tx=0x7f0bdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 -- 172.21.15.102:0/1797167262 shutdown_connections 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 --2- 172.21.15.102:0/1797167262 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec108cf0 0x7f0bec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 --2- 172.21.15.102:0/1797167262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec1083a0 0x7f0bec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 --2- 172.21.15.102:0/1797167262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec102a60 0x7f0bec102e70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 -- 172.21.15.102:0/1797167262 >> 172.21.15.102:0/1797167262 conn(0x7f0bec079730 msgr2=0x7f0bec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 -- 172.21.15.102:0/1797167262 shutdown_connections 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.082+0000 7f0bf2924640 1 -- 172.21.15.102:0/1797167262 wait complete. 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 Processor -- start 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 -- start start 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec102a60 0x7f0bec19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec108cf0 0x7f0bec19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec112aa0 con 0x7f0bec1083a0 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec112920 con 0x7f0bec108cf0 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf2924640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0bec112c20 con 0x7f0bec102a60 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0be3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0be3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35996/0 (socket says 172.21.15.102:35996) 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0be3fff640 1 -- 172.21.15.102:0/3715613048 learned_addr learned my addr 172.21.15.102:0/3715613048 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bebfff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec102a60 0x7f0bec19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.083+0000 7f0bf0ec1640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec108cf0 0x7f0bec19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 -- 172.21.15.102:0/3715613048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec102a60 msgr2=0x7f0bec19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec102a60 0x7f0bec19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 -- 172.21.15.102:0/3715613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec108cf0 msgr2=0x7f0bec19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec108cf0 0x7f0bec19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 -- 172.21.15.102:0/3715613048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bec1a6680 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be3fff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400d770 tx=0x7f0bd400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4017070 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0bd4009c30 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bec1a6970 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400f620 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.084+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bec1a6eb0 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.085+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bec102e70 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.087+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f0bd401a070 con 0x7f0bec1083a0 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.087+0000 7f0be9ffb640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 0x7f0bd80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:35.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.087+0000 7f0bebfff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 0x7f0bd80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:35.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.087+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0bd40e50b0 con 0x7f0bec1083a0 2024-09-21T03:25:35.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.088+0000 7f0bebfff640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 0x7f0bd80b8a10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0bec06b9c0 tx=0x7f0bdc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:35.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.091+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0bd40b1920 con 0x7f0bec1083a0 2024-09-21T03:25:35.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.274+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f0bec02e640 con 0x7f0bec1083a0 2024-09-21T03:25:35.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.278+0000 7f0be9ffb640 1 -- 172.21.15.102:0/3715613048 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v34)=0 v34) ==== 138+0+0 (secure 0 0 0) 0x7f0bd40b6860 con 0x7f0bec1083a0 2024-09-21T03:25:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 msgr2=0x7f0bd80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 0x7f0bd80b8a10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0bec06b9c0 tx=0x7f0bdc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 msgr2=0x7f0bec19b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:35.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400d770 tx=0x7f0bd400dc30 comp rx=0 tx=0).stop 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 shutdown_connections 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0bd80b6500 0x7f0bd80b8a10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0bec1083a0 0x7f0bec19b930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0bec108cf0 0x7f0bec19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 --2- 172.21.15.102:0/3715613048 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0bec102a60 0x7f0bec19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 >> 172.21.15.102:0/3715613048 conn(0x7f0bec079730 msgr2=0x7f0bec101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 shutdown_connections 2024-09-21T03:25:35.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:35.280+0000 7f0bf2924640 1 -- 172.21.15.102:0/3715613048 wait complete. 2024-09-21T03:25:35.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:35 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3550021078' entity='client.admin' 2024-09-21T03:25:35.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:35 smithi121 ceph-mon[34316]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:35.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:35 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4006263920' entity='client.admin' 2024-09-21T03:25:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:35 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3550021078' entity='client.admin' 2024-09-21T03:25:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:35 smithi148 ceph-mon[34651]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:35 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4006263920' entity='client.admin' 2024-09-21T03:25:35.604 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi102') 2024-09-21T03:25:35.604 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi102') 2024-09-21T03:25:36.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 -- 172.21.15.102:0/3076394680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8102f30 msgr2=0x7f2ac810fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 --2- 172.21.15.102:0/3076394680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8102f30 0x7f2ac810fc50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a480 comp rx=0 tx=0).stop 2024-09-21T03:25:36.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 -- 172.21.15.102:0/3076394680 shutdown_connections 2024-09-21T03:25:36.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 --2- 172.21.15.102:0/3076394680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8102f30 0x7f2ac810fc50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 --2- 172.21.15.102:0/3076394680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac8110190 0x7f2ac81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 --2- 172.21.15.102:0/3076394680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac81025e0 0x7f2ac81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 -- 172.21.15.102:0/3076394680 >> 172.21.15.102:0/3076394680 conn(0x7f2ac8079730 msgr2=0x7f2ac8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 -- 172.21.15.102:0/3076394680 shutdown_connections 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.189+0000 7f2acfd84640 1 -- 172.21.15.102:0/3076394680 wait complete. 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 Processor -- start 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 -- start start 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac81025e0 0x7f2ac819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac8102f30 0x7f2ac819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8115de0 con 0x7f2ac8110190 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8115c60 con 0x7f2ac8102f30 2024-09-21T03:25:36.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acfd84640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8115f60 con 0x7f2ac81025e0 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36012/0 (socket says 172.21.15.102:36012) 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 -- 172.21.15.102:0/2295289803 learned_addr learned my addr 172.21.15.102:0/2295289803 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acdb20640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac81025e0 0x7f2ac819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2acd31f640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac8102f30 0x7f2ac819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 -- 172.21.15.102:0/2295289803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac81025e0 msgr2=0x7f2ac819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac81025e0 0x7f2ac819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 -- 172.21.15.102:0/2295289803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac8102f30 msgr2=0x7f2ac819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac8102f30 0x7f2ac819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.190+0000 7f2ace321640 1 -- 172.21.15.102:0/2295289803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac81a2700 con 0x7f2ac8110190 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2ace321640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000b970 tx=0x7f2ac000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0019070 con 0x7f2ac8110190 2024-09-21T03:25:36.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ac000cb40 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac81a29f0 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0007650 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.191+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac81a9150 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.192+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac806c1e0 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.194+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f2ac001c070 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.195+0000 7f2abeffd640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 0x7f2ab40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.195+0000 7f2acdb20640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 0x7f2ab40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.195+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2ac00e5130 con 0x7f2ac8110190 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.195+0000 7f2acdb20640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 0x7f2ab40b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40058c0 tx=0x7f2ac400a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:36.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.198+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ac00ad5c0 con 0x7f2ac8110190 2024-09-21T03:25:36.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.378+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f2ac819d8c0 con 0x7f2ac8110190 2024-09-21T03:25:36.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:36 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3715613048' entity='client.admin' 2024-09-21T03:25:36.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:36.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:36.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:36.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:36.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.382+0000 7f2abeffd640 1 -- 172.21.15.102:0/2295289803 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v35)=0 v35) ==== 119+0+0 (secure 0 0 0) 0x7f2ac00b19a0 con 0x7f2ac8110190 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 msgr2=0x7f2ab40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 0x7f2ab40b89e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ac40058c0 tx=0x7f2ac400a4c0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 msgr2=0x7f2ac81a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000b970 tx=0x7f2ac000be30 comp rx=0 tx=0).stop 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 shutdown_connections 2024-09-21T03:25:36.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2ab40b64d0 0x7f2ab40b89e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ac8110190 0x7f2ac81a1fd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ac8102f30 0x7f2ac819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 --2- 172.21.15.102:0/2295289803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ac81025e0 0x7f2ac819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 >> 172.21.15.102:0/2295289803 conn(0x7f2ac8079730 msgr2=0x7f2ac8109cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 shutdown_connections 2024-09-21T03:25:36.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:36.385+0000 7f2acfd84640 1 -- 172.21.15.102:0/2295289803 wait complete. 2024-09-21T03:25:36.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:36 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3715613048' entity='client.admin' 2024-09-21T03:25:36.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:36.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:36.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:36.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:36 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3715613048' entity='client.admin' 2024-09-21T03:25:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:37.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:37 smithi121 ceph-mon[34316]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:37.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:37 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2295289803' entity='client.admin' 2024-09-21T03:25:37.539 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:37 smithi102 ceph-mon[31392]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:37.539 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:37 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2295289803' entity='client.admin' 2024-09-21T03:25:37.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:37 smithi148 ceph-mon[34651]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:37 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2295289803' entity='client.admin' 2024-09-21T03:25:37.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi102') 2024-09-21T03:25:37.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi102') 2024-09-21T03:25:37.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi102') 2024-09-21T03:25:37.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi102') 2024-09-21T03:25:37.885 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:37.886 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- 172.21.15.102:0/1769471221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 msgr2=0x7f35b41023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 --2- 172.21.15.102:0/1769471221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b41023d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009900 tx=0x7f35a402a410 comp rx=0 tx=0).stop 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- 172.21.15.102:0/1769471221 shutdown_connections 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 --2- 172.21.15.102:0/1769471221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b4110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 --2- 172.21.15.102:0/1769471221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b4109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 --2- 172.21.15.102:0/1769471221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b41023d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- 172.21.15.102:0/1769471221 >> 172.21.15.102:0/1769471221 conn(0x7f35b4079f90 msgr2=0x7f35b407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- 172.21.15.102:0/1769471221 shutdown_connections 2024-09-21T03:25:38.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- 172.21.15.102:0/1769471221 wait complete. 2024-09-21T03:25:38.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 Processor -- start 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.067+0000 7f35bb00f640 1 -- start start 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4113c30 con 0x7f35b4101fc0 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4113ab0 con 0x7f35b4109e50 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35bb00f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f35b4113db0 con 0x7f35b4109500 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36024/0 (socket says 172.21.15.102:36024) 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 -- 172.21.15.102:0/3751407619 learned_addr learned my addr 172.21.15.102:0/3751407619 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b3fff640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b95ac640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 -- 172.21.15.102:0/3751407619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 msgr2=0x7f35b419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 -- 172.21.15.102:0/3751407619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 msgr2=0x7f35b419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 -- 172.21.15.102:0/3751407619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b41a0450 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b3fff640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b95ac640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b8dab640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35a4005ab0 tx=0x7f35a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.068+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a403f030 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.069+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f35a4003cd0 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.069+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b41a06e0 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.069+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a4035070 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.069+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b41a0c10 con 0x7f35b4101fc0 2024-09-21T03:25:38.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.070+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b41023d0 con 0x7f35b4101fc0 2024-09-21T03:25:38.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.072+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f35a4042030 con 0x7f35b4101fc0 2024-09-21T03:25:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.073+0000 7f35b1ffb640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 0x7f359c0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.073+0000 7f35b3fff640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 0x7f359c0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.073+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f35a4105f50 con 0x7f35b4101fc0 2024-09-21T03:25:38.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.073+0000 7f35b3fff640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 0x7f359c0b8a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35b407a860 tx=0x7f35a8005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.076+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f35b41a0c10 con 0x7f35b4101fc0 2024-09-21T03:25:38.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.262+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f35b419b6d0 con 0x7f35b4101fc0 2024-09-21T03:25:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.267+0000 7f35b1ffb640 1 -- 172.21.15.102:0/3751407619 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v36)=0 v36) ==== 111+0+0 (secure 0 0 0) 0x7f35a40ce3e0 con 0x7f35b4101fc0 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 msgr2=0x7f359c0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 0x7f359c0b8a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f35b407a860 tx=0x7f35a8005d90 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 msgr2=0x7f35b419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f35a4005ab0 tx=0x7f35a40042f0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 shutdown_connections 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f359c0b6580 0x7f359c0b8a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35b4109e50 0x7f35b419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f35b4109500 0x7f35b419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 --2- 172.21.15.102:0/3751407619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35b4101fc0 0x7f35b419a5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 >> 172.21.15.102:0/3751407619 conn(0x7f35b4079f90 msgr2=0x7f35b41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 shutdown_connections 2024-09-21T03:25:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.270+0000 7f35bb00f640 1 -- 172.21.15.102:0/3751407619 wait complete. 2024-09-21T03:25:38.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 -- 172.21.15.102:0/408585911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc10de20 msgr2=0x7fbdfc110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 --2- 172.21.15.102:0/408585911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc10de20 0x7fbdfc110310 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009ca0 tx=0x7fbdf402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 -- 172.21.15.102:0/408585911 shutdown_connections 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 --2- 172.21.15.102:0/408585911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc10de20 0x7fbdfc110310 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 --2- 172.21.15.102:0/408585911 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc105310 0x7fbdfc10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 --2- 172.21.15.102:0/408585911 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 -- 172.21.15.102:0/408585911 >> 172.21.15.102:0/408585911 conn(0x7fbdfc079730 msgr2=0x7fbdfc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 -- 172.21.15.102:0/408585911 shutdown_connections 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 -- 172.21.15.102:0/408585911 wait complete. 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.734+0000 7fbe032dc640 1 Processor -- start 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 -- start start 2024-09-21T03:25:38.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc105310 0x7fbdfc19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 0x7fbdfc19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc113bc0 con 0x7fbdfc1049c0 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc113a40 con 0x7fbdfc10de20 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe032dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbdfc113d40 con 0x7fbdfc105310 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36038/0 (socket says 172.21.15.102:36038) 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 -- 172.21.15.102:0/2892728477 learned_addr learned my addr 172.21.15.102:0/2892728477 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe00877640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc105310 0x7fbdfc19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01879640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 0x7fbdfc19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 -- 172.21.15.102:0/2892728477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc105310 msgr2=0x7fbdfc19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc105310 0x7fbdfc19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 -- 172.21.15.102:0/2892728477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 msgr2=0x7fbdfc19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 0x7fbdfc19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 -- 172.21.15.102:0/2892728477 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdfc1a0500 con 0x7fbdfc1049c0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01879640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 0x7fbdfc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.735+0000 7fbe01078640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.736+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017020 con 0x7fbdfc1049c0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.736+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbdf8009c30 con 0x7fbdfc1049c0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.736+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdfc1a07f0 con 0x7fbdfc1049c0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.736+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800f740 con 0x7fbdfc1049c0 2024-09-21T03:25:38.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.736+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdfc1a6f50 con 0x7fbdfc1049c0 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.737+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdfc06c1e0 con 0x7fbdfc1049c0 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.738+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7fbdf801a020 con 0x7fbdfc1049c0 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.739+0000 7fbdf27fc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 0x7fbde80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.739+0000 7fbe00877640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 0x7fbde80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.739+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fbdf80e5a70 con 0x7fbdfc1049c0 2024-09-21T03:25:38.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.739+0000 7fbe00877640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 0x7fbde80b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc10fa40 tx=0x7fbdec00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:38.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.742+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbdf8021020 con 0x7fbdfc1049c0 2024-09-21T03:25:38.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.921+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fbdfc104dd0 con 0x7fbdfc1049c0 2024-09-21T03:25:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.925+0000 7fbdf27fc640 1 -- 172.21.15.102:0/2892728477 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v37)=0 v37) ==== 129+0+0 (secure 0 0 0) 0x7fbdf8009de0 con 0x7fbdfc1049c0 2024-09-21T03:25:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 msgr2=0x7fbde80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 0x7fbde80b89e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc10fa40 tx=0x7fbdec00b390 comp rx=0 tx=0).stop 2024-09-21T03:25:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 msgr2=0x7fbdfc19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800d950 tx=0x7fbdf800de10 comp rx=0 tx=0).stop 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 shutdown_connections 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbde80b64d0 0x7fbde80b89e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbdfc10de20 0x7fbdfc19fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbdfc105310 0x7fbdfc19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 --2- 172.21.15.102:0/2892728477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdfc1049c0 0x7fbdfc19a590 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 >> 172.21.15.102:0/2892728477 conn(0x7fbdfc079730 msgr2=0x7fbdfc1078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 shutdown_connections 2024-09-21T03:25:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:38.927+0000 7fbe032dc640 1 -- 172.21.15.102:0/2892728477 wait complete. 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3751407619' entity='client.admin' 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2892728477' entity='client.admin' 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3751407619' entity='client.admin' 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2892728477' entity='client.admin' 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.540 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:39.627 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi102') 2024-09-21T03:25:39.627 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi102') 2024-09-21T03:25:39.628 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi102') 2024-09-21T03:25:39.628 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi102') 2024-09-21T03:25:39.628 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi102') 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3751407619' entity='client.admin' 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2892728477' entity='client.admin' 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:25:39.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:25:40.142 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi102') 2024-09-21T03:25:40.142 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi102') 2024-09-21T03:25:40.142 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'a5dfbe26-77c8-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi102') 2024-09-21T03:25:40.146 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T03:25:40.389 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:40.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.835+0000 7f18f94cd640 1 -- 172.21.15.102:0/1792649207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f41083a0 msgr2=0x7f18f41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.835+0000 7f18f94cd640 1 --2- 172.21.15.102:0/1792649207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f41083a0 0x7f18f41087b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009900 tx=0x7f18dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 -- 172.21.15.102:0/1792649207 shutdown_connections 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 --2- 172.21.15.102:0/1792649207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f41083a0 0x7f18f41087b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 --2- 172.21.15.102:0/1792649207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f4108cf0 0x7f18f410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 --2- 172.21.15.102:0/1792649207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 0x7f18f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 -- 172.21.15.102:0/1792649207 >> 172.21.15.102:0/1792649207 conn(0x7f18f4079730 msgr2=0x7f18f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 -- 172.21.15.102:0/1792649207 shutdown_connections 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 -- 172.21.15.102:0/1792649207 wait complete. 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 Processor -- start 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.836+0000 7f18f94cd640 1 -- start start 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 0x7f18f419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f41083a0 0x7f18f419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113ba0 con 0x7f18f4108cf0 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113a20 con 0x7f18f4102a60 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f18f4113d20 con 0x7f18f41083a0 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36050/0 (socket says 172.21.15.102:36050) 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 -- 172.21.15.102:0/796909386 learned_addr learned my addr 172.21.15.102:0/796909386 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18ebfff640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f41083a0 0x7f18f419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f2ffd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 0x7f18f419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 -- 172.21.15.102:0/796909386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f41083a0 msgr2=0x7f18f419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f41083a0 0x7f18f419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 -- 172.21.15.102:0/796909386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 msgr2=0x7f18f419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 0x7f18f419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:40.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 -- 172.21.15.102:0/796909386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f41a0440 con 0x7f18f4108cf0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f37fe640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cce0 tx=0x7f18ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec00f450 con 0x7f18f4108cf0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18ec00fac0 con 0x7f18f4108cf0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ec018be0 con 0x7f18f4108cf0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f41a0730 con 0x7f18f4108cf0 2024-09-21T03:25:40.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.837+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f41a0bf0 con 0x7f18f4108cf0 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.839+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f4102e70 con 0x7f18f4108cf0 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.840+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f18ec00fc70 con 0x7f18f4108cf0 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.840+0000 7f18f0ff9640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 0x7f18e00b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.841+0000 7f18f2ffd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 0x7f18e00b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.841+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f18ec0e5e10 con 0x7f18f4108cf0 2024-09-21T03:25:40.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.841+0000 7f18f2ffd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 0x7f18e00b8a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18e4005d00 tx=0x7f18e4005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:40.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:40.845+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18ec014030 con 0x7f18f4108cf0 2024-09-21T03:25:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.021+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f18f402e640 con 0x7f18f4108cf0 2024-09-21T03:25:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.022+0000 7f18f0ff9640 1 -- 172.21.15.102:0/796909386 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22330 (secure 0 0 0) 0x7f18ec0ae2a0 con 0x7f18f4108cf0 2024-09-21T03:25:41.024 INFO:teuthology.orchestra.run.smithi102.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global dev auth_debug true 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global basic log_to_file true 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global basic log_to_journald false 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global basic log_to_stderr false 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_allow_pool_delete true 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T03:25:41.025 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global dev ms_die_on_bug true 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global dev ms_die_on_old_message true 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global dev ms_die_on_skipped_message false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced debug_mon 20/20 2024-09-21T03:25:41.026 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced debug_ms 1/1 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced debug_paxos 20/20 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T03:25:41.027 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced debug_client 20/20 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T03:25:41.028 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev bdev_debug_aio true 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced debug_bluefs 20/20 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced debug_bluestore 20/20 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced debug_ms 1/1 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced debug_osd 20/20 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_op_order true 2024-09-21T03:25:41.029 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_shutdown true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T03:25:41.030 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced debug_mds 20/20 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced debug_ms 2/2 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T03:25:41.031 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_bal_split_size 100 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds dev mds_debug_frag true 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds dev mds_verify_scatter true 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced client_dirsize_rbytes false * 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced client_mount_timeout 600 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced debug_client 20/20 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced debug_ms 1/1 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:25:41.032 INFO:teuthology.orchestra.run.smithi102.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T03:25:41.033 INFO:teuthology.orchestra.run.smithi102.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T03:25:41.033 INFO:teuthology.orchestra.run.smithi102.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T03:25:41.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 msgr2=0x7f18e00b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 0x7f18e00b8a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18e4005d00 tx=0x7f18e4005c50 comp rx=0 tx=0).stop 2024-09-21T03:25:41.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 msgr2=0x7f18f419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18ec00cce0 tx=0x7f18ec00a620 comp rx=0 tx=0).stop 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 shutdown_connections 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18e00b6500 0x7f18e00b8a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18f4108cf0 0x7f18f419fdd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18f41083a0 0x7f18f419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 --2- 172.21.15.102:0/796909386 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18f4102a60 0x7f18f419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 >> 172.21.15.102:0/796909386 conn(0x7f18f4079730 msgr2=0x7f18f41052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 shutdown_connections 2024-09-21T03:25:41.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:41.024+0000 7f18f94cd640 1 -- 172.21.15.102:0/796909386 wait complete. 2024-09-21T03:25:41.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:41 smithi121 ceph-mon[34316]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:41.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:41 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/796909386' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:25:41.616 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:41 smithi102 ceph-mon[31392]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:41.617 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:41 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/796909386' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:25:41.713 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T03:25:41.713 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:25:41.713 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:25:41.729 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:25:41.730 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-21T03:25:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:41 smithi148 ceph-mon[34651]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:41 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/796909386' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:41.785 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 03:24:17.815092441 +0000 2024-09-21T03:25:41.786 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 03:19:19.397321338 +0000 2024-09-21T03:25:41.786 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 03:19:19.397321338 +0000 2024-09-21T03:25:41.786 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 03:19:19.397321338 +0000 2024-09-21T03:25:41.786 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:25:41.850 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T03:25:41.850 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T03:25:41.850 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000291116 s, 1.8 MB/s 2024-09-21T03:25:41.851 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:25:41.908 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 03:24:17.848091756 +0000 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 03:19:19.727314485 +0000 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 03:19:19.727314485 +0000 2024-09-21T03:25:41.963 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 03:19:19.727314485 +0000 2024-09-21T03:25:41.963 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T03:25:42.026 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000257489 s, 2.0 MB/s 2024-09-21T03:25:42.027 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:25:42.083 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 03:24:17.881091072 +0000 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 03:19:20.046307862 +0000 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 03:19:20.046307862 +0000 2024-09-21T03:25:42.139 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 03:19:20.046307862 +0000 2024-09-21T03:25:42.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:25:42.202 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T03:25:42.202 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T03:25:42.202 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.0002915 s, 1.8 MB/s 2024-09-21T03:25:42.203 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:25:42.260 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-21T03:25:42.315 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:25:42.315 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:42.315 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-21T03:25:42.315 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:42.315 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:42.316 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 03:24:17.914090387 +0000 2024-09-21T03:25:42.316 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 03:19:20.385300822 +0000 2024-09-21T03:25:42.316 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 03:19:20.385300822 +0000 2024-09-21T03:25:42.316 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 03:19:20.385300822 +0000 2024-09-21T03:25:42.316 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:25:42.378 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-21T03:25:42.378 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-21T03:25:42.379 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000212581 s, 2.4 MB/s 2024-09-21T03:25:42.380 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:25:42.435 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-09-21T03:25:42.436 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:25:42.455 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:25:42.455 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-09-21T03:25:42.513 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-21 03:25:12.162184963 +0000 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-21 03:19:37.546017447 +0000 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-21 03:19:37.546017447 +0000 2024-09-21T03:25:42.514 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-21 03:19:37.546017447 +0000 2024-09-21T03:25:42.514 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:25:42.585 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-21T03:25:42.585 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-21T03:25:42.585 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000289393 s, 1.8 MB/s 2024-09-21T03:25:42.587 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:25:42.646 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-09-21T03:25:42.704 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:25:42.704 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:42.704 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T03:25:42.704 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:42.705 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:42.705 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-21 03:25:12.163184950 +0000 2024-09-21T03:25:42.705 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-21 03:19:37.879012861 +0000 2024-09-21T03:25:42.705 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-21 03:19:37.879012861 +0000 2024-09-21T03:25:42.705 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-21 03:19:37.879012861 +0000 2024-09-21T03:25:42.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:25:42.770 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-21T03:25:42.770 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-21T03:25:42.770 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000274917 s, 1.9 MB/s 2024-09-21T03:25:42.772 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:25:42.830 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-21 03:25:12.163184950 +0000 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-21 03:19:38.208008334 +0000 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-21 03:19:38.208008334 +0000 2024-09-21T03:25:42.887 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-21 03:19:38.208008334 +0000 2024-09-21T03:25:42.888 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:25:42.952 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-21T03:25:42.952 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-21T03:25:42.952 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000232179 s, 2.2 MB/s 2024-09-21T03:25:42.953 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:25:43.011 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:43.067 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-09-21 03:25:12.163184950 +0000 2024-09-21T03:25:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-09-21 03:19:38.575003286 +0000 2024-09-21T03:25:43.068 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-09-21 03:19:38.575003286 +0000 2024-09-21T03:25:43.068 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-09-21 03:19:38.575003286 +0000 2024-09-21T03:25:43.068 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:25:43.131 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-09-21T03:25:43.131 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-09-21T03:25:43.131 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000224355 s, 2.3 MB/s 2024-09-21T03:25:43.132 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:25:43.188 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2024-09-21T03:25:43.188 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:25:43.208 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:25:43.208 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:43.267 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 03:25:09.780530330 +0000 2024-09-21T03:25:43.268 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 03:19:33.969451374 +0000 2024-09-21T03:25:43.268 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 03:19:33.969451374 +0000 2024-09-21T03:25:43.268 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 03:19:33.969451374 +0000 2024-09-21T03:25:43.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:25:43.338 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T03:25:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T03:25:43.339 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000287437 s, 1.8 MB/s 2024-09-21T03:25:43.340 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:25:43.399 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 03:25:09.781530306 +0000 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 03:19:34.287443583 +0000 2024-09-21T03:25:43.457 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 03:19:34.287443583 +0000 2024-09-21T03:25:43.458 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 03:19:34.287443583 +0000 2024-09-21T03:25:43.458 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:25:43.523 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T03:25:43.523 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T03:25:43.523 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000233128 s, 2.2 MB/s 2024-09-21T03:25:43.525 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:25:43.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:43 smithi121 ceph-mon[34316]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:43.583 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2024-09-21T03:25:43.639 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:25:43.639 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:43.639 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 03:25:09.781530306 +0000 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 03:19:34.605435792 +0000 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 03:19:34.605435792 +0000 2024-09-21T03:25:43.640 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 03:19:34.605435792 +0000 2024-09-21T03:25:43.640 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:25:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:43 smithi102 ceph-mon[31392]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:43.703 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:43 smithi148 ceph-mon[34651]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T03:25:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T03:25:43.705 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000198192 s, 2.6 MB/s 2024-09-21T03:25:43.706 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:25:43.763 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2024-09-21T03:25:43.819 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:25:43.819 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2024-09-21 03:25:09.781530306 +0000 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2024-09-21 03:19:34.931427804 +0000 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2024-09-21 03:19:34.931427804 +0000 2024-09-21T03:25:43.820 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2024-09-21 03:19:34.931427804 +0000 2024-09-21T03:25:43.820 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:25:43.883 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2024-09-21T03:25:43.883 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2024-09-21T03:25:43.883 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000211787 s, 2.4 MB/s 2024-09-21T03:25:43.884 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:25:43.942 INFO:tasks.cephadm:Deploying osd.0 on smithi102 with /dev/vg_nvme/lv_4... 2024-09-21T03:25:43.942 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:25:44.185 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:45.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:45 smithi121 ceph-mon[34316]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:45.542 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:45 smithi102 ceph-mon[31392]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:45 smithi148 ceph-mon[34651]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:46.684 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:25:46.710 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi102:vg_nvme/lv_4 2024-09-21T03:25:46.959 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:25:47.355 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:47 smithi102 ceph-mon[31392]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 -- 172.21.15.102:0/3115281171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad0105270 msgr2=0x7f9ad010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/3115281171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad0105270 0x7f9ad010d8b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009900 tx=0x7f9ac402a410 comp rx=0 tx=0).stop 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 -- 172.21.15.102:0/3115281171 shutdown_connections 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/3115281171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad0105270 0x7f9ad010d8b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/3115281171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad010ddf0 0x7f9ad0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/3115281171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 0x7f9ad0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 -- 172.21.15.102:0/3115281171 >> 172.21.15.102:0/3115281171 conn(0x7f9ad0079730 msgr2=0x7f9ad0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 -- 172.21.15.102:0/3115281171 shutdown_connections 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.403+0000 7f9ad86e5640 1 -- 172.21.15.102:0/3115281171 wait complete. 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 Processor -- start 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 -- start start 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 0x7f9ad019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad0105270 0x7f9ad019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0113be0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0113a60 con 0x7f9ad0105270 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.404+0000 7f9ad86e5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad0113d60 con 0x7f9ad0104840 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41250/0 (socket says 172.21.15.102:41250) 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 -- 172.21.15.102:0/1973868442 learned_addr learned my addr 172.21.15.102:0/1973868442 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6481640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 0x7f9ad019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad5c80640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad0105270 0x7f9ad019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 -- 172.21.15.102:0/1973868442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 msgr2=0x7f9ad019a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 0x7f9ad019a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 -- 172.21.15.102:0/1973868442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad0105270 msgr2=0x7f9ad019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad0105270 0x7f9ad019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:25:47.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 -- 172.21.15.102:0/1973868442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad01a04a0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad6c82640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800d750 tx=0x7f9ac800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8017070 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ac80054f0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad01a0790 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8004cd0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.405+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad01a6ef0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.406+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad0104c50 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.408+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f9ac8009bd0 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.409+0000 7f9acf7fe640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 0x7f9ab80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.409+0000 7f9ad6481640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 0x7f9ab80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.409+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9ac80e5110 con 0x7f9ad010ddf0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.409+0000 7f9ad6481640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 0x7f9ab80b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005c40 tx=0x7f9ac000a590 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:25:47.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.413+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ac80b1980 con 0x7f9ad010ddf0 2024-09-21T03:25:47.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:47 smithi121 ceph-mon[34316]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:47.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:25:47.598+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9ad01069e0 con 0x7f9ab80b6550 2024-09-21T03:25:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:47 smithi148 ceph-mon[34651]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:48.648 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:25:48.649 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:25:48.649 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:48.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:25:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:25:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:25:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:25:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:49.335 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:49 smithi102 ceph-mon[31392]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:49.335 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:49 smithi102 ceph-mon[31392]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:49.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:49 smithi148 ceph-mon[34651]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:49 smithi148 ceph-mon[34651]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:49 smithi121 ceph-mon[34316]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:25:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:49 smithi121 ceph-mon[34316]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:50.425 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:50 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"} : dispatch 2024-09-21T03:25:50.426 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:50 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"}]': finished 2024-09-21T03:25:50.426 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:50 smithi102 ceph-mon[31392]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:25:50.426 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:25:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:50 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"} : dispatch 2024-09-21T03:25:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:50 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"}]': finished 2024-09-21T03:25:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:50 smithi148 ceph-mon[34651]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:25:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:25:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:50 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"} : dispatch 2024-09-21T03:25:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:50 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1172600683' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa4011b8-e09e-475a-9c72-baa73d3c2bc0"}]': finished 2024-09-21T03:25:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:50 smithi121 ceph-mon[34316]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:25:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:25:51.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:51 smithi102 ceph-mon[31392]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:51 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4160525411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:25:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:51 smithi148 ceph-mon[34651]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:51 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4160525411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:25:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:51 smithi121 ceph-mon[34316]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:51 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4160525411' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:25:53.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:53 smithi102 ceph-mon[31392]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:53 smithi148 ceph-mon[34651]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:53 smithi121 ceph-mon[34316]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:54.678 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:54 smithi102 ceph-mon[31392]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:54.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:54 smithi148 ceph-mon[34651]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:54.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:54 smithi121 ceph-mon[34316]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:57.350 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:57 smithi102 ceph-mon[31392]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:57 smithi148 ceph-mon[34651]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:57.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:57 smithi121 ceph-mon[34316]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:59 smithi148 ceph-mon[34651]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:25:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:59.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:25:59 smithi148 ceph-mon[34651]: Deploying daemon osd.0 on smithi102 2024-09-21T03:25:59.528 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:59 smithi102 ceph-mon[31392]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:59.528 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:25:59.528 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:59.528 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:25:59 smithi102 ceph-mon[31392]: Deploying daemon osd.0 on smithi102 2024-09-21T03:25:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:59 smithi121 ceph-mon[34316]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:25:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:25:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:25:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:25:59 smithi121 ceph-mon[34316]: Deploying daemon osd.0 on smithi102 2024-09-21T03:26:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:01 smithi102 ceph-mon[31392]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:01.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:01 smithi148 ceph-mon[34651]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:01.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:01 smithi121 ceph-mon[34316]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:03.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:03 smithi102 ceph-mon[31392]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:03.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:03 smithi148 ceph-mon[34651]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:03.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:03 smithi121 ceph-mon[34316]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:05.348 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:05 smithi102 ceph-mon[31392]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:05.348 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:05.348 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:05.348 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:05 smithi148 ceph-mon[34651]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:05 smithi121 ceph-mon[34316]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:07 smithi102 ceph-mon[31392]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:07.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:07 smithi148 ceph-mon[34651]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:07.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:07 smithi121 ceph-mon[34316]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:07.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:07.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:08.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:08.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:08.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:08.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:08.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:08.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:08.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:08.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:08.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:08.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.864+0000 7f9acf7fe640 1 -- 172.21.15.102:0/1973868442 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9ad01069e0 con 0x7f9ab80b6550 2024-09-21T03:26:08.866 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 0 on host 'smithi102' 2024-09-21T03:26:08.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 msgr2=0x7f9ab80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 0x7f9ab80b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005c40 tx=0x7f9ac000a590 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 msgr2=0x7f9ad019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800d750 tx=0x7f9ac800dc10 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 shutdown_connections 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6550 0x7f9ab80b8a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ad010ddf0 0x7f9ad019fd70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ad0105270 0x7f9ad019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 --2- 172.21.15.102:0/1973868442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ad0104840 0x7f9ad019a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.866+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 >> 172.21.15.102:0/1973868442 conn(0x7f9ad0079730 msgr2=0x7f9ad01062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.867+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 shutdown_connections 2024-09-21T03:26:08.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:26:08.867+0000 7f9ad86e5640 1 -- 172.21.15.102:0/1973868442 wait complete. 2024-09-21T03:26:09.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:09 smithi102 ceph-mon[31392]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:09.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:09.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.436 DEBUG:teuthology.orchestra.run.smithi102:osd.0> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T03:26:09.439 INFO:tasks.cephadm:Deploying osd.1 on smithi121 with /dev/vg_nvme/lv_4... 2024-09-21T03:26:09.439 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:26:09.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:09 smithi148 ceph-mon[34651]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:09.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:09.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:09 smithi121 ceph-mon[34316]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:09.678 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:26:10.703 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:26:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:26:10.465+0000 7f0f9cd6a640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:26:11.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:11 smithi148 ceph-mon[34651]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:11.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:11 smithi148 ceph-mon[34651]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:26:11.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:11 smithi121 ceph-mon[34316]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:11.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:11 smithi121 ceph-mon[34316]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:26:11.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:11 smithi102 ceph-mon[31392]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:11 smithi102 ceph-mon[31392]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:26:12.030 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:26:12.056 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-09-21T03:26:12.303 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:12.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:26:12.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.452 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:26:12.228+0000 7f0f98cec640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:26:12.452 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:26:12.234+0000 7f0f94aea640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:26:12.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:26:12.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:26:12.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T03:26:12.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 -- 172.21.15.121:0/1767279138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b84105300 msgr2=0x7f9b8410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 --2- 172.21.15.121:0/1767279138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b84105300 0x7f9b8410d850 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009900 tx=0x7f9b7802a410 comp rx=0 tx=0).stop 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 -- 172.21.15.121:0/1767279138 shutdown_connections 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 --2- 172.21.15.121:0/1767279138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b8410de10 0x7f9b84110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 --2- 172.21.15.121:0/1767279138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b84105300 0x7f9b8410d850 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:12.783 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 --2- 172.21.15.121:0/1767279138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b841049b0 0x7f9b84104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:12.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 -- 172.21.15.121:0/1767279138 >> 172.21.15.121:0/1767279138 conn(0x7f9b84079720 msgr2=0x7f9b84079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:12.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 -- 172.21.15.121:0/1767279138 shutdown_connections 2024-09-21T03:26:12.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.781+0000 7f9b89264640 1 -- 172.21.15.121:0/1767279138 wait complete. 2024-09-21T03:26:12.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 Processor -- start 2024-09-21T03:26:12.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 -- start start 2024-09-21T03:26:12.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b841049b0 0x7f9b8419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b84105300 0x7f9b8419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84113b90 con 0x7f9b84105300 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84113a10 con 0x7f9b8410de10 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b89264640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84113d10 con 0x7f9b841049b0 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b837fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b837fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:33060/0 (socket says 172.21.15.121:33060) 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b837fe640 1 -- 172.21.15.121:0/1929677449 learned_addr learned my addr 172.21.15.121:0/1929677449 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.782+0000 7f9b827fc640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b84105300 0x7f9b8419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b82ffd640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b841049b0 0x7f9b8419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 -- 172.21.15.121:0/1929677449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b841049b0 msgr2=0x7f9b8419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:12.786 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b841049b0 0x7f9b8419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 -- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b84105300 msgr2=0x7f9b8419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b84105300 0x7f9b8419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 -- 172.21.15.121:0/1929677449 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b841a04d0 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b837fe640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00d750 tx=0x7f9b7c00dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c017070 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9b7c0054f0 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b841a07c0 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c004cd0 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.783+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a6fe0 con 0x7f9b8410de10 2024-09-21T03:26:12.787 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.784+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b8406c2e0 con 0x7f9b8410de10 2024-09-21T03:26:12.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.786+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f9b7c009bd0 con 0x7f9b8410de10 2024-09-21T03:26:12.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.786+0000 7f9b6bfff640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 0x7f9b6c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:12.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.787+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f9b7c0e56a0 con 0x7f9b8410de10 2024-09-21T03:26:12.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.787+0000 7f9b82ffd640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 0x7f9b6c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:12.788 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.787+0000 7f9b82ffd640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 0x7f9b6c0b8a10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005c40 tx=0x7f9b74005bd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:12.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.790+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b7c0ad9e0 con 0x7f9b8410de10 2024-09-21T03:26:12.976 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:12.975+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9b84106fa0 con 0x7f9b6c0b6500 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi102 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi102 2024-09-21T03:26:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-21T03:26:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:13.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi102 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi102 to 17088M 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] boot 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:26:14.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] boot 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:26:14.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: osd.0 [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] boot 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:26:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:26:15.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:15 smithi148 ceph-mon[34651]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:15.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:15 smithi148 ceph-mon[34651]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:26:15.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:15 smithi121 ceph-mon[34316]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:15.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:15 smithi121 ceph-mon[34316]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:26:15.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:15 smithi102 ceph-mon[31392]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:26:15.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:15 smithi102 ceph-mon[31392]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T03:26:16.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/1007064797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"}]': finished 2024-09-21T03:26:16.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:26:16.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:16.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:16 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/2126897227' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/1007064797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"}]': finished 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:16 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/2126897227' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:16.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/1007064797' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"} : dispatch 2024-09-21T03:26:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2419af68-299f-44c9-bb97-66c3a6ef0f47"}]': finished 2024-09-21T03:26:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:26:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:16 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/2126897227' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:17 smithi121 ceph-mon[34316]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:17 smithi102 ceph-mon[31392]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:17 smithi148 ceph-mon[34651]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:19 smithi121 ceph-mon[34316]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:19.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:19 smithi102 ceph-mon[31392]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:19.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:19 smithi148 ceph-mon[34651]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:21.453 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:21 smithi121 ceph-mon[34316]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:21.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:21 smithi102 ceph-mon[31392]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:21.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:21 smithi148 ceph-mon[34651]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:23.448 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:23 smithi121 ceph-mon[34316]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:23 smithi102 ceph-mon[31392]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:23 smithi148 ceph-mon[34651]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:24.528 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:26:24.529 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:24.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:26:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:26:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:25.361 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:25 smithi121 ceph-mon[34316]: Deploying daemon osd.1 on smithi121 2024-09-21T03:26:25.361 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:25 smithi121 ceph-mon[34316]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:25 smithi102 ceph-mon[31392]: Deploying daemon osd.1 on smithi121 2024-09-21T03:26:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:25 smithi102 ceph-mon[31392]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:25 smithi148 ceph-mon[34651]: Deploying daemon osd.1 on smithi121 2024-09-21T03:26:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:25 smithi148 ceph-mon[34651]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:27.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:27 smithi121 ceph-mon[34316]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:27.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:27 smithi102 ceph-mon[31392]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:27.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:27 smithi148 ceph-mon[34651]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:29.511 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:29 smithi121 ceph-mon[34316]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:29.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:29 smithi102 ceph-mon[31392]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:29.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:29 smithi148 ceph-mon[34651]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:30.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:30 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:30.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:30.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:30.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:30 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:30.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:30 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:31.393 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:31 smithi121 ceph-mon[34316]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:31.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:31 smithi102 ceph-mon[31392]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:31.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:31 smithi148 ceph-mon[34651]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.297 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:33 smithi121 ceph-mon[34316]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:33 smithi102 ceph-mon[31392]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:33 smithi148 ceph-mon[34651]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:34.533 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.531+0000 7f9b6bfff640 1 -- 172.21.15.121:0/1929677449 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b84106fa0 con 0x7f9b6c0b6500 2024-09-21T03:26:34.533 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 1 on host 'smithi121' 2024-09-21T03:26:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 msgr2=0x7f9b6c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 0x7f9b6c0b8a10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9b74005c40 tx=0x7f9b74005bd0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.535 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 msgr2=0x7f9b8419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00d750 tx=0x7f9b7c00dc10 comp rx=0 tx=0).stop 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 shutdown_connections 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9b6c0b6500 0x7f9b6c0b8a10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9b84105300 0x7f9b8419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b8410de10 0x7f9b8419fe60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 --2- 172.21.15.121:0/1929677449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9b841049b0 0x7f9b8419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 >> 172.21.15.121:0/1929677449 conn(0x7f9b84079720 msgr2=0x7f9b84106890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 shutdown_connections 2024-09-21T03:26:34.536 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:26:34.534+0000 7f9b89264640 1 -- 172.21.15.121:0/1929677449 wait complete. 2024-09-21T03:26:35.137 DEBUG:teuthology.orchestra.run.smithi121:osd.1> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T03:26:35.140 INFO:tasks.cephadm:Deploying osd.2 on smithi148 with /dev/vg_nvme/lv_4... 2024-09-21T03:26:35.140 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:26:35.394 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:26:35.418 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:35 smithi121 ceph-mon[34316]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:35.418 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:35.418 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:35.418 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:35.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:35 smithi148 ceph-mon[34651]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:35.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:35.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:35 smithi102 ceph-mon[31392]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:36.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:36 smithi121 podman[39652]: 2024-09-21 03:26:36.094418452 +0000 UTC m=+0.846611997 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:26:36.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:36 smithi121 podman[39652]: 2024-09-21 03:26:36.208386878 +0000 UTC m=+0.960580410 container create 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:26:36.874 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:36 smithi121 podman[39652]: 2024-09-21 03:26:36.704883141 +0000 UTC m=+1.457076691 container init 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T03:26:36.874 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:36 smithi121 podman[39652]: 2024-09-21 03:26:36.708786743 +0000 UTC m=+1.460980275 container start 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:26:36.874 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:36 smithi121 podman[39652]: 2024-09-21 03:26:36.771402285 +0000 UTC m=+1.523595832 container attach 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T03:26:37.164 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:37 smithi121 podman[39652]: 2024-09-21 03:26:37.003296631 +0000 UTC m=+1.755490204 container died 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:26:37.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:37 smithi148 ceph-mon[34651]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:37.451 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:37 smithi121 ceph-mon[34316]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:37.677 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:26:37.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:37 smithi102 ceph-mon[31392]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:37.703 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_4 2024-09-21T03:26:37.958 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:26:38.285 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:38 smithi121 podman[39726]: 2024-09-21 03:26:38.179985392 +0000 UTC m=+1.274069354 container remove 2d10ea13f69c4af157b1fccc1fdfa3c58b64f9fd9d8190defdfc473736f1e009 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T03:26:38.285 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:38 smithi121 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service: Failed with result 'exit-code'. 2024-09-21T03:26:38.285 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:38 smithi121 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service: Consumed 1.049s CPU time. 2024-09-21T03:26:38.439 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 -- 172.21.15.148:0/930192735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 msgr2=0x7f54240757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 --2- 172.21.15.148:0/930192735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54240757b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5420009900 tx=0x7f542002a410 comp rx=0 tx=0).stop 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 -- 172.21.15.148:0/930192735 shutdown_connections 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 --2- 172.21.15.148:0/930192735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54240761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 --2- 172.21.15.148:0/930192735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f5424116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 --2- 172.21.15.148:0/930192735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54240757b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.437+0000 7f542c6d1640 1 -- 172.21.15.148:0/930192735 >> 172.21.15.148:0/930192735 conn(0x7f542407b850 msgr2=0x7f542407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 -- 172.21.15.148:0/930192735 shutdown_connections 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 -- 172.21.15.148:0/930192735 wait complete. 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 Processor -- start 2024-09-21T03:26:38.440 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 -- start start 2024-09-21T03:26:38.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54241a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.438+0000 7f542c6d1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f54241a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.442 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f542411a190 con 0x7f5424075dd0 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f542411a010 con 0x7f5424114430 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f542411a310 con 0x7f5424077380 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:45694/0 (socket says 172.21.15.148:45694) 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 -- 172.21.15.148:0/3553397505 learned_addr learned my addr 172.21.15.148:0/3553397505 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542ac6e640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f54241a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542a46d640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54241a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 -- 172.21.15.148:0/3553397505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 msgr2=0x7f54241a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f54241a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 -- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 msgr2=0x7f54241a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54241a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 -- 172.21.15.148:0/3553397505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54241a6a90 con 0x7f5424077380 2024-09-21T03:26:38.443 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542ac6e640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f54241a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542a46d640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54241a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f5429c6c640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f541c00eb90 tx=0x7f541c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c010630 con 0x7f5424077380 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f541c00ee90 con 0x7f5424077380 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54241a6d80 con 0x7f5424077380 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541c018ba0 con 0x7f5424077380 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.439+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54241ad5a0 con 0x7f5424077380 2024-09-21T03:26:38.444 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.440+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54240761e0 con 0x7f5424077380 2024-09-21T03:26:38.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.442+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7f541c0107d0 con 0x7f5424077380 2024-09-21T03:26:38.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.443+0000 7f541b7fe640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 0x7f54100b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:26:38.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.443+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2097+0+0 (secure 0 0 0) 0x7f541c0e66c0 con 0x7f5424077380 2024-09-21T03:26:38.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.443+0000 7f542a46d640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 0x7f54100b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:26:38.445 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.444+0000 7f542a46d640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 0x7f54100b8a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5420000c00 tx=0x7f5420032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:26:38.447 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.446+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f541c0ae870 con 0x7f5424077380 2024-09-21T03:26:38.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:38.631+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f5424113810 con 0x7f54100b6500 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi121 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.264 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:39.265 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:39 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi121 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:39.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:39.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:39.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:39.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:39 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:39.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi121 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi121 to 17087M 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:26:39.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:39 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:40.446 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:40 smithi148 ceph-mon[34651]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:40.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:40 smithi102 ceph-mon[31392]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:40.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:40 smithi121 ceph-mon[34316]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2539969842' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"}]': finished 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: osdmap e12: 3 total, 1 up, 3 in 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:41.402 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:41 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:41.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2539969842' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"}]': finished 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: osdmap e12: 3 total, 1 up, 3 in 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:41.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:41 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/2539969842' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"} : dispatch 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b9b4159-420e-4fcf-bf82-eeb15e5674c3"}]': finished 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: osdmap e12: 3 total, 1 up, 3 in 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:41.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:41 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:42.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:42 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2659631201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:42.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:42 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2659631201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:42.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:42 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/2659631201' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:26:43.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:43 smithi102 ceph-mon[31392]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:43.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:43 smithi148 ceph-mon[34651]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:43.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:43 smithi121 ceph-mon[34316]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:45.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:45 smithi148 ceph-mon[34651]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:45.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:45 smithi121 ceph-mon[34316]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:45.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:45 smithi102 ceph-mon[31392]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:47.305 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:47 smithi148 ceph-mon[34651]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:47.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:47 smithi121 ceph-mon[34316]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:47.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:47 smithi102 ceph-mon[31392]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:48.613 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service: Scheduled restart job, restart counter is at 1. 2024-09-21T03:26:48.613 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 systemd[1]: Stopped Ceph osd.1 for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:26:48.613 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service: Consumed 1.049s CPU time. 2024-09-21T03:26:48.613 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 systemd[1]: Starting Ceph osd.1 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:26:48.614 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 podman[41868]: 2024-09-21 03:26:48.512658318 +0000 UTC m=+0.110245789 container create 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:26:48.614 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 podman[41868]: 2024-09-21 03:26:48.418724839 +0000 UTC m=+0.016312282 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:26:48.888 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 podman[41868]: 2024-09-21 03:26:48.731336833 +0000 UTC m=+0.328924267 container init 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 podman[41868]: 2024-09-21 03:26:48.735008128 +0000 UTC m=+0.332595564 container start 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 podman[41868]: 2024-09-21 03:26:48.798030411 +0000 UTC m=+0.395617862 container attach 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 bash[41868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T03:26:48.889 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:48 smithi121 bash[41868]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T03:26:49.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:49 smithi148 ceph-mon[34651]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:26:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:49 smithi121 ceph-mon[34316]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:26:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:49 smithi102 ceph-mon[31392]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:26:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:50.488 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:50 smithi148 ceph-mon[34651]: Deploying daemon osd.2 on smithi148 2024-09-21T03:26:50.530 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-mon[34316]: Deploying daemon osd.2 on smithi148 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T03:26:50.530 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-21T03:26:50.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:50 smithi102 ceph-mon[31392]: Deploying daemon osd.2 on smithi148 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-1/block 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-1/block 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T03:26:50.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate[41882]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T03:26:50.787 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 bash[41868]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-21T03:26:50.787 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:50 smithi121 podman[41868]: 2024-09-21 03:26:50.559865933 +0000 UTC m=+2.157453364 container died 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:26:51.224 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 podman[42006]: 2024-09-21 03:26:51.118147677 +0000 UTC m=+0.551945769 container remove 11d5ff729bf5cbd91df7ce6aaee4fc219dbeff93d75586de0f24c0c8b042b2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-activate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T03:26:51.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:51 smithi148 ceph-mon[34651]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:51.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:51 smithi121 ceph-mon[34316]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:51.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 podman[42064]: 2024-09-21 03:26:51.233567658 +0000 UTC m=+0.016554836 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:26:51.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 podman[42064]: 2024-09-21 03:26:51.335569921 +0000 UTC m=+0.118557124 container create e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T03:26:51.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:51 smithi102 ceph-mon[31392]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:52.035 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 podman[42064]: 2024-09-21 03:26:51.56242397 +0000 UTC m=+0.345411135 container init e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:26:52.035 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 podman[42064]: 2024-09-21 03:26:51.565568524 +0000 UTC m=+0.348555681 container start e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T03:26:52.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 ceph-osd[42083]: -- 172.21.15.121:0/229599843 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55edab47fa40 con 0x55edaf577180 2024-09-21T03:26:52.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 bash[42064]: e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 2024-09-21T03:26:52.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:51 smithi121 systemd[1]: Started Ceph osd.1 for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:26:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:53 smithi148 ceph-mon[34651]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:53 smithi121 ceph-mon[34316]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:53.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:26:53.197+0000 7f51907d7640 -1 Falling back to public interface 2024-09-21T03:26:53.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:53 smithi102 ceph-mon[31392]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:55.346 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:55 smithi148 ceph-mon[34651]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:55 smithi121 ceph-mon[34316]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:55 smithi102 ceph-mon[31392]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:56.427 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:56.427 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:56.427 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:56.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:56.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:57.468 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:57 smithi148 ceph-mon[34651]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:57.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:57 smithi121 ceph-mon[34316]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:57.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:26:57.452+0000 7f51907d7640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:26:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:57 smithi102 ceph-mon[31392]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:58.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:58.546 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:26:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:58.850 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.847+0000 7f541b7fe640 1 -- 172.21.15.148:0/3553397505 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5424113810 con 0x7f54100b6500 2024-09-21T03:26:58.850 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 2 on host 'smithi148' 2024-09-21T03:26:58.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 msgr2=0x7f54100b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:58.852 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 0x7f54100b8a10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5420000c00 tx=0x7f5420032c70 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 msgr2=0x7f54241a1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f541c00eb90 tx=0x7f541c00c6a0 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 shutdown_connections 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f54100b6500 0x7f54100b8a10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5424114430 0x7f54241a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5424077380 0x7f54241a1180 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 --2- 172.21.15.148:0/3553397505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5424075dd0 0x7f54241a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.850+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 >> 172.21.15.148:0/3553397505 conn(0x7f542407b850 msgr2=0x7f5424113100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:26:58.853 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.851+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 shutdown_connections 2024-09-21T03:26:58.854 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:26:58.851+0000 7f542c6d1640 1 -- 172.21.15.148:0/3553397505 wait complete. 2024-09-21T03:26:59.410 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:59.410 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:26:59.410 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.410 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: osdmap e13: 3 total, 1 up, 3 in 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:59.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:26:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:59.412 DEBUG:teuthology.orchestra.run.smithi148:osd.2> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T03:26:59.414 INFO:tasks.cephadm:Deploying osd.3 on smithi102 with /dev/vg_nvme/lv_3... 2024-09-21T03:26:59.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:26:59.535 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:26:59.262+0000 7f518c759640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:26:59.536 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:26:59.267+0000 7f5188557640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: osdmap e13: 3 total, 1 up, 3 in 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:26:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:59.675 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: osdmap e13: 3 total, 1 up, 3 in 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:26:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:26:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: osdmap e14: 3 total, 1 up, 3 in 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: osdmap e14: 3 total, 1 up, 3 in 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:00.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: osdmap e14: 3 total, 1 up, 3 in 2024-09-21T03:27:00.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:00.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:00.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:01.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: pgmap v60: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] boot 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: pgmap v60: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] boot 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:01.697 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:01.698 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:27:01.306+0000 7f1f91399640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: pgmap v60: 0 pgs: ; 0 B data, 27 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: osd.1 [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] boot 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:27:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:02.004 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:27:02.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi102:vg_nvme/lv_3 2024-09-21T03:27:02.288 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:27:02.313 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:02.314 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:02.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:02.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:02.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 -- 172.21.15.102:0/3522017117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c108cf0 msgr2=0x7faa3c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 --2- 172.21.15.102:0/3522017117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c108cf0 0x7faa3c10f520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa34009ca0 tx=0x7faa3402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 -- 172.21.15.102:0/3522017117 shutdown_connections 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 --2- 172.21.15.102:0/3522017117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c108cf0 0x7faa3c10f520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 --2- 172.21.15.102:0/3522017117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c1083a0 0x7faa3c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 --2- 172.21.15.102:0/3522017117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c102a60 0x7faa3c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 -- 172.21.15.102:0/3522017117 >> 172.21.15.102:0/3522017117 conn(0x7faa3c079730 msgr2=0x7faa3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.730+0000 7faa44623640 1 -- 172.21.15.102:0/3522017117 shutdown_connections 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 -- 172.21.15.102:0/3522017117 wait complete. 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 Processor -- start 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 -- start start 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 0x7faa3c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 0x7faa3c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112aa0 con 0x7faa3c1083a0 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112920 con 0x7faa3c108cf0 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.731+0000 7faa44623640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c112c20 con 0x7faa3c102a60 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43838/0 (socket says 172.21.15.102:43838) 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 -- 172.21.15.102:0/2958205726 learned_addr learned my addr 172.21.15.102:0/2958205726 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa423bf640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 0x7faa3c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa42bc0640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 0x7faa3c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 -- 172.21.15.102:0/2958205726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 msgr2=0x7faa3c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 0x7faa3c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 -- 172.21.15.102:0/2958205726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 msgr2=0x7faa3c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 0x7faa3c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 -- 172.21.15.102:0/2958205726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c1a65e0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa42bc0640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 0x7faa3c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa423bf640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 0x7faa3c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa41bbe640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9f0 tx=0x7faa3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800ccc0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa380054f0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c1a68d0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38010690 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.732+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c1a6dc0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.733+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c102e70 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.735+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 19) ==== 154474+0+0 (secure 0 0 0) 0x7faa380046c0 con 0x7faa3c1083a0 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.736+0000 7faa337fe640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 0x7faa280b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.736+0000 7faa423bf640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 0x7faa280b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.736+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2660+0+0 (secure 0 0 0) 0x7faa380e6320 con 0x7faa3c1083a0 2024-09-21T03:27:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.736+0000 7faa423bf640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 0x7faa280b89e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa2c005d00 tx=0x7faa2c005c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.739+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa38056710 con 0x7faa3c1083a0 2024-09-21T03:27:02.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:02.933+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7faa3c063800 con 0x7faa280b64d0 2024-09-21T03:27:03.574 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi148 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:03.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:03.734 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi148 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:03.735 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi148 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi148 to 17088M 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:03.993 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:27:03.732+0000 7f1f8d31b640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:27:03.994 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:27:03.737+0000 7f1f85111640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.503 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:04 smithi102 ceph-mon[31392]: from='osd.2 ' entity='osd.2' 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:04 smithi148 ceph-mon[34651]: from='osd.2 ' entity='osd.2' 2024-09-21T03:27:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:27:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T03:27:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:04 smithi121 ceph-mon[34316]: from='osd.2 ' entity='osd.2' 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] boot 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:27:05.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"} : dispatch 2024-09-21T03:27:05.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"}]': finished 2024-09-21T03:27:05.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:27:05.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] boot 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"} : dispatch 2024-09-21T03:27:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"}]': finished 2024-09-21T03:27:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:27:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: osd.2 [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] boot 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"} : dispatch 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1268963846' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a79de33f-eac7-49a7-9045-be22d0ae933c"}]': finished 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:27:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:06.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:06 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2760026403' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:06 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2760026403' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:06.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:06 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2760026403' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:07 smithi102 ceph-mon[31392]: pgmap v69: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:07 smithi102 ceph-mon[31392]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:27:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:07.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:07 smithi148 ceph-mon[34651]: pgmap v69: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:07 smithi148 ceph-mon[34651]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:27:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:07 smithi121 ceph-mon[34316]: pgmap v69: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:07 smithi121 ceph-mon[34316]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:27:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:07.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54054]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54054]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54054]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54057]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54057]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.580 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.581 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54057]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:08.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 ceph-mon[31392]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:27:08.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:08.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:08.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 ceph-mon[31392]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:08.623 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:08.623 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 ceph-mon[34651]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:27:08.624 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:08.624 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:08.624 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 ceph-mon[34651]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43301]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43301]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43301]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43304]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:08.624 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43304]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.625 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.625 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43304]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.664 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:08.665 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 ceph-mon[34316]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:27:08.665 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:08.665 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:27:08.665 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 ceph-mon[34316]: pgmap v72: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42968]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42968]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42968]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42971]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42971]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.665 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.666 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42971]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54243]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54243]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54243]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54246]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:08 smithi102 sudo[54246]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.993 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43307]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:08.993 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43307]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43307]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43310]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43310]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:08 smithi148 sudo[43310]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:09.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42974]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:27:09.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42974]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:09.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:09.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42974]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:09.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42977]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:27:09.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42977]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:27:09.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:27:09.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:08 smithi121 sudo[42977]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:09 smithi102 ceph-mon[31392]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:09 smithi148 ceph-mon[34651]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:27:09.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:09 smithi121 ceph-mon[34316]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:27:10.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:10.335+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7faa380a9e10 con 0x7faa3c1083a0 2024-09-21T03:27:10.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:10 smithi102 ceph-mon[31392]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:27:10.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:10.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:10 smithi102 ceph-mon[31392]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:10 smithi148 ceph-mon[34651]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:27:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:10 smithi148 ceph-mon[34651]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:10 smithi121 ceph-mon[34316]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T03:27:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:10 smithi121 ceph-mon[34316]: pgmap v75: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:11.584 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:11 smithi102 ceph-mon[31392]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T03:27:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:11 smithi148 ceph-mon[34651]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T03:27:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:11 smithi121 ceph-mon[34316]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T03:27:12.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:12 smithi102 ceph-mon[31392]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:12 smithi148 ceph-mon[34651]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:12 smithi121 ceph-mon[34316]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:14.133 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:27:14.133 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:14.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:27:14.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:14.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:27:14.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:15.083 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:14 smithi102 ceph-mon[31392]: Deploying daemon osd.3 on smithi102 2024-09-21T03:27:15.083 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:14 smithi102 ceph-mon[31392]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:15.144 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:14 smithi148 ceph-mon[34651]: Deploying daemon osd.3 on smithi102 2024-09-21T03:27:15.144 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:14 smithi148 ceph-mon[34651]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:15.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:14 smithi121 ceph-mon[34316]: Deploying daemon osd.3 on smithi102 2024-09-21T03:27:15.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:14 smithi121 ceph-mon[34316]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:17.429 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:17 smithi102 ceph-mon[31392]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:17.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:17 smithi148 ceph-mon[34651]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:17 smithi121 ceph-mon[34316]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:19.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:19 smithi148 ceph-mon[34651]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:19 smithi121 ceph-mon[34316]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:19.566 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:19 smithi102 ceph-mon[31392]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:20.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:20.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:20.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:20.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:20.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:20.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:20.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:20.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:20.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:21.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:21 smithi148 ceph-mon[34651]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:21.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:21 smithi121 ceph-mon[34316]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:21.656 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:21 smithi102 ceph-mon[31392]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:23.489 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:23 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:23.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:23.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:23.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:23 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:23.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:23.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:23.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:23.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:23 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.156+0000 7faa337fe640 1 -- 172.21.15.102:0/2958205726 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa3c063800 con 0x7faa280b64d0 2024-09-21T03:27:24.159 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 3 on host 'smithi102' 2024-09-21T03:27:24.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 msgr2=0x7faa280b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 0x7faa280b89e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa2c005d00 tx=0x7faa2c005c90 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 msgr2=0x7faa3c19b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9f0 tx=0x7faa3800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 shutdown_connections 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa280b64d0 0x7faa280b89e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa3c1083a0 0x7faa3c19b810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa3c108cf0 0x7faa3c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 --2- 172.21.15.102:0/2958205726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa3c102a60 0x7faa3c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.159+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 >> 172.21.15.102:0/2958205726 conn(0x7faa3c079730 msgr2=0x7faa3c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.160+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 shutdown_connections 2024-09-21T03:27:24.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:27:24.160+0000 7faa44623640 1 -- 172.21.15.102:0/2958205726 wait complete. 2024-09-21T03:27:24.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:24.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:24.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:24.827 DEBUG:teuthology.orchestra.run.smithi102:osd.3> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T03:27:24.829 INFO:tasks.cephadm:Deploying osd.4 on smithi121 with /dev/vg_nvme/lv_3... 2024-09-21T03:27:24.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:27:25.082 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:27:25.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:25 smithi102 ceph-mon[31392]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:25.471 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:25 smithi121 ceph-mon[34316]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:25.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:25 smithi148 ceph-mon[34651]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:26.020 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:27:25 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:27:25.708+0000 7fb285283640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:27:26.324 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:26 smithi102 ceph-mon[31392]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:27:26.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:26 smithi148 ceph-mon[34651]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:27:26.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:26 smithi121 ceph-mon[34316]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:27:27.407 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-mon[31392]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:27.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-mon[31392]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:27:27.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-mon[31392]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T03:27:27.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-mon[31392]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:27:27.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:27.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:27 smithi121 ceph-mon[34316]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:27.543 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:27 smithi121 ceph-mon[34316]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:27:27.544 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:27 smithi121 ceph-mon[34316]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T03:27:27.544 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:27 smithi121 ceph-mon[34316]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:27:27.544 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:27 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:27.626 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:27:27.652 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-09-21T03:27:27.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:27 smithi148 ceph-mon[34651]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:27 smithi148 ceph-mon[34651]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:27:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:27 smithi148 ceph-mon[34651]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T03:27:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:27 smithi148 ceph-mon[34651]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:27:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:27 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:27.905 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:27:27.952 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:27:27.678+0000 7fb281205640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:27:27.952 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:27:27 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:27:27.686+0000 7fb278ffb640 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: osdmap e26: 4 total, 3 up, 4 in 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:28.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:28.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.384+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/1021059068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd0109e10 msgr2=0x7f6dd0110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.386 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.384+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/1021059068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd0109e10 0x7f6dd0110640 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009ca0 tx=0x7f6dc802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/1021059068 shutdown_connections 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/1021059068 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd01094c0 0x7f6dd01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/1021059068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd0109e10 0x7f6dd0110640 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/1021059068 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0103b80 0x7f6dd0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/1021059068 >> 172.21.15.121:0/1021059068 conn(0x7f6dd00ff5d0 msgr2=0x7f6dd0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/1021059068 shutdown_connections 2024-09-21T03:27:28.387 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/1021059068 wait complete. 2024-09-21T03:27:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.385+0000 7f6dd6c3c640 1 Processor -- start 2024-09-21T03:27:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 -- start start 2024-09-21T03:27:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd0103b80 0x7f6dd019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.389 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0109e10 0x7f6dd019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113c70 con 0x7f6dd0103b80 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113af0 con 0x7f6dd01094c0 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd6c3c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113df0 con 0x7f6dd0109e10 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:55692/0 (socket says 172.21.15.121:55692) 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 -- 172.21.15.121:0/597588288 learned_addr learned my addr 172.21.15.121:0/597588288 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd49d8640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd0103b80 0x7f6dd019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dd51d9640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0109e10 0x7f6dd019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 -- 172.21.15.121:0/597588288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0109e10 msgr2=0x7f6dd019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0109e10 0x7f6dd019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 -- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd0103b80 msgr2=0x7f6dd019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd0103b80 0x7f6dd019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:28.390 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.386+0000 7f6dcffff640 1 -- 172.21.15.121:0/597588288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd01a0530 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dcffff640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e9f0 tx=0x7f6dc400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc400ccc0 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd01a0820 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6dc4010900 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4018860 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.387+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd01a6f80 con 0x7f6dd01094c0 2024-09-21T03:27:28.391 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.388+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd0103f90 con 0x7f6dd01094c0 2024-09-21T03:27:28.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.391+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f6dc4010ab0 con 0x7f6dd01094c0 2024-09-21T03:27:28.392 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.391+0000 7f6dcdffb640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 0x7f6db80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:28.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.391+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3917+0+0 (secure 0 0 0) 0x7f6dc40e6a00 con 0x7f6dd01094c0 2024-09-21T03:27:28.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.391+0000 7f6dd49d8640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 0x7f6db80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:28.393 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.392+0000 7f6dd49d8640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 0x7f6db80b8ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009990 tx=0x7f6dc0009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:28.396 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.395+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dc40ae3c0 con 0x7f6dd01094c0 2024-09-21T03:27:28.585 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:28.584+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6dd0063800 con 0x7f6db80b65a0 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: osdmap e26: 4 total, 3 up, 4 in 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:28.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:28.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: osdmap e26: 4 total, 3 up, 4 in 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354]' entity='osd.3' 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:28.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:28.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:28.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:28.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:29.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:27:29.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:27:29.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi102 2024-09-21T03:27:29.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-21T03:27:29.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] boot 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:29.525 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi102 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] boot 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:27:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:29.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:29.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi102 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi102 to 8544M 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: osd.3 [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] boot 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:29.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:30.520 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:30 smithi121 ceph-mon[34316]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:30.521 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:30 smithi121 ceph-mon[34316]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T03:27:30.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:30 smithi102 ceph-mon[31392]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:30.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:30 smithi102 ceph-mon[31392]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T03:27:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:30 smithi148 ceph-mon[34651]: from='client.24371 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:30 smithi148 ceph-mon[34651]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/1618116981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"}]': finished 2024-09-21T03:27:31.486 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:27:31.487 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/1618116981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"}]': finished 2024-09-21T03:27:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:27:31.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:31.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/1618116981' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"} : dispatch 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb68fd9-b5d3-4847-b717-10a7e9ac1319"}]': finished 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T03:27:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:32.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:32 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/3177061547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:32.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:32 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/3177061547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:32.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:32 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/3177061547' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:33 smithi121 ceph-mon[34316]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:27:33.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:33 smithi102 ceph-mon[31392]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:27:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:33 smithi148 ceph-mon[34651]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:27:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:35 smithi102 ceph-mon[31392]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:27:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:35 smithi148 ceph-mon[34651]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:27:35.757 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:35 smithi121 ceph-mon[34316]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-21T03:27:37.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:37 smithi121 ceph-mon[34316]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:27:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:37 smithi102 ceph-mon[31392]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:27:37.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:37 smithi148 ceph-mon[34651]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-21T03:27:39.354 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:39 smithi121 ceph-mon[34316]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:27:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:39 smithi102 ceph-mon[31392]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:27:39.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:39 smithi148 ceph-mon[34651]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:27:40.401 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:27:40.401 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:40.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:27:40.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:27:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:41 smithi102 ceph-mon[31392]: Deploying daemon osd.4 on smithi121 2024-09-21T03:27:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:41 smithi102 ceph-mon[31392]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:27:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:41 smithi148 ceph-mon[34651]: Deploying daemon osd.4 on smithi121 2024-09-21T03:27:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:41 smithi148 ceph-mon[34651]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:27:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:41 smithi121 ceph-mon[34316]: Deploying daemon osd.4 on smithi121 2024-09-21T03:27:41.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:41 smithi121 ceph-mon[34316]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:27:43.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:43 smithi102 ceph-mon[31392]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:27:43.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:43 smithi148 ceph-mon[34651]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:27:43.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:43 smithi121 ceph-mon[34316]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:27:45.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:45 smithi121 ceph-mon[34316]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:45.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:45 smithi102 ceph-mon[31392]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:45.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:45 smithi148 ceph-mon[34651]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:46.621 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:46.621 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:46.622 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:47.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:47 smithi102 ceph-mon[31392]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:47.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:47 smithi148 ceph-mon[34651]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:47.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:47 smithi121 ceph-mon[34316]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:49.781 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.780+0000 7f6dcdffb640 1 -- 172.21.15.121:0/597588288 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6dd0063800 con 0x7f6db80b65a0 2024-09-21T03:27:49.782 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 4 on host 'smithi121' 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.782+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 msgr2=0x7f6db80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.782+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 0x7f6db80b8ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009990 tx=0x7f6dc0009110 comp rx=0 tx=0).stop 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.782+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 msgr2=0x7f6dd019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.782+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400e9f0 tx=0x7f6dc400edf0 comp rx=0 tx=0).stop 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 shutdown_connections 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6db80b65a0 0x7f6db80b8ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6dd0109e10 0x7f6dd019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:49.784 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6dd01094c0 0x7f6dd019ab60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:49.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 --2- 172.21.15.121:0/597588288 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6dd0103b80 0x7f6dd019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:49.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 >> 172.21.15.121:0/597588288 conn(0x7f6dd00ff5d0 msgr2=0x7f6dd0108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:49.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 shutdown_connections 2024-09-21T03:27:49.785 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:27:49.783+0000 7f6dd6c3c640 1 -- 172.21.15.121:0/597588288 wait complete. 2024-09-21T03:27:50.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:50.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.448 DEBUG:teuthology.orchestra.run.smithi121:osd.4> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T03:27:50.450 INFO:tasks.cephadm:Deploying osd.5 on smithi148 with /dev/vg_nvme/lv_3... 2024-09-21T03:27:50.451 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:27:50.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:50.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:27:50.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:50.706 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:27:51.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:51 smithi148 ceph-mon[34651]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:51.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:51 smithi121 ceph-mon[34316]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:51.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:51 smithi102 ceph-mon[31392]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:51.894 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:27:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:27:51.690+0000 7fe6d7e67640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:27:52.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:52 smithi148 ceph-mon[34651]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:52.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:52 smithi148 ceph-mon[34651]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:52.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:52 smithi121 ceph-mon[34316]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:52.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:52 smithi121 ceph-mon[34316]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:52.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:52 smithi102 ceph-mon[31392]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:52.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:52 smithi102 ceph-mon[31392]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:27:53.284 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:53.284 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:27:53.284 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:53.284 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T03:27:53.285 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:53.285 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:53 smithi148 ceph-mon[34651]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:53.286 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:27:53.311 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_3 2024-09-21T03:27:53.535 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:27:53.258+0000 7fe6d3de9640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:27:53.535 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:27:53.265+0000 7fe6cfbe7640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:53.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:53 smithi121 ceph-mon[34316]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:53.604 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:27:53.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:27:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: from='osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T03:27:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:53 smithi102 ceph-mon[31392]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 -- 172.21.15.148:0/2258550054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900108480 msgr2=0x7fc90010ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2258550054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900108480 0x7fc90010ecb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0009ca0 tx=0x7fc8f002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 -- 172.21.15.148:0/2258550054 shutdown_connections 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2258550054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900107b30 0x7fc900107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2258550054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900108480 0x7fc90010ecb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2258550054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 0x7fc900102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 -- 172.21.15.148:0/2258550054 >> 172.21.15.148:0/2258550054 conn(0x7fc900077c60 msgr2=0x7fc9000780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:27:54.096 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 -- 172.21.15.148:0/2258550054 shutdown_connections 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.090+0000 7fc9076d3640 1 -- 172.21.15.148:0/2258550054 wait complete. 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 Processor -- start 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 -- start start 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 0x7fc900199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900108480 0x7fc90019eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc900112280 con 0x7fc900108480 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc900112100 con 0x7fc9001021f0 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc9076d3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc900112400 con 0x7fc900107b30 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc904c6e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc904c6e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:41376/0 (socket says 172.21.15.148:41376) 2024-09-21T03:27:54.097 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc904c6e640 1 -- 172.21.15.148:0/2356465924 learned_addr learned my addr 172.21.15.148:0/2356465924 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.091+0000 7fc90546f640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 0x7fc900199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc905c70640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900108480 0x7fc90019eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 -- 172.21.15.148:0/2356465924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 msgr2=0x7fc900199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 0x7fc900199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 -- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900108480 msgr2=0x7fc90019eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900108480 0x7fc90019eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 -- 172.21.15.148:0/2356465924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90019f3d0 con 0x7fc900107b30 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc904c6e640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c970 tx=0x7fc8f400ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4007bb0 con 0x7fc900107b30 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8f4007d50 con 0x7fc900107b30 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90019f6c0 con 0x7fc900107b30 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400f450 con 0x7fc900107b30 2024-09-21T03:27:54.098 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.092+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9001a5e20 con 0x7fc900107b30 2024-09-21T03:27:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.093+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc900102600 con 0x7fc900107b30 2024-09-21T03:27:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.096+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fc8f40046c0 con 0x7fc900107b30 2024-09-21T03:27:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.096+0000 7fc8fe7fc640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 0x7fc8e80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:27:54.099 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.097+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4036+0+0 (secure 0 0 0) 0x7fc8f40e6400 con 0x7fc900107b30 2024-09-21T03:27:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.097+0000 7fc90546f640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 0x7fc8e80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:27:54.100 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.097+0000 7fc90546f640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 0x7fc8e80b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005fd0 tx=0x7fc8f800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:27:54.102 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.100+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8f4014030 con 0x7fc900107b30 2024-09-21T03:27:54.299 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:27:54.297+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc9001013e0 con 0x7fc8e80b6560 2024-09-21T03:27:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:54.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:54 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.602 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.603 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:54.603 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:54.603 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:54 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:54.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:54.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:27:54.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:54 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi121 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] boot 2024-09-21T03:27:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T03:27:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:55.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:27:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi121 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] boot 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi121 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi121 to 8543M 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: osd.4 [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] boot 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:27:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:27:55.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:27:55.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:27:56.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:56 smithi148 ceph-mon[34651]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T03:27:56.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:56 smithi148 ceph-mon[34651]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:27:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:56 smithi102 ceph-mon[31392]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T03:27:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:56 smithi102 ceph-mon[31392]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:27:56.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:56 smithi121 ceph-mon[34316]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T03:27:56.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:56 smithi121 ceph-mon[34316]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/607904873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"}]': finished 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:27:57.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:57 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2728219809' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/607904873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"}]': finished 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:27:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:57 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2728219809' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/607904873' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"} : dispatch 2024-09-21T03:27:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "921fdc95-272e-4059-912a-76c97e920465"}]': finished 2024-09-21T03:27:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T03:27:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:27:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:57 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/2728219809' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:27:58.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:27:58 smithi102 ceph-mon[31392]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:27:58.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:27:58 smithi148 ceph-mon[34651]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:27:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:27:58 smithi121 ceph-mon[34316]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:01.480 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:01 smithi148 ceph-mon[34651]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:01.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:01 smithi121 ceph-mon[34316]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:01.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:01 smithi102 ceph-mon[31392]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:03.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:03 smithi148 ceph-mon[34651]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:03.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:03 smithi121 ceph-mon[34316]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:03 smithi102 ceph-mon[31392]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:05.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:05 smithi148 ceph-mon[34651]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:28:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:05 smithi121 ceph-mon[34316]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:28:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:05.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:05 smithi102 ceph-mon[31392]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:28:05.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:06.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:06 smithi148 ceph-mon[34651]: Deploying daemon osd.5 on smithi148 2024-09-21T03:28:06.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:06 smithi121 ceph-mon[34316]: Deploying daemon osd.5 on smithi148 2024-09-21T03:28:06.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:06 smithi102 ceph-mon[31392]: Deploying daemon osd.5 on smithi148 2024-09-21T03:28:07.288 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:07 smithi148 ceph-mon[34651]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:07.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:07 smithi121 ceph-mon[34316]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:07 smithi102 ceph-mon[31392]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:09.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:09 smithi121 ceph-mon[34316]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:09.615 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:09 smithi148 ceph-mon[34651]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:09.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:09 smithi102 ceph-mon[31392]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:11.478 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:11 smithi148 ceph-mon[34651]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:11.478 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:11.478 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:11.478 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:11.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:11 smithi121 ceph-mon[34316]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:11.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:11.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:11.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:11.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:11 smithi102 ceph-mon[31392]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:13.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:13.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:14.812 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.810+0000 7fc8fe7fc640 1 -- 172.21.15.148:0/2356465924 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9001013e0 con 0x7fc8e80b6560 2024-09-21T03:28:14.812 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 5 on host 'smithi148' 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.812+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 msgr2=0x7fc8e80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.812+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 0x7fc8e80b8a70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f8005fd0 tx=0x7fc8f800b390 comp rx=0 tx=0).stop 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.812+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 msgr2=0x7fc900199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.812+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc8f400c970 tx=0x7fc8f400ce30 comp rx=0 tx=0).stop 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 shutdown_connections 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8e80b6560 0x7fc8e80b8a70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc900108480 0x7fc90019eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:14.814 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc900107b30 0x7fc900199a00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 --2- 172.21.15.148:0/2356465924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9001021f0 0x7fc900199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 >> 172.21.15.148:0/2356465924 conn(0x7fc900077c60 msgr2=0x7fc900100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 shutdown_connections 2024-09-21T03:28:14.815 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:28:14.813+0000 7fc9076d3640 1 -- 172.21.15.148:0/2356465924 wait complete. 2024-09-21T03:28:15.397 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:15 smithi148 ceph-mon[34651]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:15.397 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:15 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:15.397 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:15 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.397 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:15 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.423 DEBUG:teuthology.orchestra.run.smithi148:osd.5> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T03:28:15.426 INFO:tasks.cephadm:Deploying osd.6 on smithi102 with /dev/vg_nvme/lv_2... 2024-09-21T03:28:15.426 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:28:15.517 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:15 smithi102 ceph-mon[31392]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:15.517 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:15 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:15.517 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:15 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.517 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:15 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:15 smithi121 ceph-mon[34316]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:15.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:15 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:15.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:15 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:15 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:28:17.085 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:28:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:28:16.818+0000 7ffa6f0c3640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:28:17.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:17 smithi102 ceph-mon[31392]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:17.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:17 smithi102 ceph-mon[31392]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:17.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:17 smithi102 ceph-mon[31392]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:17.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:17 smithi148 ceph-mon[34651]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:17.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:17 smithi148 ceph-mon[34651]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:17.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:17 smithi148 ceph-mon[34651]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:17 smithi121 ceph-mon[34316]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:17 smithi121 ceph-mon[34316]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:17 smithi121 ceph-mon[34316]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:28:18.341 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:18 smithi102 ceph-mon[31392]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:28:18.341 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:18 smithi102 ceph-mon[31392]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:28:18.342 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:18 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:18.342 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:18 smithi102 ceph-mon[31392]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.342 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:18 smithi102 ceph-mon[31392]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.425 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:28:18.450 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi102:vg_nvme/lv_2 2024-09-21T03:28:18.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:18 smithi121 ceph-mon[34316]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:28:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:18 smithi121 ceph-mon[34316]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:28:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:18 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:18 smithi121 ceph-mon[34316]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:18 smithi121 ceph-mon[34316]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.688 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:28:18.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-mon[34651]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:28:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-mon[34651]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T03:28:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-mon[34651]: from='osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-mon[34651]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:28:18.744 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:28:18.281+0000 7ffa6b045640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:28:18.744 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:28:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:28:18.291+0000 7ffa66e43640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 -- 172.21.15.102:0/480628972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 msgr2=0x7fcc901098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 --2- 172.21.15.102:0/480628972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc901098b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009900 tx=0x7fcc8002a410 comp rx=0 tx=0).stop 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 -- 172.21.15.102:0/480628972 shutdown_connections 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 --2- 172.21.15.102:0/480628972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc901098b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 --2- 172.21.15.102:0/480628972 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90109df0 0x7fcc90110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:19.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 --2- 172.21.15.102:0/480628972 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90103b60 0x7fcc90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:19.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 -- 172.21.15.102:0/480628972 >> 172.21.15.102:0/480628972 conn(0x7fcc9007b850 msgr2=0x7fcc9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:19.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 -- 172.21.15.102:0/480628972 shutdown_connections 2024-09-21T03:28:19.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.192+0000 7fcc9805c640 1 -- 172.21.15.102:0/480628972 wait complete. 2024-09-21T03:28:19.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 Processor -- start 2024-09-21T03:28:19.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 -- start start 2024-09-21T03:28:19.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90103b60 0x7fcc9019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:19.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90109df0 0x7fcc9019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90113bd0 con 0x7fcc901094a0 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90113a50 con 0x7fcc90109df0 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc9805c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90113d50 con 0x7fcc90103b60 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:54786/0 (socket says 172.21.15.102:54786) 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 -- 172.21.15.102:0/2802505810 learned_addr learned my addr 172.21.15.102:0/2802505810 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc965f9640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90109df0 0x7fcc9019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc95df8640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90103b60 0x7fcc9019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 -- 172.21.15.102:0/2802505810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90103b60 msgr2=0x7fcc9019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90103b60 0x7fcc9019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 -- 172.21.15.102:0/2802505810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90109df0 msgr2=0x7fcc9019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:19.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90109df0 0x7fcc9019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.193+0000 7fcc955f7640 1 -- 172.21.15.102:0/2802505810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc901a0510 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc955f7640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc80005940 tx=0x7fcc800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8003f030 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc901a07a0 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcc800318f0 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80035070 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.194+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc901a6f60 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.195+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90104de0 con 0x7fcc901094a0 2024-09-21T03:28:19.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.196+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fcc80042030 con 0x7fcc901094a0 2024-09-21T03:28:19.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.197+0000 7fcc86ffd640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 0x7fcc7c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:19.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.197+0000 7fcc95df8640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 0x7fcc7c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:19.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.197+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4468+0+0 (secure 0 0 0) 0x7fcc80106b30 con 0x7fcc901094a0 2024-09-21T03:28:19.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.198+0000 7fcc95df8640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 0x7fcc7c0b8a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c005fd0 tx=0x7fcc8c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:19.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.201+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcc800ce2c0 con 0x7fcc901094a0 2024-09-21T03:28:19.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:19.392+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcc90063800 con 0x7fcc7c0b6560 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi148 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.394 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:19.395 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi148 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:19.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:28:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:28:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi148 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] boot 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:28:20.289 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] boot 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi148 to 8544M 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: osd.5 [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] boot 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:21.585 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:21 smithi102 ceph-mon[31392]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:21.585 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:21 smithi102 ceph-mon[31392]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:21.585 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:21 smithi102 ceph-mon[31392]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:28:21.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:21 smithi148 ceph-mon[34651]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:21 smithi148 ceph-mon[34651]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:21 smithi148 ceph-mon[34651]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:28:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:21 smithi121 ceph-mon[34316]: from='client.14577 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:21.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:21 smithi121 ceph-mon[34316]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:21.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:21 smithi121 ceph-mon[34316]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T03:28:22.574 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:22 smithi102 ceph-mon[31392]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T03:28:22.574 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"} : dispatch 2024-09-21T03:28:22.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"}]': finished 2024-09-21T03:28:22.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:22 smithi102 ceph-mon[31392]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:28:22.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:22 smithi148 ceph-mon[34651]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T03:28:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"} : dispatch 2024-09-21T03:28:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"}]': finished 2024-09-21T03:28:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:22 smithi148 ceph-mon[34651]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:28:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:22 smithi121 ceph-mon[34316]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T03:28:22.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"} : dispatch 2024-09-21T03:28:22.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2081712905' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0d2ec93c-5842-4c44-83a6-85b40ea4dfb6"}]': finished 2024-09-21T03:28:22.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:22 smithi121 ceph-mon[34316]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T03:28:22.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:23 smithi102 ceph-mon[31392]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:23 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/62433604' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:23 smithi148 ceph-mon[34651]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:23 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/62433604' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:23 smithi121 ceph-mon[34316]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:23 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/62433604' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:25 smithi102 ceph-mon[31392]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:25.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:25 smithi148 ceph-mon[34651]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:25.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:25 smithi121 ceph-mon[34316]: pgmap v129: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:27.605 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:27 smithi148 ceph-mon[34651]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:27.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:27 smithi102 ceph-mon[31392]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:27 smithi121 ceph-mon[34316]: pgmap v130: 1 pgs: 1 peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:29.403 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:29 smithi102 ceph-mon[31392]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:28:29.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:29 smithi148 ceph-mon[34651]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:28:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:29 smithi121 ceph-mon[34316]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:28:31.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:31 smithi102 ceph-mon[31392]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:28:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:28:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:31 smithi148 ceph-mon[34651]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:28:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:28:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:31 smithi121 ceph-mon[34316]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:28:31.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:28:31.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:32.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:32 smithi102 ceph-mon[31392]: Deploying daemon osd.6 on smithi102 2024-09-21T03:28:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:32 smithi148 ceph-mon[34651]: Deploying daemon osd.6 on smithi102 2024-09-21T03:28:32.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:32 smithi121 ceph-mon[34316]: Deploying daemon osd.6 on smithi102 2024-09-21T03:28:33.635 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:33 smithi102 ceph-mon[31392]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:28:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:33 smithi148 ceph-mon[34651]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:28:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:33 smithi121 ceph-mon[34316]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T03:28:35.542 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:35 smithi102 ceph-mon[31392]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:35 smithi148 ceph-mon[34651]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:35 smithi121 ceph-mon[34316]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:36.627 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:36 smithi102 ceph-mon[31392]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:36.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:36 smithi148 ceph-mon[34651]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:36 smithi121 ceph-mon[34316]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:37.577 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:37.577 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:37.577 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:38.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:38 smithi102 ceph-mon[31392]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:38.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:38 smithi148 ceph-mon[34651]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:38 smithi121 ceph-mon[34316]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:28:40.458 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 6 on host 'smithi102' 2024-09-21T03:28:40.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.455+0000 7fcc86ffd640 1 -- 172.21.15.102:0/2802505810 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcc90063800 con 0x7fcc7c0b6560 2024-09-21T03:28:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 msgr2=0x7fcc7c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 0x7fcc7c0b8a70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c005fd0 tx=0x7fcc8c005850 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 msgr2=0x7fcc9019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcc80005940 tx=0x7fcc800042f0 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 shutdown_connections 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcc7c0b6560 0x7fcc7c0b8a70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcc901094a0 0x7fcc9019ab40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc90109df0 0x7fcc9019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 --2- 172.21.15.102:0/2802505810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcc90103b60 0x7fcc9019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 >> 172.21.15.102:0/2802505810 conn(0x7fcc9007b850 msgr2=0x7fcc90107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 shutdown_connections 2024-09-21T03:28:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:28:40.458+0000 7fcc9805c640 1 -- 172.21.15.102:0/2802505810 wait complete. 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:40 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:40 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:40 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:41.152 DEBUG:teuthology.orchestra.run.smithi102:osd.6> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T03:28:41.154 INFO:tasks.cephadm:Deploying osd.7 on smithi121 with /dev/vg_nvme/lv_2... 2024-09-21T03:28:41.154 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:28:41.407 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:28:42.695 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:28:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:28:42.463+0000 7fe8a9273640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:28:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:43 smithi148 ceph-mon[34651]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:43 smithi148 ceph-mon[34651]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:28:43.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:43 smithi121 ceph-mon[34316]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:43.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:43 smithi121 ceph-mon[34316]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:28:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:43 smithi102 ceph-mon[31392]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:43 smithi102 ceph-mon[31392]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:28:44.051 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:28:44.078 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-09-21T03:28:44.325 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:28:44.448 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:44 smithi121 ceph-mon[34316]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:28:44.449 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:44 smithi121 ceph-mon[34316]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:28:44.449 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:44 smithi121 ceph-mon[34316]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:28:44.449 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:44.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:28:44.247+0000 7fe8a51f5640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:28:44.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:28:44.258+0000 7fe8a0ff3640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:28:44.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-mon[31392]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:28:44.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-mon[31392]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:28:44.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-mon[31392]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:28:44.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:44 smithi148 ceph-mon[34651]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:28:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:44 smithi148 ceph-mon[34651]: osdmap e42: 7 total, 6 up, 7 in 2024-09-21T03:28:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:44 smithi148 ceph-mon[34651]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:28:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 -- 172.21.15.121:0/1570614318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec103b60 msgr2=0x7f0dec103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 --2- 172.21.15.121:0/1570614318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec103b60 0x7f0dec103f70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009900 tx=0x7f0ddc02a410 comp rx=0 tx=0).stop 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 -- 172.21.15.121:0/1570614318 shutdown_connections 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 --2- 172.21.15.121:0/1570614318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 --2- 172.21.15.121:0/1570614318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec109df0 0x7f0dec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 --2- 172.21.15.121:0/1570614318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec103b60 0x7f0dec103f70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:44.844 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 -- 172.21.15.121:0/1570614318 >> 172.21.15.121:0/1570614318 conn(0x7f0dec07b850 msgr2=0x7f0dec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 -- 172.21.15.121:0/1570614318 shutdown_connections 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.819+0000 7f0df0be2640 1 -- 172.21.15.121:0/1570614318 wait complete. 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 Processor -- start 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 -- start start 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 0x7f0dec19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec113bf0 con 0x7f0dec1094a0 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec113a70 con 0x7f0dec109df0 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0df0be2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec113d70 con 0x7f0dec103b60 2024-09-21T03:28:44.845 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:34192/0 (socket says 172.21.15.121:34192) 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 -- 172.21.15.121:0/2090904297 learned_addr learned my addr 172.21.15.121:0/2090904297 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dea59c640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 0x7f0dec19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0de9d9b640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 -- 172.21.15.121:0/2090904297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 msgr2=0x7f0dec19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 0x7f0dec19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 -- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 msgr2=0x7f0dec19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 -- 172.21.15.121:0/2090904297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec1a0530 con 0x7f0dec109df0 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0de9d9b640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dea59c640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 0x7f0dec19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:28:44.846 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.820+0000 7f0dead9d640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0de400eaa0 tx=0x7f0de400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.821+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de400cdb0 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.821+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0de4005020 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.821+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec1a0820 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.821+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40116d0 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.821+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a6f80 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.822+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec103f70 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.823+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f0de40051d0 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.824+0000 7f0ddb7fe640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 0x7f0dd40b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.824+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4900+0+0 (secure 0 0 0) 0x7f0de40e6ba0 con 0x7f0dec109df0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.824+0000 7f0dea59c640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 0x7f0dd40b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.825+0000 7f0dea59c640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 0x7f0dd40b8af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc005ab0 tx=0x7f0ddc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:28:44.847 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:44.827+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0de4016030 con 0x7f0dec109df0 2024-09-21T03:28:45.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:28:45.013+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0dec063800 con 0x7f0dd40b65e0 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: osdmap e43: 7 total, 6 up, 7 in 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi102 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:45 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: osdmap e43: 7 total, 6 up, 7 in 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi102 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:45.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:45 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:45.645 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: osdmap e43: 7 total, 6 up, 7 in 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi102 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:28:45.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi102 to 5696M 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:28:45.647 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:45 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] boot 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:28:46.434 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:46.620 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:28:46.620 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:28:46.620 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:46.620 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:46.621 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] boot 2024-09-21T03:28:46.621 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:28:46.621 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:46.660 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:28:46.660 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:28:46.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: from='client.24437 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:28:46.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:46.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: osd.6 [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] boot 2024-09-21T03:28:46.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: osdmap e44: 7 total, 7 up, 7 in 2024-09-21T03:28:46.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:28:47.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:47 smithi121 ceph-mon[34316]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:47.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:47 smithi121 ceph-mon[34316]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T03:28:47.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:47 smithi102 ceph-mon[31392]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:47.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:47 smithi102 ceph-mon[31392]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T03:28:47.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:47 smithi148 ceph-mon[34651]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:28:47.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:47 smithi148 ceph-mon[34651]: osdmap e45: 7 total, 7 up, 7 in 2024-09-21T03:28:48.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/126013809' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"}]': finished 2024-09-21T03:28:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:28:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:28:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/4144542010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/126013809' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"}]': finished 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:28:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/4144542010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/126013809' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"} : dispatch 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "57d52535-2844-4895-b02c-543c561ee54b"}]': finished 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:28:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/4144542010' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:28:49.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:49 smithi121 ceph-mon[34316]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:49 smithi102 ceph-mon[31392]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:49 smithi148 ceph-mon[34651]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:51.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:51 smithi121 ceph-mon[34316]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:51.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:51 smithi102 ceph-mon[31392]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:51.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:51 smithi148 ceph-mon[34651]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:53 smithi121 ceph-mon[34316]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:53.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:53 smithi102 ceph-mon[31392]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:53 smithi148 ceph-mon[34651]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:55 smithi121 ceph-mon[34316]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:55.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:55 smithi102 ceph-mon[31392]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:55 smithi148 ceph-mon[34651]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:56.543 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:28:56.543 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:28:56.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:56.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:28:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:28:57.655 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:57 smithi121 ceph-mon[34316]: Deploying daemon osd.7 on smithi121 2024-09-21T03:28:57.655 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:57 smithi121 ceph-mon[34316]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:57 smithi102 ceph-mon[31392]: Deploying daemon osd.7 on smithi121 2024-09-21T03:28:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:57 smithi102 ceph-mon[31392]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:57 smithi148 ceph-mon[34651]: Deploying daemon osd.7 on smithi121 2024-09-21T03:28:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:57 smithi148 ceph-mon[34651]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:59.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:28:59 smithi121 ceph-mon[34316]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:28:59 smithi102 ceph-mon[31392]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:28:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:28:59 smithi148 ceph-mon[34651]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:01.447 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:01 smithi121 ceph-mon[34316]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:01 smithi102 ceph-mon[31392]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:01.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:01 smithi148 ceph-mon[34651]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:02.577 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:02.577 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:02.577 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:02.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:02.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:03.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:03 smithi121 ceph-mon[34316]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:03 smithi102 ceph-mon[31392]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:03 smithi148 ceph-mon[34651]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:05.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:05.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:05.930 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.929+0000 7f0ddb7fe640 1 -- 172.21.15.121:0/2090904297 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0dec063800 con 0x7f0dd40b65e0 2024-09-21T03:29:05.931 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 7 on host 'smithi121' 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 msgr2=0x7f0dd40b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 0x7f0dd40b8af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc005ab0 tx=0x7f0ddc005a20 comp rx=0 tx=0).stop 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 msgr2=0x7f0dec19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0de400eaa0 tx=0x7f0de400ef60 comp rx=0 tx=0).stop 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 shutdown_connections 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0dd40b65e0 0x7f0dd40b8af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:05.933 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0dec1094a0 0x7f0dec19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:05.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0dec109df0 0x7f0dec19fe00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:05.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 --2- 172.21.15.121:0/2090904297 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0dec103b60 0x7f0dec19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:05.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 >> 172.21.15.121:0/2090904297 conn(0x7f0dec07b850 msgr2=0x7f0dec107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:29:05.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 shutdown_connections 2024-09-21T03:29:05.934 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:29:05.931+0000 7f0df0be2640 1 -- 172.21.15.121:0/2090904297 wait complete. 2024-09-21T03:29:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.615 DEBUG:teuthology.orchestra.run.smithi121:osd.7> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T03:29:06.617 INFO:tasks.cephadm:Deploying osd.8 on smithi148 with /dev/vg_nvme/lv_2... 2024-09-21T03:29:06.617 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:29:06.645 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:06.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:06.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:06.873 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:29:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:07 smithi102 ceph-mon[31392]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:07.723 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:07 smithi121 ceph-mon[34316]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:07 smithi148 ceph-mon[34651]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:08.748 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:29:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:29:08.378+0000 7fa4f2fc7640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:29:09.407 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:09 smithi121 ceph-mon[34316]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:09.407 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:09 smithi121 ceph-mon[34316]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.407 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:09 smithi121 ceph-mon[34316]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.414 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:09 smithi148 ceph-mon[34651]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:09.415 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:09 smithi148 ceph-mon[34651]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.415 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:09 smithi148 ceph-mon[34651]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.418 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:29:09.446 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_2 2024-09-21T03:29:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:09 smithi102 ceph-mon[31392]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:09 smithi102 ceph-mon[31392]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:09 smithi102 ceph-mon[31392]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:29:09.748 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:29:10.214 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- 172.21.15.148:0/178070999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c108480 msgr2=0x7f221c10ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 --2- 172.21.15.148:0/178070999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c108480 0x7f221c10ecb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2214009ca0 tx=0x7f221402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- 172.21.15.148:0/178070999 shutdown_connections 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 --2- 172.21.15.148:0/178070999 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c108480 0x7f221c10ecb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 --2- 172.21.15.148:0/178070999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c107b30 0x7f221c107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 --2- 172.21.15.148:0/178070999 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c1021f0 0x7f221c102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- 172.21.15.148:0/178070999 >> 172.21.15.148:0/178070999 conn(0x7f221c077c60 msgr2=0x7f221c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- 172.21.15.148:0/178070999 shutdown_connections 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- 172.21.15.148:0/178070999 wait complete. 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 Processor -- start 2024-09-21T03:29:10.215 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.212+0000 7f222247b640 1 -- start start 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c107b30 0x7f221c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c108480 0x7f221c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f221c112280 con 0x7f221c107b30 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f221c112100 con 0x7f221c108480 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f222247b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f221c112400 con 0x7f221c1021f0 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:10.217 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:44342/0 (socket says 172.21.15.148:44342) 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 -- 172.21.15.148:0/657496098 learned_addr learned my addr 172.21.15.148:0/657496098 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f2220a18640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c108480 0x7f221c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221b7fe640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c107b30 0x7f221c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 -- 172.21.15.148:0/657496098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c108480 msgr2=0x7f221c19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c108480 0x7f221c19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 -- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c107b30 msgr2=0x7f221c19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c107b30 0x7f221c19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.213+0000 7f221bfff640 1 -- 172.21.15.148:0/657496098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221c1a04f0 con 0x7f221c1021f0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f221bfff640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f220c00e9f0 tx=0x7f220c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c00cd80 con 0x7f221c1021f0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221c1a07e0 con 0x7f221c1021f0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f220c010900 con 0x7f221c1021f0 2024-09-21T03:29:10.218 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f220c0188d0 con 0x7f221c1021f0 2024-09-21T03:29:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.214+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f221c1a6f40 con 0x7f221c1021f0 2024-09-21T03:29:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.215+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f221c102600 con 0x7f221c1021f0 2024-09-21T03:29:10.219 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.217+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f220c010ab0 con 0x7f221c1021f0 2024-09-21T03:29:10.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.218+0000 7f22197fa640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 0x7f22040b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:10.220 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.218+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5316+0+0 (secure 0 0 0) 0x7f220c0e7070 con 0x7f221c1021f0 2024-09-21T03:29:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.218+0000 7f221b7fe640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 0x7f22040b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:10.221 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.219+0000 7f221b7fe640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 0x7f22040b8a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f221c06aa70 tx=0x7f2210005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:29:10.224 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.222+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f220c0b27f0 con 0x7f221c1021f0 2024-09-21T03:29:10.420 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:10.417+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f221c063800 con 0x7f22040b6560 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:10.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:10.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.728 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:10.729 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.758 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:29:10.758 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T03:29:10.758 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.758 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:10.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:10.760 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:10.760 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:10.760 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:11.035 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:29:10.755+0000 7fa4eef49640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:29:11.035 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:29:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:29:10.767+0000 7fa4e6d3f640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi121 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:11.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='osd.7 ' entity='osd.7' 2024-09-21T03:29:11.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] boot 2024-09-21T03:29:11.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:29:11.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi121 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T03:29:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='osd.7 ' entity='osd.7' 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] boot 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:29:11.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi121 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi121 to 5695M 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: osdmap e48: 8 total, 7 up, 8 in 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='osd.7 ' entity='osd.7' 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: osd.7 [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] boot 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: osdmap e49: 8 total, 8 up, 8 in 2024-09-21T03:29:11.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:29:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:12 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:29:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:12 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:29:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:12 smithi102 ceph-mon[31392]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:12 smithi102 ceph-mon[31392]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T03:29:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:12 smithi102 ceph-mon[31392]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:12 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:29:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:12 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:29:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:12 smithi148 ceph-mon[34651]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:12 smithi148 ceph-mon[34651]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T03:29:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:12 smithi148 ceph-mon[34651]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:12 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:29:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:12 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:29:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:12 smithi121 ceph-mon[34316]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:12 smithi121 ceph-mon[34316]: osdmap e50: 8 total, 8 up, 8 in 2024-09-21T03:29:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:12 smithi121 ceph-mon[34316]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/3182190160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"}]': finished 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:13 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2605458727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:14.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/3182190160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"}]': finished 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:14.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:13 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/2605458727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:14.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: osdmap e51: 8 total, 8 up, 8 in 2024-09-21T03:29:14.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/3182190160' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:14.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"} : dispatch 2024-09-21T03:29:14.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c9af4a2-c599-4c13-916a-482f92ff1ef6"}]': finished 2024-09-21T03:29:14.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T03:29:14.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:14.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2605458727' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:14 smithi148 ceph-mon[34651]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:15.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:14 smithi121 ceph-mon[34316]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:15.104 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:14 smithi102 ceph-mon[31392]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:17.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:17 smithi148 ceph-mon[34651]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:17 smithi121 ceph-mon[34316]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:17.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:17 smithi102 ceph-mon[31392]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 225 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:19.255 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:19 smithi148 ceph-mon[34651]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T03:29:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:19 smithi121 ceph-mon[34316]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T03:29:19.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:19 smithi102 ceph-mon[31392]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-09-21T03:29:21.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:21 smithi148 ceph-mon[34651]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:29:21.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:21 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:29:21.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:21 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:21.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:21 smithi121 ceph-mon[34316]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:29:21.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:21 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:29:21.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:21 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:21.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:21 smithi102 ceph-mon[31392]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:29:21.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:21 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:29:21.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:21 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:22.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:22 smithi121 ceph-mon[34316]: Deploying daemon osd.8 on smithi148 2024-09-21T03:29:22.595 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:22 smithi148 ceph-mon[34651]: Deploying daemon osd.8 on smithi148 2024-09-21T03:29:22.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:22 smithi102 ceph-mon[31392]: Deploying daemon osd.8 on smithi148 2024-09-21T03:29:23.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:23 smithi121 ceph-mon[34316]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:23.595 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:23 smithi148 ceph-mon[34651]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:23.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:23 smithi102 ceph-mon[31392]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:25.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:25 smithi121 ceph-mon[34316]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:29:25.595 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:25 smithi148 ceph-mon[34651]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:29:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:25 smithi102 ceph-mon[31392]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:29:27.534 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:27 smithi148 ceph-mon[34651]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:27 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:27 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:27 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:27 smithi121 ceph-mon[34316]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:27 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:27.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:27 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:27.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:27 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:27 smithi102 ceph-mon[31392]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:27 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:27 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:27 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:29 smithi148 ceph-mon[34651]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:29.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:29 smithi121 ceph-mon[34316]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:29.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:29 smithi102 ceph-mon[31392]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:30.507 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.505+0000 7f22197fa640 1 -- 172.21.15.148:0/657496098 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f221c063800 con 0x7f22040b6560 2024-09-21T03:29:30.507 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 8 on host 'smithi148' 2024-09-21T03:29:30.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 msgr2=0x7f22040b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:30.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 0x7f22040b8a70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f221c06aa70 tx=0x7f2210005f90 comp rx=0 tx=0).stop 2024-09-21T03:29:30.509 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 msgr2=0x7f221c19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f220c00e9f0 tx=0x7f220c00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 shutdown_connections 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22040b6560 0x7f22040b8a70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f221c107b30 0x7f221c19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f221c108480 0x7f221c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 --2- 172.21.15.148:0/657496098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f221c1021f0 0x7f221c19a580 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 >> 172.21.15.148:0/657496098 conn(0x7f221c077c60 msgr2=0x7f221c108b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 shutdown_connections 2024-09-21T03:29:30.510 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:29:30.508+0000 7f222247b640 1 -- 172.21.15.148:0/657496098 wait complete. 2024-09-21T03:29:31.147 DEBUG:teuthology.orchestra.run.smithi148:osd.8> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T03:29:31.149 INFO:tasks.cephadm:Deploying osd.9 on smithi102 with /dev/vg_nvme/lv_1... 2024-09-21T03:29:31.149 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:29:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:29:31.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:31 smithi102 ceph-mon[31392]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:31 smithi148 ceph-mon[34651]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:31.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:31 smithi121 ceph-mon[34316]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:33.404 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:33 smithi102 ceph-mon[31392]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:33.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:33 smithi121 ceph-mon[34316]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:33.669 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:33 smithi148 ceph-mon[34651]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:33.670 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:29:33 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:29:33.346+0000 7fe60e427640 -1 osd.8 0 log_to_monitors true 2024-09-21T03:29:34.212 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:29:34.245 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi102:vg_nvme/lv_1 2024-09-21T03:29:34.503 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:29:34.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:34 smithi121 ceph-mon[34316]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:34.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:34 smithi121 ceph-mon[34316]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:34.624 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:34 smithi102 ceph-mon[31392]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:34.624 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:34 smithi102 ceph-mon[31392]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:34 smithi148 ceph-mon[34651]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:34 smithi148 ceph-mon[34651]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 -- 172.21.15.102:0/1384666337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 msgr2=0x7f8bb810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 --2- 172.21.15.102:0/1384666337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb810f560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009900 tx=0x7f8bb002a410 comp rx=0 tx=0).stop 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 -- 172.21.15.102:0/1384666337 shutdown_connections 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 --2- 172.21.15.102:0/1384666337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb810f560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 --2- 172.21.15.102:0/1384666337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb81083e0 0x7f8bb81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 --2- 172.21.15.102:0/1384666337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb8102aa0 0x7f8bb8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 -- 172.21.15.102:0/1384666337 >> 172.21.15.102:0/1384666337 conn(0x7f8bb80797e0 msgr2=0x7f8bb8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 -- 172.21.15.102:0/1384666337 shutdown_connections 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.004+0000 7f8bc0234640 1 -- 172.21.15.102:0/1384666337 wait complete. 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 Processor -- start 2024-09-21T03:29:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 -- start start 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb81083e0 0x7f8bb819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8112ac0 con 0x7f8bb8108d30 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8112940 con 0x7f8bb8102aa0 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bc0234640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb8112c40 con 0x7f8bb81083e0 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bbe7d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bbe7d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34814/0 (socket says 172.21.15.102:34814) 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.005+0000 7f8bbe7d1640 1 -- 172.21.15.102:0/933479986 learned_addr learned my addr 172.21.15.102:0/933479986 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbd7cf640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb81083e0 0x7f8bb819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbdfd0640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 -- 172.21.15.102:0/933479986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb81083e0 msgr2=0x7f8bb819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb81083e0 0x7f8bb819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 -- 172.21.15.102:0/933479986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 msgr2=0x7f8bb819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 -- 172.21.15.102:0/933479986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb81a25f0 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbdfd0640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bbe7d1640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0005ab0 tx=0x7f8bb00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb003f030 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb81a2880 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8bb0003cd0 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0035070 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.006+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb81a9040 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.007+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb8102eb0 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.009+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f8bb0042030 con 0x7f8bb8108d30 2024-09-21T03:29:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.010+0000 7f8baeffd640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 0x7f8ba40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:29:35.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.010+0000 7f8bbdfd0640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 0x7f8ba40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:29:35.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.010+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5748+0+0 (secure 0 0 0) 0x7f8bb0107460 con 0x7f8bb8108d30 2024-09-21T03:29:35.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.010+0000 7f8bbdfd0640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 0x7f8ba40b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005fd0 tx=0x7f8bb4009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:29:35.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.013+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8bb00ce650 con 0x7f8bb8108d30 2024-09-21T03:29:35.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:35.203+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8bb8104880 con 0x7f8ba40b6560 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.580 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:35.581 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:35.582 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:29:35.289+0000 7fe60a3a9640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T03:29:35.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:29:35.299+0000 7fe6061a7640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:29:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:29:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:35.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:35.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: osdmap e53: 9 total, 8 up, 9 in 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:29:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi148 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: from='client.14649 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: osdmap e54: 9 total, 8 up, 9 in 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:36.583 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:36.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi148 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: from='client.14649 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: osdmap e54: 9 total, 8 up, 9 in 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:36.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi148 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi148 to 5696M 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: from='client.14649 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi102:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: osdmap e54: 9 total, 8 up, 9 in 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:36.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] boot 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:37 smithi102 ceph-mon[31392]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T03:29:37.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] boot 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:37 smithi148 ceph-mon[34651]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: osd.8 [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] boot 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:29:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:37 smithi121 ceph-mon[34316]: osdmap e56: 9 total, 9 up, 9 in 2024-09-21T03:29:38.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"} : dispatch 2024-09-21T03:29:38.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"}]': finished 2024-09-21T03:29:38.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:38 smithi102 ceph-mon[31392]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:29:38.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:38 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:38.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2164688544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"} : dispatch 2024-09-21T03:29:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"}]': finished 2024-09-21T03:29:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:38 smithi148 ceph-mon[34651]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:29:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:38 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2164688544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"} : dispatch 2024-09-21T03:29:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2854045609' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "42776936-bb0a-4c50-8985-7362fc3d88cf"}]': finished 2024-09-21T03:29:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:38 smithi121 ceph-mon[34316]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T03:29:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:38 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2164688544' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:29:39.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:39 smithi102 ceph-mon[31392]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:39.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:39 smithi148 ceph-mon[34651]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:39 smithi121 ceph-mon[34316]: pgmap v182: 1 pgs: 1 remapped+peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:41.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:41 smithi102 ceph-mon[31392]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:41 smithi148 ceph-mon[34651]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:41 smithi121 ceph-mon[34316]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:43.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:43 smithi102 ceph-mon[31392]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:29:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:43 smithi148 ceph-mon[34651]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:29:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:43 smithi121 ceph-mon[34316]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:29:45.513 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:45 smithi102 ceph-mon[31392]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:29:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:45 smithi148 ceph-mon[34651]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:29:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:45 smithi121 ceph-mon[34316]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:29:46.634 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:29:46.634 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:46 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:46.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:29:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:46 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:29:46.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:46 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:47.562 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:47 smithi102 ceph-mon[31392]: Deploying daemon osd.9 on smithi102 2024-09-21T03:29:47.562 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:47 smithi102 ceph-mon[31392]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:47.645 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:47 smithi148 ceph-mon[34651]: Deploying daemon osd.9 on smithi102 2024-09-21T03:29:47.645 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:47 smithi148 ceph-mon[34651]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:47.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:47 smithi121 ceph-mon[34316]: Deploying daemon osd.9 on smithi102 2024-09-21T03:29:47.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:47 smithi121 ceph-mon[34316]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:29:49.627 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:49 smithi102 ceph-mon[31392]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:29:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:49 smithi148 ceph-mon[34651]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:29:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:49 smithi121 ceph-mon[34316]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:29:51.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:51 smithi102 ceph-mon[31392]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:51.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:51 smithi148 ceph-mon[34651]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:51 smithi121 ceph-mon[34316]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:52.497 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:52 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:52.497 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:52 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:52.497 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:52 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:52.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:52 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:52 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:52 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:52 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:52 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:52 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:53.522 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:53 smithi102 ceph-mon[31392]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:53 smithi148 ceph-mon[34651]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:53 smithi121 ceph-mon[34316]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:29:55.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:55 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.561+0000 7f8baeffd640 1 -- 172.21.15.102:0/933479986 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8bb8104880 con 0x7f8ba40b6560 2024-09-21T03:29:55.563 INFO:teuthology.orchestra.run.smithi102.stdout:Created osd(s) 9 on host 'smithi102' 2024-09-21T03:29:55.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 msgr2=0x7f8ba40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:55.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 0x7f8ba40b8a70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4005fd0 tx=0x7f8bb4009600 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 msgr2=0x7f8bb81a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0005ab0 tx=0x7f8bb00042f0 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 shutdown_connections 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8ba40b6560 0x7f8ba40b8a70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8bb8108d30 0x7f8bb81a1ec0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8bb81083e0 0x7f8bb819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 --2- 172.21.15.102:0/933479986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8bb8102aa0 0x7f8bb819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 >> 172.21.15.102:0/933479986 conn(0x7f8bb80797e0 msgr2=0x7f8bb8104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 shutdown_connections 2024-09-21T03:29:55.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:29:55.563+0000 7f8bc0234640 1 -- 172.21.15.102:0/933479986 wait complete. 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:55 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:55.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:55.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:29:55.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:29:55.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:55 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.203 DEBUG:teuthology.orchestra.run.smithi102:osd.9> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T03:29:56.206 INFO:tasks.cephadm:Deploying osd.10 on smithi121 with /dev/vg_nvme/lv_1... 2024-09-21T03:29:56.206 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:29:56.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:56.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:56 smithi102 ceph-mon[31392]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:56.461 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:29:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:56 smithi121 ceph-mon[34316]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:29:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:29:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:56 smithi148 ceph-mon[34651]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:58.006 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:29:57 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:29:57.940+0000 7f204700d640 -1 osd.9 0 log_to_monitors true 2024-09-21T03:29:58.162 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:58 smithi121 ceph-mon[34316]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:29:58.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:58 smithi102 ceph-mon[31392]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:29:58.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:58 smithi148 ceph-mon[34651]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T03:29:59.189 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.217 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T03:29:59.218 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:29:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.220 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-09-21T03:29:59.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi121:vg_nvme/lv_1 2024-09-21T03:29:59.386 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]} : dispatch 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi102", "root=default"]}]': finished 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: osdmap e59: 10 total, 9 up, 10 in 2024-09-21T03:29:59.387 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:29:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:29:59.496 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:29:59.702 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:29:59.439+0000 7f20437a4640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T03:29:59.703 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:29:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:29:59.452+0000 7f203ad85640 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:30:00.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2980628109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e0108cf0 msgr2=0x7f61e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:00.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2980628109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e0108cf0 0x7f61e010f520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f61d8009ca0 tx=0x7f61d802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.006 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2980628109 shutdown_connections 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2980628109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e0108cf0 0x7f61e010f520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2980628109 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e01083a0 0x7f61e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2980628109 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0102a60 0x7f61e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2980628109 >> 172.21.15.121:0/2980628109 conn(0x7f61e0079730 msgr2=0x7f61e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2980628109 shutdown_connections 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.004+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2980628109 wait complete. 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.005+0000 7f61e5d9d640 1 Processor -- start 2024-09-21T03:30:00.007 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.005+0000 7f61e5d9d640 1 -- start start 2024-09-21T03:30:00.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.005+0000 7f61e5d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e0102a60 0x7f61e019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:00.009 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.005+0000 7f61e5d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 0x7f61e019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0112b00 con 0x7f61e0108cf0 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0112980 con 0x7f61e01083a0 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f61e0112c80 con 0x7f61e0102a60 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:39400/0 (socket says 172.21.15.121:39400) 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 -- 172.21.15.121:0/2958591776 learned_addr learned my addr 172.21.15.121:0/2958591776 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61df7fe640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e0102a60 0x7f61e019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:00.010 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61dffff640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 0x7f61e019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 -- 172.21.15.121:0/2958591776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e0102a60 msgr2=0x7f61e019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e0102a60 0x7f61e019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 -- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 msgr2=0x7f61e019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 0x7f61e019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 -- 172.21.15.121:0/2958591776 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e01a65f0 con 0x7f61e01083a0 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61dffff640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 0x7f61e019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61d6ffd640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c970 tx=0x7f61c800cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8014070 con 0x7f61e01083a0 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f61c8004440 con 0x7f61e01083a0 2024-09-21T03:30:00.011 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e01a68e0 con 0x7f61e01083a0 2024-09-21T03:30:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8003d80 con 0x7f61e01083a0 2024-09-21T03:30:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.006+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e01a6e70 con 0x7f61e01083a0 2024-09-21T03:30:00.012 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.008+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e0102e70 con 0x7f61e01083a0 2024-09-21T03:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.009+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f61c8017070 con 0x7f61e01083a0 2024-09-21T03:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.010+0000 7f61dd7fa640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 0x7f61cc0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.010+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6196+0+0 (secure 0 0 0) 0x7f61c80e6d70 con 0x7f61e01083a0 2024-09-21T03:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.010+0000 7f61df7fe640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 0x7f61cc0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:00.013 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.011+0000 7f61df7fe640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 0x7f61cc0b8b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61e006b9c0 tx=0x7f61d0009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:00.014 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.013+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61c801e030 con 0x7f61e01083a0 2024-09-21T03:30:00.204 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:00.202+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f61e0063800 con 0x7f61cc0b6610 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi102 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: overall HEALTH_OK 2024-09-21T03:30:00.205 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi102 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:00.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:00.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' 2024-09-21T03:30:00.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: overall HEALTH_OK 2024-09-21T03:30:00.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi102 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi102 to 4272M 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892]' entity='osd.9' 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: overall HEALTH_OK 2024-09-21T03:30:00.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:01.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] boot 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:30:01.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] boot 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:30:01.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:01.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: osd.9 [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] boot 2024-09-21T03:30:01.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: osdmap e60: 10 total, 10 up, 10 in 2024-09-21T03:30:01.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:30:02.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:02 smithi148 ceph-mon[34651]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T03:30:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:02 smithi148 ceph-mon[34651]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:02 smithi121 ceph-mon[34316]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T03:30:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:02 smithi121 ceph-mon[34316]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:02.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:02 smithi102 ceph-mon[31392]: osdmap e61: 10 total, 10 up, 10 in 2024-09-21T03:30:02.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:02 smithi102 ceph-mon[31392]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/3052475056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"}]': finished 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:03 smithi148 ceph-mon[34651]: from='client.? 172.21.15.121:0/2177520537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/3052475056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"}]': finished 2024-09-21T03:30:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:30:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:03 smithi121 ceph-mon[34316]: from='client.? 172.21.15.121:0/2177520537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/3052475056' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"} : dispatch 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "127447a0-18cf-4a03-a1da-4d4a1a3c2268"}]': finished 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:03 smithi102 ceph-mon[31392]: from='client.? 172.21.15.121:0/2177520537' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:04.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:04 smithi148 ceph-mon[34651]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:04 smithi121 ceph-mon[34316]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:04.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:04 smithi102 ceph-mon[31392]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:07.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:07 smithi121 ceph-mon[34316]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:07 smithi102 ceph-mon[31392]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:07 smithi148 ceph-mon[34651]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:09.473 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:09 smithi121 ceph-mon[34316]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:09 smithi102 ceph-mon[31392]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:09.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:09 smithi148 ceph-mon[34651]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:11.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:11 smithi121 ceph-mon[34316]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:11.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:30:11.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:11 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:11 smithi102 ceph-mon[31392]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:30:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:11 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:11 smithi148 ceph-mon[34651]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:30:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:11 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:12.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:12 smithi121 ceph-mon[34316]: Deploying daemon osd.10 on smithi121 2024-09-21T03:30:12.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:12 smithi102 ceph-mon[31392]: Deploying daemon osd.10 on smithi121 2024-09-21T03:30:12.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:12 smithi148 ceph-mon[34651]: Deploying daemon osd.10 on smithi121 2024-09-21T03:30:13.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:13 smithi121 ceph-mon[34316]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:13 smithi102 ceph-mon[31392]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:13 smithi148 ceph-mon[34651]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:15.524 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:15 smithi121 ceph-mon[34316]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:15.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:15 smithi102 ceph-mon[31392]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:15 smithi148 ceph-mon[34651]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:17 smithi121 ceph-mon[34316]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:17.545 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:17 smithi148 ceph-mon[34651]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:17.545 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:17.545 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:17.545 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:17 smithi102 ceph-mon[31392]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:19 smithi121 ceph-mon[34316]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:19 smithi102 ceph-mon[31392]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:19.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:19 smithi148 ceph-mon[34651]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:20.663 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.661+0000 7f61dd7fa640 1 -- 172.21.15.121:0/2958591776 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f61e0063800 con 0x7f61cc0b6610 2024-09-21T03:30:20.663 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 10 on host 'smithi121' 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 msgr2=0x7f61cc0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 0x7f61cc0b8b20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61e006b9c0 tx=0x7f61d0009110 comp rx=0 tx=0).stop 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 msgr2=0x7f61e019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f61c800c970 tx=0x7f61c800cd70 comp rx=0 tx=0).stop 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 shutdown_connections 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f61cc0b6610 0x7f61cc0b8b20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:20.665 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61e0108cf0 0x7f61e019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:20.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f61e01083a0 0x7f61e019b930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:20.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 --2- 172.21.15.121:0/2958591776 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61e0102a60 0x7f61e019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:20.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 >> 172.21.15.121:0/2958591776 conn(0x7f61e0079730 msgr2=0x7f61e0105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:20.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 shutdown_connections 2024-09-21T03:30:20.666 INFO:teuthology.orchestra.run.smithi121.stderr:2024-09-21T03:30:20.664+0000 7f61e5d9d640 1 -- 172.21.15.121:0/2958591776 wait complete. 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.249 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:21.276 DEBUG:teuthology.orchestra.run.smithi121:osd.10> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T03:30:21.278 INFO:tasks.cephadm:Deploying osd.11 on smithi148 with /dev/vg_nvme/lv_1... 2024-09-21T03:30:21.278 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:30:21.541 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:30:23.259 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:30:22 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:30:22.932+0000 7fd8f4f7d640 -1 osd.10 0 log_to_monitors true 2024-09-21T03:30:23.405 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:23 smithi148 ceph-mon[34651]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:23.405 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:23 smithi148 ceph-mon[34651]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:23.405 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:23 smithi148 ceph-mon[34651]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:23.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:23 smithi121 ceph-mon[34316]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:23.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:23 smithi121 ceph-mon[34316]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:23.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:23 smithi121 ceph-mon[34316]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:23 smithi102 ceph-mon[31392]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:23 smithi102 ceph-mon[31392]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:23 smithi102 ceph-mon[31392]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:30:24.103 INFO:teuthology.orchestra.run.smithi148.stdout: 2024-09-21T03:30:24.130 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi148:vg_nvme/lv_1 2024-09-21T03:30:24.382 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-mon[34316]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:30:24.382 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-mon[34316]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:30:24.382 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:24.382 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-mon[34316]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.383 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-mon[34316]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.383 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:30:24.276+0000 7fd8f0eff640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T03:30:24.383 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:30:24 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:30:24.287+0000 7fd8eccfd640 -1 osd.10 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:30:24.383 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:30:24.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:24 smithi148 ceph-mon[34651]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:30:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:24 smithi148 ceph-mon[34651]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:30:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:24 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:24 smithi148 ceph-mon[34651]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:24 smithi148 ceph-mon[34651]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:24 smithi102 ceph-mon[31392]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:30:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:24 smithi102 ceph-mon[31392]: osdmap e63: 11 total, 10 up, 11 in 2024-09-21T03:30:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:24 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:24 smithi102 ceph-mon[31392]: from='osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:24 smithi102 ceph-mon[31392]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]} : dispatch 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- 172.21.15.148:0/2740459205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 msgr2=0x7fe96c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 --2- 172.21.15.148:0/2740459205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c1098b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe968009900 tx=0x7fe96802a410 comp rx=0 tx=0).stop 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- 172.21.15.148:0/2740459205 shutdown_connections 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 --2- 172.21.15.148:0/2740459205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 0x7fe96c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 --2- 172.21.15.148:0/2740459205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c1098b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 --2- 172.21.15.148:0/2740459205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:24.870 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- 172.21.15.148:0/2740459205 >> 172.21.15.148:0/2740459205 conn(0x7fe96c07b850 msgr2=0x7fe96c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- 172.21.15.148:0/2740459205 shutdown_connections 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- 172.21.15.148:0/2740459205 wait complete. 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 Processor -- start 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.853+0000 7fe9744e4640 1 -- start start 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 0x7fe96c19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113c30 con 0x7fe96c109df0 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113ab0 con 0x7fe96c103b60 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe9744e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe96c113db0 con 0x7fe96c1094a0 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:54690/0 (socket says 172.21.15.148:54690) 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 -- 172.21.15.148:0/3070597099 learned_addr learned my addr 172.21.15.148:0/3070597099 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe972280640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:24.871 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 -- 172.21.15.148:0/3070597099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 msgr2=0x7fe96c19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 -- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 msgr2=0x7fe96c19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe972a81640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 0x7fe96c19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 0x7fe96c19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 -- 172.21.15.148:0/3070597099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96c1a0530 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe972280640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.854+0000 7fe971a7f640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe968005940 tx=0x7fe968004360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.855+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe96803f030 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.855+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe96c1a07c0 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.855+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe968003cd0 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.855+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe968035070 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.855+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe96c1a6f80 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.856+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe96c103f70 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.857+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fe968042030 con 0x7fe96c1094a0 2024-09-21T03:30:24.872 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.858+0000 7fe95f7fe640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 0x7fe9580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:24.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.858+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6629+0+0 (secure 0 0 0) 0x7fe9681076f0 con 0x7fe96c1094a0 2024-09-21T03:30:24.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.858+0000 7fe972280640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 0x7fe9580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:24.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.859+0000 7fe972280640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 0x7fe9580b8a70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe960005fd0 tx=0x7fe960005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:24.873 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:24.861+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9680ce610 con 0x7fe96c1094a0 2024-09-21T03:30:25.049 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:25.047+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fe96c063800 con 0x7fe9580b6560 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.430 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:25.431 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:25.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: osdmap e64: 11 total, 10 up, 11 in 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:30:25.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi121 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] boot 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:30:26.411 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:26 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:26.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi121 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] boot 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:30:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:26 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi121 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi121 to 4271M 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: from='client.24526 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi148:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: osd.10 [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] boot 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T03:30:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:26 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:30:27.656 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:27 smithi148 ceph-mon[34651]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:27.656 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:27 smithi148 ceph-mon[34651]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T03:30:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:27 smithi102 ceph-mon[31392]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:27 smithi102 ceph-mon[31392]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T03:30:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:27 smithi121 ceph-mon[34316]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:27 smithi121 ceph-mon[34316]: osdmap e66: 11 total, 11 up, 11 in 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/2411460684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"}]': finished 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:28.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:28 smithi121 ceph-mon[34316]: from='client.? 172.21.15.148:0/1113758026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/2411460684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"}]': finished 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:28 smithi102 ceph-mon[31392]: from='client.? 172.21.15.148:0/1113758026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: osdmap e67: 11 total, 11 up, 11 in 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/2411460684' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"} : dispatch 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17bb6286-d812-42d3-b399-87e75901b950"}]': finished 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:28 smithi148 ceph-mon[34651]: from='client.? 172.21.15.148:0/1113758026' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:30:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:29 smithi102 ceph-mon[31392]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:29 smithi148 ceph-mon[34651]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:29 smithi121 ceph-mon[34316]: pgmap v218: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:31.582 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:31 smithi148 ceph-mon[34651]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:31.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:31 smithi102 ceph-mon[31392]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:31 smithi121 ceph-mon[34316]: pgmap v219: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:33.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:33 smithi148 ceph-mon[34651]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:30:33.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:33 smithi102 ceph-mon[31392]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:30:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:33 smithi121 ceph-mon[34316]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:30:35.551 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:35 smithi148 ceph-mon[34651]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:30:35.551 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:30:35.551 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:35 smithi102 ceph-mon[31392]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:30:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:30:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:35 smithi121 ceph-mon[34316]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-21T03:30:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:30:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:36.626 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:36 smithi148 ceph-mon[34651]: Deploying daemon osd.11 on smithi148 2024-09-21T03:30:36.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:36 smithi102 ceph-mon[31392]: Deploying daemon osd.11 on smithi148 2024-09-21T03:30:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:36 smithi121 ceph-mon[34316]: Deploying daemon osd.11 on smithi148 2024-09-21T03:30:37.686 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:37 smithi148 ceph-mon[34651]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:30:37.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:37 smithi102 ceph-mon[31392]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:30:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:37 smithi121 ceph-mon[34316]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-21T03:30:39.630 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:39 smithi148 ceph-mon[34651]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T03:30:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:39 smithi102 ceph-mon[31392]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T03:30:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:39 smithi121 ceph-mon[34316]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-21T03:30:41.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:41 smithi148 ceph-mon[34651]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:41.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:41 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:41.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:41 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:41.628 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:41 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:41.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:41 smithi102 ceph-mon[31392]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:41 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:41 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:41 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:41 smithi121 ceph-mon[34316]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:41 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:41 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:41 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:43.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:43 smithi102 ceph-mon[31392]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:43.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:43 smithi148 ceph-mon[34651]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:43 smithi121 ceph-mon[34316]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:30:44.412 INFO:teuthology.orchestra.run.smithi148.stdout:Created osd(s) 11 on host 'smithi148' 2024-09-21T03:30:44.412 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.409+0000 7fe95f7fe640 1 -- 172.21.15.148:0/3070597099 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fe96c063800 con 0x7fe9580b6560 2024-09-21T03:30:44.414 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 msgr2=0x7fe9580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 0x7fe9580b8a70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe960005fd0 tx=0x7fe960005ea0 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 msgr2=0x7fe96c19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe968005940 tx=0x7fe968004360 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 shutdown_connections 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9580b6560 0x7fe9580b8a70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe96c109df0 0x7fe96c19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe96c1094a0 0x7fe96c19ab60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 --2- 172.21.15.148:0/3070597099 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe96c103b60 0x7fe96c19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 >> 172.21.15.148:0/3070597099 conn(0x7fe96c07b850 msgr2=0x7fe96c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 shutdown_connections 2024-09-21T03:30:44.415 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:44.412+0000 7fe9744e4640 1 -- 172.21.15.148:0/3070597099 wait complete. 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:44.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:45.049 DEBUG:teuthology.orchestra.run.smithi148:osd.11> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T03:30:45.052 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T03:30:45.052 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:30:45.306 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- 172.21.15.102:0/343033690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4501083d0 msgr2=0x7ff4501087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 --2- 172.21.15.102:0/343033690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4501083d0 0x7ff4501087e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff440009900 tx=0x7ff44002a410 comp rx=0 tx=0).stop 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- 172.21.15.102:0/343033690 shutdown_connections 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 --2- 172.21.15.102:0/343033690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4501083d0 0x7ff4501087e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 --2- 172.21.15.102:0/343033690 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff450108d20 0x7ff45010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 --2- 172.21.15.102:0/343033690 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450102a90 0x7ff450102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- 172.21.15.102:0/343033690 >> 172.21.15.102:0/343033690 conn(0x7ff450079730 msgr2=0x7ff450079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- 172.21.15.102:0/343033690 shutdown_connections 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- 172.21.15.102:0/343033690 wait complete. 2024-09-21T03:30:45.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 Processor -- start 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.805+0000 7ff456f40640 1 -- start start 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4501083d0 0x7ff450110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450108d20 0x7ff450110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff450113c60 con 0x7ff450102a90 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff450113ae0 con 0x7ff4501083d0 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff456f40640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff450113de0 con 0x7ff450108d20 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39766/0 (socket says 172.21.15.102:39766) 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 -- 172.21.15.102:0/644562772 learned_addr learned my addr 172.21.15.102:0/644562772 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff4554dd640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450108d20 0x7ff450110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff447fff640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4501083d0 0x7ff450110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 -- 172.21.15.102:0/644562772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450108d20 msgr2=0x7ff450110ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450108d20 0x7ff450110ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 -- 172.21.15.102:0/644562772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4501083d0 msgr2=0x7ff450110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4501083d0 0x7ff450110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 -- 172.21.15.102:0/644562772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4501a89d0 con 0x7ff450102a90 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.806+0000 7ff454cdc640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00d770 tx=0x7ff44c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.807+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c017070 con 0x7ff450102a90 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.807+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff44c0054f0 con 0x7ff450102a90 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.807+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4501a8cc0 con 0x7ff450102a90 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.807+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004de0 con 0x7ff450102a90 2024-09-21T03:30:45.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.807+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4501a9180 con 0x7ff450102a90 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.808+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff450103d10 con 0x7ff450102a90 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.809+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7ff44c004f80 con 0x7ff450102a90 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.810+0000 7ff445ffb640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 0x7ff4380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.810+0000 7ff447fff640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 0x7ff4380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.810+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7024+0+0 (secure 0 0 0) 0x7ff44c0e6cf0 con 0x7ff450102a90 2024-09-21T03:30:45.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.811+0000 7ff447fff640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 0x7ff4380b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff440005940 tx=0x7ff4400058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:45.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.813+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff44c0b1e70 con 0x7ff450102a90 2024-09-21T03:30:45.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.993+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff450102ea0 con 0x7ff450102a90 2024-09-21T03:30:45.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.993+0000 7ff445ffb640 1 -- 172.21.15.102:0/644562772 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7ff44c0b6db0 con 0x7ff450102a90 2024-09-21T03:30:45.994 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:30:45.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.995+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 msgr2=0x7ff4380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:45.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.995+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 0x7ff4380b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff440005940 tx=0x7ff4400058d0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.995+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 msgr2=0x7ff450110030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.995+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00d770 tx=0x7ff44c00dc30 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.995+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 shutdown_connections 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff4380b6560 0x7ff4380b8a70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff450108d20 0x7ff450110ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4501083d0 0x7ff450110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 --2- 172.21.15.102:0/644562772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff450102a90 0x7ff450110030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 >> 172.21.15.102:0/644562772 conn(0x7ff450079730 msgr2=0x7ff450104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 shutdown_connections 2024-09-21T03:30:45.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:45.996+0000 7ff456f40640 1 -- 172.21.15.102:0/644562772 wait complete. 2024-09-21T03:30:46.364 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:46 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/644562772' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:46.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:46 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/644562772' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:46.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:46 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/644562772' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:46.826 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726889425,"num_in_osds":12,"osd_in_since":1726889427,"num_remapped_pgs":0} 2024-09-21T03:30:47.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:47 smithi148 ceph-mon[34651]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:47.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:47 smithi148 ceph-mon[34651]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:47 smithi148 ceph-mon[34651]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.244 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:30:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:30:46.965+0000 7f42f1a36640 -1 osd.11 0 log_to_monitors true 2024-09-21T03:30:47.437 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:47 smithi121 ceph-mon[34316]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:47.437 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:47 smithi121 ceph-mon[34316]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.437 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:47 smithi121 ceph-mon[34316]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:47 smithi102 ceph-mon[31392]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:47.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:47 smithi102 ceph-mon[31392]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:47 smithi102 ceph-mon[31392]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:30:47.827 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:30:48.087 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:48.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:48.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:48 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:48.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:48.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: osdmap e69: 12 total, 11 up, 12 in 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]} : dispatch 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:48.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:48 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:48.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 -- 172.21.15.102:0/1677366277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 msgr2=0x7f14b0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 --2- 172.21.15.102:0/1677366277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 0x7f14b0110620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009ca0 tx=0x7f14a802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 -- 172.21.15.102:0/1677366277 shutdown_connections 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 --2- 172.21.15.102:0/1677366277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 0x7f14b0110620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 --2- 172.21.15.102:0/1677366277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 0x7f14b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 --2- 172.21.15.102:0/1677366277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0103b60 0x7f14b0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 -- 172.21.15.102:0/1677366277 >> 172.21.15.102:0/1677366277 conn(0x7f14b007b850 msgr2=0x7f14b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 -- 172.21.15.102:0/1677366277 shutdown_connections 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.545+0000 7f14b4a05640 1 -- 172.21.15.102:0/1677366277 wait complete. 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 Processor -- start 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 -- start start 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:48.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0109df0 0x7f14b019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113c20 con 0x7f14b0103b60 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113aa0 con 0x7f14b0109df0 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.546+0000 7f14b4a05640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113da0 con 0x7f14b01094a0 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39786/0 (socket says 172.21.15.102:39786) 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 -- 172.21.15.102:0/3946191307 learned_addr learned my addr 172.21.15.102:0/3946191307 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14aed9d640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0109df0 0x7f14b019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14add9b640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 -- 172.21.15.102:0/3946191307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 msgr2=0x7f14b019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 -- 172.21.15.102:0/3946191307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0109df0 msgr2=0x7f14b019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0109df0 0x7f14b019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 -- 172.21.15.102:0/3946191307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b01a0440 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14add9b640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14ae59c640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14a000d950 tx=0x7f14a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a0017070 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14a0009c30 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b01a0730 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a000f6b0 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.547+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b01a6e90 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.548+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b0103f70 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.551+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f14a00109c0 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.552+0000 7f14a77fe640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 0x7f149c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.552+0000 7f14add9b640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 0x7f149c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.552+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7062+0+0 (secure 0 0 0) 0x7f14a00e6a70 con 0x7f14b0103b60 2024-09-21T03:30:48.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.552+0000 7f14add9b640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 0x7f149c0b8a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14b0107090 tx=0x7f1498005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:48.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.555+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14a0009de0 con 0x7f14b0103b60 2024-09-21T03:30:48.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.735+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f14b01a7200 con 0x7f14b0103b60 2024-09-21T03:30:48.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.735+0000 7f14a77fe640 1 -- 172.21.15.102:0/3946191307 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f14a00ad7e0 con 0x7f14b0103b60 2024-09-21T03:30:48.737 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 msgr2=0x7f149c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 0x7f149c0b8a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14b0107090 tx=0x7f1498005f90 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 msgr2=0x7f14b019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f14a000d950 tx=0x7f14a000de10 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 shutdown_connections 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6560 0x7f149c0b8a70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0109df0 0x7f14b019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 --2- 172.21.15.102:0/3946191307 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b019a4d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 >> 172.21.15.102:0/3946191307 conn(0x7f14b007b850 msgr2=0x7f14b0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 shutdown_connections 2024-09-21T03:30:48.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:48.738+0000 7f14b4a05640 1 -- 172.21.15.102:0/3946191307 wait complete. 2024-09-21T03:30:48.993 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:30:48.500+0000 7f42ed9b8640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T03:30:48.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:30:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:30:48.514+0000 7f42e57ae640 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: Detected new or changed devices on smithi148 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: from='osd.11 ' entity='osd.11' 2024-09-21T03:30:49.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:49 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3946191307' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: Detected new or changed devices on smithi148 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: from='osd.11 ' entity='osd.11' 2024-09-21T03:30:49.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:49 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3946191307' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:49.514 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1726889425,"num_in_osds":12,"osd_in_since":1726889427,"num_remapped_pgs":0} 2024-09-21T03:30:49.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: Detected new or changed devices on smithi148 2024-09-21T03:30:49.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi148 to 4272M 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi148", "root=default"]}]': finished 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: osdmap e70: 12 total, 11 up, 12 in 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: from='osd.11 ' entity='osd.11' 2024-09-21T03:30:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:49 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3946191307' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:50.224 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: purged_snaps scrub starts 2024-09-21T03:30:50.224 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: purged_snaps scrub ok 2024-09-21T03:30:50.224 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.225 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] boot 2024-09-21T03:30:50.225 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:30:50.225 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:50 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: purged_snaps scrub starts 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: purged_snaps scrub ok 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] boot 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:30:50.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:50 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:30:50.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: purged_snaps scrub starts 2024-09-21T03:30:50.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: purged_snaps scrub ok 2024-09-21T03:30:50.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: osd.11 [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] boot 2024-09-21T03:30:50.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T03:30:50.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:50 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:30:50.766 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:51.142 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:51 smithi102 ceph-mon[31392]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:51.143 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:51 smithi102 ceph-mon[31392]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 -- 172.21.15.102:0/1192840891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8103210 msgr2=0x7effa8103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 --2- 172.21.15.102:0/1192840891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8103210 0x7effa8103620 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7effa4009900 tx=0x7effa402a410 comp rx=0 tx=0).stop 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 -- 172.21.15.102:0/1192840891 shutdown_connections 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 --2- 172.21.15.102:0/1192840891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 --2- 172.21.15.102:0/1192840891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8105220 0x7effa8105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 --2- 172.21.15.102:0/1192840891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8103210 0x7effa8103620 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 -- 172.21.15.102:0/1192840891 >> 172.21.15.102:0/1192840891 conn(0x7effa8079ea0 msgr2=0x7effa807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 -- 172.21.15.102:0/1192840891 shutdown_connections 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.230+0000 7effafe7b640 1 -- 172.21.15.102:0/1192840891 wait complete. 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 Processor -- start 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 -- start start 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8103210 0x7effa8199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7effa8112ba0 con 0x7effa8105220 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7effa8112a20 con 0x7effa8105b70 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effafe7b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7effa8112d20 con 0x7effa8103210 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effad416640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effad416640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39812/0 (socket says 172.21.15.102:39812) 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.231+0000 7effad416640 1 -- 172.21.15.102:0/1809615953 learned_addr learned my addr 172.21.15.102:0/1809615953 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effae418640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effadc17640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8103210 0x7effa8199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 -- 172.21.15.102:0/1809615953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8103210 msgr2=0x7effa8199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8103210 0x7effa8199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 -- 172.21.15.102:0/1809615953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 msgr2=0x7effa819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 -- 172.21.15.102:0/1809615953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa819f400 con 0x7effa8105220 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effae418640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effad416640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d750 tx=0x7eff9800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98017070 con 0x7effa8105220 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7eff980054f0 con 0x7effa8105220 2024-09-21T03:30:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff98004d90 con 0x7effa8105220 2024-09-21T03:30:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa819f6f0 con 0x7effa8105220 2024-09-21T03:30:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.232+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa819fbe0 con 0x7effa8105220 2024-09-21T03:30:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.233+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effa8103620 con 0x7effa8105220 2024-09-21T03:30:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.235+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7eff98004f30 con 0x7effa8105220 2024-09-21T03:30:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.236+0000 7eff9effd640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 0x7eff940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.236+0000 7effadc17640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 0x7eff940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.236+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7eff980e6e60 con 0x7effa8105220 2024-09-21T03:30:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.236+0000 7effadc17640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 0x7eff940b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7effa4000c00 tx=0x7effa4009610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.239+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effa819fbe0 con 0x7effa8105220 2024-09-21T03:30:51.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.419+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7effa819a680 con 0x7effa8105220 2024-09-21T03:30:51.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.420+0000 7eff9effd640 1 -- 172.21.15.102:0/1809615953 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7effa819a680 con 0x7effa8105220 2024-09-21T03:30:51.422 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 msgr2=0x7eff940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 0x7eff940b8aa0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7effa4000c00 tx=0x7effa4009610 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 msgr2=0x7effa8199af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7eff9800d750 tx=0x7eff9800dc10 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 shutdown_connections 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7eff940b6590 0x7eff940b8aa0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effa8105220 0x7effa8199af0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7effa8105b70 0x7effa819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 --2- 172.21.15.102:0/1809615953 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7effa8103210 0x7effa8199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:51.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 >> 172.21.15.102:0/1809615953 conn(0x7effa8079ea0 msgr2=0x7effa81064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:51.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 shutdown_connections 2024-09-21T03:30:51.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:51.422+0000 7effafe7b640 1 -- 172.21.15.102:0/1809615953 wait complete. 2024-09-21T03:30:51.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:51 smithi148 ceph-mon[34651]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:51.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:51 smithi148 ceph-mon[34651]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:30:51.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:51 smithi121 ceph-mon[34316]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:51.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:51 smithi121 ceph-mon[34316]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T03:30:52.117 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1726889449,"num_in_osds":12,"osd_in_since":1726889427,"num_remapped_pgs":0} 2024-09-21T03:30:52.117 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:30:52.202 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:52 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1809615953' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:52.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:52 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1809615953' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:52.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:52 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1809615953' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:30:52.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 -- 172.21.15.102:0/2120237460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 msgr2=0x7f906810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 --2- 172.21.15.102:0/2120237460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906810f530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9060009ca0 tx=0x7f906002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 -- 172.21.15.102:0/2120237460 shutdown_connections 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 --2- 172.21.15.102:0/2120237460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906810f530 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 --2- 172.21.15.102:0/2120237460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f90681083b0 0x7f90681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 --2- 172.21.15.102:0/2120237460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9068102ac0 0x7f9068102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 -- 172.21.15.102:0/2120237460 >> 172.21.15.102:0/2120237460 conn(0x7f9068079720 msgr2=0x7f9068079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 -- 172.21.15.102:0/2120237460 shutdown_connections 2024-09-21T03:30:52.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.830+0000 7f906db7d640 1 -- 172.21.15.102:0/2120237460 wait complete. 2024-09-21T03:30:52.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 Processor -- start 2024-09-21T03:30:52.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 -- start start 2024-09-21T03:30:52.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9068102ac0 0x7f906819b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 0x7f906819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9068112b60 con 0x7f9068108d00 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f90681129e0 con 0x7f90681083b0 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.831+0000 7f906db7d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9068112ce0 con 0x7f9068102ac0 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39824/0 (socket says 172.21.15.102:39824) 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 -- 172.21.15.102:0/1105533958 learned_addr learned my addr 172.21.15.102:0/1105533958 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f90677fe640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9068102ac0 0x7f906819b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f905effd640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 0x7f906819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 -- 172.21.15.102:0/1105533958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9068102ac0 msgr2=0x7f906819b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9068102ac0 0x7f906819b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 -- 172.21.15.102:0/1105533958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 msgr2=0x7f906819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 0x7f906819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 -- 172.21.15.102:0/1105533958 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90681a66e0 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f905effd640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 0x7f906819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f9067fff640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9060005e30 tx=0x7f9060003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9060031650 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f90600317f0 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90681a6970 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f906002fb70 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.832+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90681a6f00 con 0x7f9068108d00 2024-09-21T03:30:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.834+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9068102ed0 con 0x7f9068108d00 2024-09-21T03:30:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.835+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f906002fd10 con 0x7f9068108d00 2024-09-21T03:30:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.836+0000 7f90657fa640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 0x7f90540b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.836+0000 7f90677fe640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 0x7f90540b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.836+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f9060108470 con 0x7f9068108d00 2024-09-21T03:30:52.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.836+0000 7f90677fe640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 0x7f90540b8b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f906806c380 tx=0x7f9058008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:52.839+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90600cf0d0 con 0x7f9068108d00 2024-09-21T03:30:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.017+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f906806bc30 con 0x7f9068108d00 2024-09-21T03:30:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.018+0000 7f90657fa640 1 -- 172.21.15.102:0/1105533958 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18859 (secure 0 0 0) 0x7f906806bc30 con 0x7f9068108d00 2024-09-21T03:30:53.020 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:30:53.020 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":72,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:30:50.509009+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:30:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 msgr2=0x7f90540b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 0x7f90540b8b20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f906806c380 tx=0x7f9058008040 comp rx=0 tx=0).stop 2024-09-21T03:30:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 msgr2=0x7f906819bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9060005e30 tx=0x7f9060003f90 comp rx=0 tx=0).stop 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 shutdown_connections 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f90540b6610 0x7f90540b8b20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9068108d00 0x7f906819bed0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f90681083b0 0x7f906819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 --2- 172.21.15.102:0/1105533958 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9068102ac0 0x7f906819b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 >> 172.21.15.102:0/1105533958 conn(0x7f9068079720 msgr2=0x7f9068106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 shutdown_connections 2024-09-21T03:30:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:53.020+0000 7f906db7d640 1 -- 172.21.15.102:0/1105533958 wait complete. 2024-09-21T03:30:53.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:53 smithi102 ceph-mon[31392]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:53.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:53 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1105533958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:30:53.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:53 smithi148 ceph-mon[34651]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:53.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:53 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1105533958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:30:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:53 smithi121 ceph-mon[34316]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:53.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:53 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1105533958' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:30:53.701 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:27:06.439475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:30:53.702 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T03:30:53.940 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:54.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- 172.21.15.102:0/4101032085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508108420 msgr2=0x7fd508108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 --2- 172.21.15.102:0/4101032085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508108420 0x7fd508108830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009900 tx=0x7fd4fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- 172.21.15.102:0/4101032085 shutdown_connections 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 --2- 172.21.15.102:0/4101032085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508108420 0x7fd508108830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 --2- 172.21.15.102:0/4101032085 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108d70 0x7fd50810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 --2- 172.21.15.102:0/4101032085 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508102ae0 0x7fd508102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- 172.21.15.102:0/4101032085 >> 172.21.15.102:0/4101032085 conn(0x7fd508079770 msgr2=0x7fd508079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- 172.21.15.102:0/4101032085 shutdown_connections 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- 172.21.15.102:0/4101032085 wait complete. 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 Processor -- start 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.375+0000 7fd50fd57640 1 -- start start 2024-09-21T03:30:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108420 0x7fd50819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 0x7fd50819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd508112b50 con 0x7fd508102ae0 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd5081129d0 con 0x7fd508108d70 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50fd57640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd508112cd0 con 0x7fd508108420 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52572/0 (socket says 172.21.15.102:52572) 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 -- 172.21.15.102:0/3443873863 learned_addr learned my addr 172.21.15.102:0/3443873863 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50d2f2640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108420 0x7fd50819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50e2f4640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 0x7fd50819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 -- 172.21.15.102:0/3443873863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108420 msgr2=0x7fd50819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108420 0x7fd50819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 -- 172.21.15.102:0/3443873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 msgr2=0x7fd50819be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 0x7fd50819be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 -- 172.21.15.102:0/3443873863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5081a66d0 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50e2f4640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 0x7fd50819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd50daf3640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800c890 tx=0x7fd4f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.376+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8004220 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.377+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5081a69c0 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.377+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd4f80043c0 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.377+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4f80049c0 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.377+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5081a6f20 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.378+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd508103d60 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.379+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fd4f8005140 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.380+0000 7fd506ffd640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.380+0000 7fd50d2f2640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.380+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fd4f80e7100 con 0x7fd508102ae0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.381+0000 7fd50d2f2640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 0x7fd4f00b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005940 tx=0x7fd4fc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:54.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.384+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4f8014030 con 0x7fd508102ae0 2024-09-21T03:30:54.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.561+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd50802e640 con 0x7fd508102ae0 2024-09-21T03:30:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.562+0000 7fd506ffd640 1 -- 172.21.15.102:0/3443873863 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7fd4f80adcc0 con 0x7fd508102ae0 2024-09-21T03:30:54.564 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-09-21T03:30:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 msgr2=0x7fd4f00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 0x7fd4f00b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc005940 tx=0x7fd4fc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 msgr2=0x7fd50819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd4f800c890 tx=0x7fd4f800cd50 comp rx=0 tx=0).stop 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 shutdown_connections 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4f00b6560 0x7fd4f00b8a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd508108d70 0x7fd50819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd508108420 0x7fd50819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 --2- 172.21.15.102:0/3443873863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd508102ae0 0x7fd50819b3c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 >> 172.21.15.102:0/3443873863 conn(0x7fd508079770 msgr2=0x7fd508106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 shutdown_connections 2024-09-21T03:30:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:54.564+0000 7fd50fd57640 1 -- 172.21.15.102:0/3443873863 wait complete. 2024-09-21T03:30:55.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:55 smithi102 ceph-mon[31392]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:55.435 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:55 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3443873863' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.a on smithi102 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.d on smithi102 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.g on smithi102 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.j on smithi102 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.b on smithi121 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.e on smithi121 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.h on smithi121 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.k on smithi121 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.c on smithi148 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.f on smithi148 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.i on smithi148 2024-09-21T03:30:55.468 INFO:tasks.cephadm:Adding mds.l on smithi148 2024-09-21T03:30:55.469 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l' 2024-09-21T03:30:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:55 smithi121 ceph-mon[34316]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:55.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:55 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3443873863' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:30:55.729 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:30:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:55 smithi148 ceph-mon[34651]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:55 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3443873863' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 -- 172.21.15.148:0/3090664017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 msgr2=0x7f10b4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 --2- 172.21.15.148:0/3090664017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b4102e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 -- 172.21.15.148:0/3090664017 shutdown_connections 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 --2- 172.21.15.148:0/3090664017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 --2- 172.21.15.148:0/3090664017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 0x7f10b41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 --2- 172.21.15.148:0/3090664017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b4102e70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 -- 172.21.15.148:0/3090664017 >> 172.21.15.148:0/3090664017 conn(0x7f10b4079730 msgr2=0x7f10b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 -- 172.21.15.148:0/3090664017 shutdown_connections 2024-09-21T03:30:56.426 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.415+0000 7f10bc455640 1 -- 172.21.15.148:0/3090664017 wait complete. 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.416+0000 7f10bc455640 1 Processor -- start 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.416+0000 7f10bc455640 1 -- start start 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 0x7f10b419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4113ba0 con 0x7f10b4108cf0 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4113a20 con 0x7f10b41083a0 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10bc455640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4113d20 con 0x7f10b4102a60 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.148:60194/0 (socket says 172.21.15.148:60194) 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 -- 172.21.15.148:0/2207185464 learned_addr learned my addr 172.21.15.148:0/2207185464 (peer_addr_for_me v2:172.21.15.148:0/0) 2024-09-21T03:30:56.427 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10b99f0640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 0x7f10b419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba9f2640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 -- 172.21.15.148:0/2207185464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 msgr2=0x7f10b419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 0x7f10b419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 -- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 msgr2=0x7f10b419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 -- 172.21.15.148:0/2207185464 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b41a04c0 con 0x7f10b4102a60 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba9f2640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.417+0000 7f10ba1f1640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005ab0 tx=0x7f10ac0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.418+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac03f030 con 0x7f10b4102a60 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.418+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b41a0750 con 0x7f10b4102a60 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.418+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f10ac003cd0 con 0x7f10b4102a60 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.418+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac035070 con 0x7f10b4102a60 2024-09-21T03:30:56.428 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.418+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b41a6f10 con 0x7f10b4102a60 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.419+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b4103ce0 con 0x7f10b4102a60 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.420+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f10ac042030 con 0x7f10b4102a60 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.421+0000 7f10b37fe640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 0x7f109c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.421+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f10ac1077f0 con 0x7f10b4102a60 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.421+0000 7f10b99f0640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 0x7f109c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.422+0000 7f10b99f0640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 0x7f109c0b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f10b41081a0 tx=0x7f10a800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:56.429 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.424+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mon.1 v2:172.21.15.148:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10ac0ce3b0 con 0x7f10b4102a60 2024-09-21T03:30:56.619 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.617+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}) -- 0x7f10b4063900 con 0x7f109c0b65e0 2024-09-21T03:30:56.629 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.628+0000 7f10b37fe640 1 -- 172.21.15.148:0/2207185464 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f10b4063900 con 0x7f109c0b65e0 2024-09-21T03:30:56.630 INFO:teuthology.orchestra.run.smithi148.stdout:Scheduled mds.all update... 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.630+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 msgr2=0x7f109c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.630+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 0x7f109c0b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f10b41081a0 tx=0x7f10a800b390 comp rx=0 tx=0).stop 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.630+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 msgr2=0x7f10b419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.630+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005ab0 tx=0x7f10ac0042f0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 shutdown_connections 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f109c0b65e0 0x7f109c0b8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f10b4108cf0 0x7f10b419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.632 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f10b41083a0 0x7f10b419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 --2- 172.21.15.148:0/2207185464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f10b4102a60 0x7f10b419a550 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:56.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 >> 172.21.15.148:0/2207185464 conn(0x7f10b4079730 msgr2=0x7f10b4101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:56.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 shutdown_connections 2024-09-21T03:30:56.633 INFO:teuthology.orchestra.run.smithi148.stderr:2024-09-21T03:30:56.631+0000 7f10bc455640 1 -- 172.21.15.148:0/2207185464 wait complete. 2024-09-21T03:30:57.278 DEBUG:teuthology.orchestra.run.smithi102:mds.a> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T03:30:57.281 DEBUG:teuthology.orchestra.run.smithi102:mds.d> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T03:30:57.323 DEBUG:teuthology.orchestra.run.smithi102:mds.g> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T03:30:57.366 DEBUG:teuthology.orchestra.run.smithi102:mds.j> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T03:30:57.410 DEBUG:teuthology.orchestra.run.smithi121:mds.b> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T03:30:57.412 DEBUG:teuthology.orchestra.run.smithi121:mds.e> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T03:30:57.455 DEBUG:teuthology.orchestra.run.smithi121:mds.h> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T03:30:57.498 DEBUG:teuthology.orchestra.run.smithi121:mds.k> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T03:30:57.518 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:57.518 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.518 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:57.518 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.518 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:57.519 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.519 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:30:57.519 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:30:57.519 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.519 DEBUG:teuthology.orchestra.run.smithi148:mds.c> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T03:30:57.522 DEBUG:teuthology.orchestra.run.smithi148:mds.f> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:30:57.542 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.543 DEBUG:teuthology.orchestra.run.smithi148:mds.i> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T03:30:57.586 DEBUG:teuthology.orchestra.run.smithi148:mds.l> sudo journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T03:30:57.628 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T03:30:57.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:30:57.650 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:30:57.869 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:30:58.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 -- 172.21.15.102:0/1517863730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638102ae0 msgr2=0x7fa638102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/1517863730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638102ae0 0x7fa638102ef0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa634009900 tx=0x7fa63402a410 comp rx=0 tx=0).stop 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 -- 172.21.15.102:0/1517863730 shutdown_connections 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/1517863730 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638108d70 0x7fa63810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/1517863730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108420 0x7fa638108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/1517863730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638102ae0 0x7fa638102ef0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.352+0000 7fa63ff8d640 1 -- 172.21.15.102:0/1517863730 >> 172.21.15.102:0/1517863730 conn(0x7fa638079770 msgr2=0x7fa638079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.353+0000 7fa63ff8d640 1 -- 172.21.15.102:0/1517863730 shutdown_connections 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.353+0000 7fa63ff8d640 1 -- 172.21.15.102:0/1517863730 wait complete. 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.353+0000 7fa63ff8d640 1 Processor -- start 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.353+0000 7fa63ff8d640 1 -- start start 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638102ae0 0x7fa63819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:58.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 0x7fa63819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa638112b70 con 0x7fa638108420 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa6381129f0 con 0x7fa638108d70 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa638112cf0 con 0x7fa638102ae0 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52596/0 (socket says 172.21.15.102:52596) 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 -- 172.21.15.102:0/3147282609 learned_addr learned my addr 172.21.15.102:0/3147282609 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63dd29640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638102ae0 0x7fa63819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63e52a640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 0x7fa63819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 -- 172.21.15.102:0/3147282609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638102ae0 msgr2=0x7fa63819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638102ae0 0x7fa63819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 -- 172.21.15.102:0/3147282609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 msgr2=0x7fa63819fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:58.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 0x7fa63819fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 -- 172.21.15.102:0/3147282609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6381a0560 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63e52a640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 0x7fa63819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63d528640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d740 tx=0x7fa62800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628017070 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa62800de50 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62800f620 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.354+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6381a0850 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.355+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6381a6fb0 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.355+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa638103d60 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.357+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fa62801a070 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.358+0000 7fa62effd640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 0x7fa6240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.358+0000 7fa63dd29640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 0x7fa6240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.358+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fa6280e6940 con 0x7fa638108420 2024-09-21T03:30:58.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.358+0000 7fa63dd29640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 0x7fa6240b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa634009230 tx=0x7fa6340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:30:58.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.361+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6280ad5a0 con 0x7fa638108420 2024-09-21T03:30:58.447 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:58 smithi148 ceph-mon[34651]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:58.448 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:58 smithi148 ceph-mon[34651]: Saving service mds.all spec with placement smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T03:30:58.448 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:58 smithi148 ceph-mon[34651]: Deploying daemon mds.l on smithi148 2024-09-21T03:30:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:58 smithi121 ceph-mon[34316]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:58 smithi121 ceph-mon[34316]: Saving service mds.all spec with placement smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T03:30:58.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:58 smithi121 ceph-mon[34316]: Deploying daemon mds.l on smithi148 2024-09-21T03:30:58.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.576+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa638102ef0 con 0x7fa638108420 2024-09-21T03:30:58.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:58 smithi102 ceph-mon[31392]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:30:58.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:58 smithi102 ceph-mon[31392]: Saving service mds.all spec with placement smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T03:30:58.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:58 smithi102 ceph-mon[31392]: Deploying daemon mds.l on smithi148 2024-09-21T03:30:58.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.577+0000 7fa62effd640 1 -- 172.21.15.102:0/3147282609 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa638102ef0 con 0x7fa638108420 2024-09-21T03:30:58.580 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:30:58.580 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":1,"btime":"2024-09-21T03:23:16:722520+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T03:30:58.580 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 1 2024-09-21T03:30:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 msgr2=0x7fa6240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 0x7fa6240b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa634009230 tx=0x7fa6340058d0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 msgr2=0x7fa63819ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa62800d740 tx=0x7fa62800dc00 comp rx=0 tx=0).stop 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 shutdown_connections 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa6240b6560 0x7fa6240b8a70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa638108420 0x7fa63819ab90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa638108d70 0x7fa63819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 --2- 172.21.15.102:0/3147282609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa638102ae0 0x7fa63819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 >> 172.21.15.102:0/3147282609 conn(0x7fa638079770 msgr2=0x7fa638101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 shutdown_connections 2024-09-21T03:30:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:30:58.579+0000 7fa63ff8d640 1 -- 172.21.15.102:0/3147282609 wait complete. 2024-09-21T03:30:58.994 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:58 smithi148 systemd[1]: Starting Ceph mds.l for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:30:59.395 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:59 smithi148 ceph-mon[34651]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:59.395 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:30:59 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3147282609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:30:59.395 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 podman[63215]: 2024-09-21 03:30:59.028031755 +0000 UTC m=+0.016162778 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:30:59.395 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 podman[63215]: 2024-09-21 03:30:59.157772908 +0000 UTC m=+0.145903921 container create 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T03:30:59.395 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 podman[63215]: 2024-09-21 03:30:59.393812261 +0000 UTC m=+0.381943275 container init 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:30:59.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:59 smithi121 ceph-mon[34316]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:59.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:30:59 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3147282609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:30:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:59 smithi102 ceph-mon[31392]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:30:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:30:59 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3147282609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:30:59.744 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 podman[63215]: 2024-09-21 03:30:59.397014337 +0000 UTC m=+0.385145368 container start 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T03:30:59.744 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 ceph-mds[63234]: -- 172.21.15.148:0/2153875958 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5562a8ce7c20 con 0x5562ace8fa80 2024-09-21T03:30:59.744 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l[63230]: starting mds.l at 2024-09-21T03:30:59.744 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 bash[63215]: 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 2024-09-21T03:30:59.744 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:30:59 smithi148 systemd[1]: Started Ceph mds.l for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:00.515 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6832/1886877979,v1:172.21.15.148:6833/1886877979] up:boot 2024-09-21T03:31:00.515 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: fsmap 1 up:standby 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: Deploying daemon mds.k on smithi121 2024-09-21T03:31:00.516 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:00 smithi121 ceph-mon[34316]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6832/1886877979,v1:172.21.15.148:6833/1886877979] up:boot 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: fsmap 1 up:standby 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:00.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: Deploying daemon mds.k on smithi121 2024-09-21T03:31:00.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:00 smithi102 ceph-mon[31392]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6832/1886877979,v1:172.21.15.148:6833/1886877979] up:boot 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: fsmap 1 up:standby 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:00.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: Deploying daemon mds.k on smithi121 2024-09-21T03:31:00.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:00 smithi148 ceph-mon[34651]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:01.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:01.626 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:01.786 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:01 smithi121 systemd[1]: Starting Ceph mds.k for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 -- 172.21.15.102:0/1212333090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74102a70 msgr2=0x7fef74102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1212333090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74102a70 0x7fef74102e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fef64009ca0 tx=0x7fef6402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 -- 172.21.15.102:0/1212333090 shutdown_connections 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1212333090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74108d00 0x7fef7410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1212333090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 0x7fef741087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1212333090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74102a70 0x7fef74102e80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 -- 172.21.15.102:0/1212333090 >> 172.21.15.102:0/1212333090 conn(0x7fef74079730 msgr2=0x7fef74079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 -- 172.21.15.102:0/1212333090 shutdown_connections 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.101+0000 7fef78e1e640 1 -- 172.21.15.102:0/1212333090 wait complete. 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 Processor -- start 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 -- start start 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74102a70 0x7fef7419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 0x7fef7419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fef74112a90 con 0x7fef74108d00 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef74112910 con 0x7fef741083b0 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef78e1e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fef74112c10 con 0x7fef74102a70 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef72d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:02.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef72d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52616/0 (socket says 172.21.15.102:52616) 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.102+0000 7fef72d9d640 1 -- 172.21.15.102:0/1119047274 learned_addr learned my addr 172.21.15.102:0/1119047274 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef7259c640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74102a70 0x7fef7419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef71d9b640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 0x7fef7419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 -- 172.21.15.102:0/1119047274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74102a70 msgr2=0x7fef7419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74102a70 0x7fef7419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 -- 172.21.15.102:0/1119047274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 msgr2=0x7fef7419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 0x7fef7419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 -- 172.21.15.102:0/1119047274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef741a03c0 con 0x7fef74108d00 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef72d9d640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d750 tx=0x7fef6c00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c017070 con 0x7fef74108d00 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef741a06b0 con 0x7fef74108d00 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fef6c0097c0 con 0x7fef74108d00 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c004c40 con 0x7fef74108d00 2024-09-21T03:31:02.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.103+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741a0ba0 con 0x7fef74108d00 2024-09-21T03:31:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.104+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef74103cf0 con 0x7fef74108d00 2024-09-21T03:31:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.106+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fef6c009970 con 0x7fef74108d00 2024-09-21T03:31:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.106+0000 7fef6b7fe640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 0x7fef600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.107+0000 7fef7259c640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 0x7fef600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:02.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.107+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fef6c0e6d00 con 0x7fef74108d00 2024-09-21T03:31:02.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.107+0000 7fef7259c640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 0x7fef600b8aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef64005e30 tx=0x7fef64009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:02.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.110+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef741a0ba0 con 0x7fef74108d00 2024-09-21T03:31:02.119 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:01 smithi121 podman[62865]: 2024-09-21 03:31:01.769009121 +0000 UTC m=+0.020772470 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:02.119 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:01 smithi121 podman[62865]: 2024-09-21 03:31:01.87977607 +0000 UTC m=+0.131539416 container create 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:31:02.120 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 podman[62865]: 2024-09-21 03:31:02.115633701 +0000 UTC m=+0.367397047 container init 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T03:31:02.120 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 podman[62865]: 2024-09-21 03:31:02.11846753 +0000 UTC m=+0.370230879 container start 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:31:02.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.330+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef7419b640 con 0x7fef74108d00 2024-09-21T03:31:02.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.331+0000 7fef6b7fe640 1 -- 172.21.15.102:0/1119047274 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fef6c0ad960 con 0x7fef74108d00 2024-09-21T03:31:02.333 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:02.333 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":2,"btime":"2024-09-21T03:30:59:435854+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:31:02.333 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 2 2024-09-21T03:31:02.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 msgr2=0x7fef600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:02.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 0x7fef600b8aa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fef64005e30 tx=0x7fef64009360 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 msgr2=0x7fef7419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00d750 tx=0x7fef6c00db50 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 shutdown_connections 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fef600b6590 0x7fef600b8aa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef74108d00 0x7fef7419fd50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef741083b0 0x7fef7419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 --2- 172.21.15.102:0/1119047274 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fef74102a70 0x7fef7419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 >> 172.21.15.102:0/1119047274 conn(0x7fef74079730 msgr2=0x7fef74106680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 shutdown_connections 2024-09-21T03:31:02.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:02.333+0000 7fef78e1e640 1 -- 172.21.15.102:0/1119047274 wait complete. 2024-09-21T03:31:02.535 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 ceph-mds[62884]: -- 172.21.15.121:0/872175361 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bbf15e5860 con 0x55bbf578d180 2024-09-21T03:31:02.535 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k[62880]: starting mds.k at 2024-09-21T03:31:02.536 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 bash[62865]: 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e 2024-09-21T03:31:02.536 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:31:02 smithi121 systemd[1]: Started Ceph mds.k for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:03.396 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:03.397 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: Deploying daemon mds.j on smithi102 2024-09-21T03:31:03.397 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1119047274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:03.397 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6832/172872234,v1:172.21.15.121:6833/172872234] up:boot 2024-09-21T03:31:03.397 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: fsmap 2 up:standby 2024-09-21T03:31:03.397 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:31:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: Deploying daemon mds.j on smithi102 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1119047274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6832/172872234,v1:172.21.15.121:6833/172872234] up:boot 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: fsmap 2 up:standby 2024-09-21T03:31:03.537 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: Deploying daemon mds.j on smithi102 2024-09-21T03:31:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1119047274' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:03.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6832/172872234,v1:172.21.15.121:6833/172872234] up:boot 2024-09-21T03:31:03.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: fsmap 2 up:standby 2024-09-21T03:31:03.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:31:04.953 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:04 smithi102 systemd[1]: Starting Ceph mds.j for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:05.097 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:05.316 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:05 smithi102 ceph-mon[31392]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:05.316 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 podman[73694]: 2024-09-21 03:31:04.939558476 +0000 UTC m=+0.015600807 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:05.316 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 podman[73694]: 2024-09-21 03:31:05.041462036 +0000 UTC m=+0.117504347 container create ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:31:05.317 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 podman[73694]: 2024-09-21 03:31:05.277770735 +0000 UTC m=+0.353813058 container init ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T03:31:05.317 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 podman[73694]: 2024-09-21 03:31:05.281956774 +0000 UTC m=+0.357999090 container start ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:31:05.317 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 ceph-mds[73738]: -- 172.21.15.102:0/850508790 <== mon.0 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556551f2f860 con 0x5565560d7600 2024-09-21T03:31:05.484 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:05.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:05 smithi121 ceph-mon[34316]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:05.605 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j[73727]: starting mds.j at 2024-09-21T03:31:05.605 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 bash[73694]: ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e 2024-09-21T03:31:05.606 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:31:05 smithi102 systemd[1]: Started Ceph mds.j for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:05 smithi148 ceph-mon[34651]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:05.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- 172.21.15.102:0/4112206477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc1083a0 msgr2=0x7ff0dc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 --2- 172.21.15.102:0/4112206477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc1087b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009900 tx=0x7ff0c402a410 comp rx=0 tx=0).stop 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- 172.21.15.102:0/4112206477 shutdown_connections 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 --2- 172.21.15.102:0/4112206477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc1087b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 --2- 172.21.15.102:0/4112206477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 --2- 172.21.15.102:0/4112206477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc102a60 0x7ff0dc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- 172.21.15.102:0/4112206477 >> 172.21.15.102:0/4112206477 conn(0x7ff0dc079730 msgr2=0x7ff0dc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- 172.21.15.102:0/4112206477 shutdown_connections 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- 172.21.15.102:0/4112206477 wait complete. 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 Processor -- start 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.946+0000 7ff0e1797640 1 -- start start 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc102a60 0x7ff0dc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:05.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc112a80 con 0x7ff0dc108cf0 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc112900 con 0x7ff0dc1083a0 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff0dc112c00 con 0x7ff0dc102a60 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52098/0 (socket says 172.21.15.102:52098) 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 -- 172.21.15.102:0/2525176113 learned_addr learned my addr 172.21.15.102:0/2525176113 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0d3fff640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 -- 172.21.15.102:0/2525176113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc102a60 msgr2=0x7ff0dc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0daffd640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc102a60 0x7ff0dc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc102a60 0x7ff0dc19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 -- 172.21.15.102:0/2525176113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 msgr2=0x7ff0dc19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:05.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 -- 172.21.15.102:0/2525176113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0dc1a04d0 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0d3fff640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0db7fe640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400eaa0 tx=0x7ff0d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400cdb0 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0dc1a07c0 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff0d4005020 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.947+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40116b0 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.948+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0dc1a6f20 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.948+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0dc102e70 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.950+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7ff0d40051d0 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.951+0000 7ff0d8ff9640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 0x7ff0c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.951+0000 7ff0daffd640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 0x7ff0c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.951+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7ff0d40e7610 con 0x7ff0dc108cf0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.951+0000 7ff0daffd640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 0x7ff0c80b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005fd0 tx=0x7ff0cc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:05.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:05.954+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0d4016030 con 0x7ff0dc108cf0 2024-09-21T03:31:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.176+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0dc19b690 con 0x7ff0dc108cf0 2024-09-21T03:31:06.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.176+0000 7ff0d8ff9640 1 -- 172.21.15.102:0/2525176113 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7ff0dc19b690 con 0x7ff0dc108cf0 2024-09-21T03:31:06.179 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:06.179 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":3,"btime":"2024-09-21T03:31:02:743040+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:31:06.179 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 3 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.178+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 msgr2=0x7ff0c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.178+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 0x7ff0c80b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc005fd0 tx=0x7ff0cc005850 comp rx=0 tx=0).stop 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.178+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 msgr2=0x7ff0dc19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.178+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400eaa0 tx=0x7ff0d400ef60 comp rx=0 tx=0).stop 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 shutdown_connections 2024-09-21T03:31:06.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff0c80b6560 0x7ff0c80b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff0dc108cf0 0x7ff0dc19fda0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0dc1083a0 0x7ff0dc19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 --2- 172.21.15.102:0/2525176113 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff0dc102a60 0x7ff0dc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 >> 172.21.15.102:0/2525176113 conn(0x7ff0dc079730 msgr2=0x7ff0dc06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 shutdown_connections 2024-09-21T03:31:06.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:06.179+0000 7ff0e1797640 1 -- 172.21.15.102:0/2525176113 wait complete. 2024-09-21T03:31:06.722 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.722 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.722 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: Deploying daemon mds.d on smithi102 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2525176113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:06.723 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.102:6834/1688882523,v1:172.21.15.102:6835/1688882523] up:boot 2024-09-21T03:31:06.724 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: fsmap 3 up:standby 2024-09-21T03:31:06.724 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: Deploying daemon mds.d on smithi102 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2525176113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.102:6834/1688882523,v1:172.21.15.102:6835/1688882523] up:boot 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: fsmap 3 up:standby 2024-09-21T03:31:06.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:31:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: Deploying daemon mds.d on smithi102 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2525176113' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.102:6834/1688882523,v1:172.21.15.102:6835/1688882523] up:boot 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: fsmap 3 up:standby 2024-09-21T03:31:06.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:31:08.453 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 systemd[1]: Starting Ceph mds.d for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:08.836 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 podman[74079]: 2024-09-21 03:31:08.581657034 +0000 UTC m=+0.113242598 container create 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T03:31:08.836 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 podman[74079]: 2024-09-21 03:31:08.484323968 +0000 UTC m=+0.015909536 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:08.836 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 podman[74079]: 2024-09-21 03:31:08.834779935 +0000 UTC m=+0.366365500 container init 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T03:31:09.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 podman[74079]: 2024-09-21 03:31:08.837675478 +0000 UTC m=+0.369261049 container start 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T03:31:09.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 ceph-mds[74098]: -- 172.21.15.102:0/2004143652 <== mon.0 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a5bca5860 con 0x557a5fe4d600 2024-09-21T03:31:09.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d[74094]: starting mds.d at 2024-09-21T03:31:09.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 bash[74079]: 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 2024-09-21T03:31:09.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:31:08 smithi102 systemd[1]: Started Ceph mds.d for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:09.490 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:09.518 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:09.519 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:09 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:09.530 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:09.530 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.530 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.530 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.531 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:09.531 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:09.531 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:09 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:09 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:09.747 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:10.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 -- 172.21.15.102:0/2303959516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b241094a0 msgr2=0x7f1b241098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/2303959516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b241094a0 0x7f1b241098b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c009900 tx=0x7f1b0c02a410 comp rx=0 tx=0).stop 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 -- 172.21.15.102:0/2303959516 shutdown_connections 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/2303959516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b241094a0 0x7f1b241098b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/2303959516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24109df0 0x7f1b24110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/2303959516 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b24103b60 0x7f1b24103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 -- 172.21.15.102:0/2303959516 >> 172.21.15.102:0/2303959516 conn(0x7f1b2407b850 msgr2=0x7f1b2407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 -- 172.21.15.102:0/2303959516 shutdown_connections 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.229+0000 7f1b2a78c640 1 -- 172.21.15.102:0/2303959516 wait complete. 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 Processor -- start 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 -- start start 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24103b60 0x7f1b24075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:10.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b241094a0 0x7f1b24075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24113bd0 con 0x7f1b24109df0 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24113a50 con 0x7f1b24103b60 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b2a78c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1b24113d50 con 0x7f1b241094a0 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:10.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b23fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24103b60 0x7f1b24075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52130/0 (socket says 172.21.15.102:52130) 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 -- 172.21.15.102:0/3973911573 learned_addr learned my addr 172.21.15.102:0/3973911573 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b1bfff640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b241094a0 0x7f1b24075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 -- 172.21.15.102:0/3973911573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b241094a0 msgr2=0x7f1b24075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b241094a0 0x7f1b24075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 -- 172.21.15.102:0/3973911573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24103b60 msgr2=0x7f1b24075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:10.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.230+0000 7f1b28d29640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24103b60 0x7f1b24075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b28d29640 1 -- 172.21.15.102:0/3973911573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b241a87d0 con 0x7f1b24109df0 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b28d29640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00cce0 tx=0x7f1b1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00f450 con 0x7f1b24109df0 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b241a8ac0 con 0x7f1b24109df0 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1b1c00fac0 con 0x7f1b24109df0 2024-09-21T03:31:10.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c018be0 con 0x7f1b24109df0 2024-09-21T03:31:10.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.231+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b241a8fd0 con 0x7f1b24109df0 2024-09-21T03:31:10.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.232+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b24104de0 con 0x7f1b24109df0 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.234+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f1b1c00fc70 con 0x7f1b24109df0 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.234+0000 7f1b21ffb640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 0x7f1b100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.234+0000 7f1b23fff640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 0x7f1b100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.235+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f1b1c0e7710 con 0x7f1b24109df0 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.235+0000 7f1b23fff640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 0x7f1b100b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1b24077160 tx=0x7f1b1400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:10.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.238+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b1c014030 con 0x7f1b24109df0 2024-09-21T03:31:10.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:10 smithi102 ceph-mon[31392]: Deploying daemon mds.e on smithi121 2024-09-21T03:31:10.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:10 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.102:6836/2970785732,v1:172.21.15.102:6837/2970785732] up:boot 2024-09-21T03:31:10.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:10 smithi102 ceph-mon[31392]: fsmap 4 up:standby 2024-09-21T03:31:10.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:10 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:31:10.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.455+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b24103f70 con 0x7f1b24109df0 2024-09-21T03:31:10.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.455+0000 7f1b21ffb640 1 -- 172.21.15.102:0/3973911573 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3919 (secure 0 0 0) 0x7f1b1c0ae400 con 0x7f1b24109df0 2024-09-21T03:31:10.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:10.457 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"btime":"2024-09-21T03:31:09:264782+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:31:10.458 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 5 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 msgr2=0x7f1b100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 0x7f1b100b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1b24077160 tx=0x7f1b1400b390 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 msgr2=0x7f1b24076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c00cce0 tx=0x7f1b1c00a620 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 shutdown_connections 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1b100b6560 0x7f1b100b8a70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1b24109df0 0x7f1b24076190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1b241094a0 0x7f1b24075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 --2- 172.21.15.102:0/3973911573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1b24103b60 0x7f1b24075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:10.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 >> 172.21.15.102:0/3973911573 conn(0x7f1b2407b850 msgr2=0x7f1b24107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:10.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 shutdown_connections 2024-09-21T03:31:10.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:10.458+0000 7f1b2a78c640 1 -- 172.21.15.102:0/3973911573 wait complete. 2024-09-21T03:31:10.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:10 smithi121 ceph-mon[34316]: Deploying daemon mds.e on smithi121 2024-09-21T03:31:10.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:10 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.102:6836/2970785732,v1:172.21.15.102:6837/2970785732] up:boot 2024-09-21T03:31:10.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:10 smithi121 ceph-mon[34316]: fsmap 4 up:standby 2024-09-21T03:31:10.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:10 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:31:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:10 smithi148 ceph-mon[34651]: Deploying daemon mds.e on smithi121 2024-09-21T03:31:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:10 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.102:6836/2970785732,v1:172.21.15.102:6837/2970785732] up:boot 2024-09-21T03:31:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:10 smithi148 ceph-mon[34651]: fsmap 4 up:standby 2024-09-21T03:31:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:10 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:31:11.036 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:10 smithi121 systemd[1]: Starting Ceph mds.e for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:11.371 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:11 smithi121 ceph-mon[34316]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:11.371 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:11 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3973911573' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:11.372 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 podman[63149]: 2024-09-21 03:31:10.993727733 +0000 UTC m=+0.016079514 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:11.372 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 podman[63149]: 2024-09-21 03:31:11.12884677 +0000 UTC m=+0.151198545 container create 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T03:31:11.372 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 podman[63149]: 2024-09-21 03:31:11.370708833 +0000 UTC m=+0.393060617 container init 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T03:31:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:11 smithi102 ceph-mon[31392]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:11 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3973911573' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:11 smithi148 ceph-mon[34651]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:11 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3973911573' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:11.786 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 podman[63149]: 2024-09-21 03:31:11.373596599 +0000 UTC m=+0.395948373 container start 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:31:11.786 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 ceph-mds[63168]: -- 172.21.15.121:0/2980775461 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a852679860 con 0x55a856821600 2024-09-21T03:31:11.786 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: starting mds.e at 2024-09-21T03:31:11.786 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 bash[63149]: 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 2024-09-21T03:31:11.786 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:31:11 smithi121 systemd[1]: Started Ceph mds.e for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: Deploying daemon mds.f on smithi148 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6834/2193609869,v1:172.21.15.121:6835/2193609869] up:boot 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: fsmap 5 up:standby 2024-09-21T03:31:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:12 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: Deploying daemon mds.f on smithi148 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6834/2193609869,v1:172.21.15.121:6835/2193609869] up:boot 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: fsmap 5 up:standby 2024-09-21T03:31:12.895 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:12 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: Deploying daemon mds.f on smithi148 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6834/2193609869,v1:172.21.15.121:6835/2193609869] up:boot 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: fsmap 5 up:standby 2024-09-21T03:31:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:12 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:31:13.268 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:13.494 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 systemd[1]: Starting Ceph mds.f for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:13.850 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 podman[63486]: 2024-09-21 03:31:13.464968246 +0000 UTC m=+0.015860129 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:13.875 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 podman[63486]: 2024-09-21 03:31:13.579655885 +0000 UTC m=+0.130547755 container create 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T03:31:13.875 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 podman[63486]: 2024-09-21 03:31:13.849212541 +0000 UTC m=+0.400104420 container init 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T03:31:14.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 -- 172.21.15.102:0/326288255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8109e20 msgr2=0x7f4ef8110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:14.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/326288255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8109e20 0x7f4ef8110650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0009ca0 tx=0x7f4ef002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 -- 172.21.15.102:0/326288255 shutdown_connections 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/326288255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8109e20 0x7f4ef8110650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/326288255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 0x7f4ef81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/326288255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8103b90 0x7f4ef8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 -- 172.21.15.102:0/326288255 >> 172.21.15.102:0/326288255 conn(0x7f4ef80ff5e0 msgr2=0x7f4ef8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 -- 172.21.15.102:0/326288255 shutdown_connections 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.017+0000 7f4efd3f2640 1 -- 172.21.15.102:0/326288255 wait complete. 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 Processor -- start 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 -- start start 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 0x7f4ef819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:14.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 0x7f4ef819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8113c00 con 0x7f4ef8103b90 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8113a80 con 0x7f4ef81094d0 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4efd3f2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8113d80 con 0x7f4ef8109e20 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4ef6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41130/0 (socket says 172.21.15.102:41130) 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4ef6ffd640 1 -- 172.21.15.102:0/1055868201 learned_addr learned my addr 172.21.15.102:0/1055868201 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4eeffff640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 0x7f4ef819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.018+0000 7f4ef77fe640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 0x7f4ef819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 -- 172.21.15.102:0/1055868201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 msgr2=0x7f4ef819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:14.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 0x7f4ef819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 -- 172.21.15.102:0/1055868201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 msgr2=0x7f4ef819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 0x7f4ef819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 -- 172.21.15.102:0/1055868201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef81a0480 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef77fe640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 0x7f4ef819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef6ffd640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c890 tx=0x7f4ee800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8004220 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef81a0770 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4ee80043c0 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80049e0 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.019+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef81a6ed0 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.020+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef8103fa0 con 0x7f4ef8103b90 2024-09-21T03:31:14.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.022+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f4ee8005140 con 0x7f4ef8103b90 2024-09-21T03:31:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.023+0000 7f4ef4ff9640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 0x7f4ee40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.023+0000 7f4eeffff640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 0x7f4ee40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.023+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f4ee80e6ff0 con 0x7f4ef8103b90 2024-09-21T03:31:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.023+0000 7f4eeffff640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 0x7f4ee40b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8102ce0 tx=0x7f4ee0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:14.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.026+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ee8014030 con 0x7f4ef8103b90 2024-09-21T03:31:14.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 podman[63486]: 2024-09-21 03:31:13.852077089 +0000 UTC m=+0.402968963 container start 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:31:14.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 ceph-mds[63505]: -- 172.21.15.148:0/2695639825 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fb20651c20 con 0x55fb247f9600 2024-09-21T03:31:14.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: starting mds.f at 2024-09-21T03:31:14.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 bash[63486]: 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 2024-09-21T03:31:14.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:31:13 smithi148 systemd[1]: Started Ceph mds.f for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:14.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.243+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ef802e640 con 0x7f4ef8103b90 2024-09-21T03:31:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.244+0000 7f4ef4ff9640 1 -- 172.21.15.102:0/1055868201 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5575 (secure 0 0 0) 0x7f4ee80b2030 con 0x7f4ef8103b90 2024-09-21T03:31:14.246 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:14.246 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":7,"btime":"2024-09-21T03:31:13:940754+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T03:31:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 7 2024-09-21T03:31:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 msgr2=0x7f4ee40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 0x7f4ee40b8a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8102ce0 tx=0x7f4ee0005f90 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 msgr2=0x7f4ef819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ee800c890 tx=0x7f4ee800cd50 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 shutdown_connections 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4ee40b6560 0x7f4ee40b8a70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4ef8109e20 0x7f4ef819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ef81094d0 0x7f4ef819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 --2- 172.21.15.102:0/1055868201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4ef8103b90 0x7f4ef819a510 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.246+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 >> 172.21.15.102:0/1055868201 conn(0x7f4ef80ff5e0 msgr2=0x7f4ef8107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.247+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 shutdown_connections 2024-09-21T03:31:14.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:14.247+0000 7f4efd3f2640 1 -- 172.21.15.102:0/1055868201 wait complete. 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6834/4203175374,v1:172.21.15.148:6835/4203175374] up:boot 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: fsmap 6 up:standby 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:14.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:14.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: Deploying daemon mds.c on smithi148 2024-09-21T03:31:14.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:14.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1055868201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6834/4203175374,v1:172.21.15.148:6835/4203175374] up:boot 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: fsmap 6 up:standby 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:15.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:15.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:15.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: Deploying daemon mds.c on smithi148 2024-09-21T03:31:15.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:15.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1055868201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6834/4203175374,v1:172.21.15.148:6835/4203175374] up:boot 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: fsmap 6 up:standby 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:15.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:15.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: Deploying daemon mds.c on smithi148 2024-09-21T03:31:15.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:15.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1055868201' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:15.994 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:15 smithi148 systemd[1]: Starting Ceph mds.c for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:16.365 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 podman[63752]: 2024-09-21 03:31:15.989089551 +0000 UTC m=+0.016201279 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:16.365 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 podman[63752]: 2024-09-21 03:31:16.101786251 +0000 UTC m=+0.128897980 container create 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T03:31:16.365 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 podman[63752]: 2024-09-21 03:31:16.363376728 +0000 UTC m=+0.390488457 container init 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T03:31:16.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 podman[63752]: 2024-09-21 03:31:16.366385174 +0000 UTC m=+0.393496904 container start 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:31:16.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 ceph-mds[63772]: -- 172.21.15.148:0/3054651438 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e996cd3860 con 0x55e99ae7b600 2024-09-21T03:31:16.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: starting mds.c at 2024-09-21T03:31:16.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 bash[63752]: 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 2024-09-21T03:31:16.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:31:16 smithi148 systemd[1]: Started Ceph mds.c for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:17.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:17.258 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:17.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:17.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.381 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.381 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:17.381 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:17.381 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:17 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:17.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:17 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:17.646 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:17 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:17.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 -- 172.21.15.102:0/3277988736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c41022a0 msgr2=0x7fc1c41026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:17.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 --2- 172.21.15.102:0/3277988736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c41022a0 0x7fc1c41026b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009900 tx=0x7fc1b402a410 comp rx=0 tx=0).stop 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 -- 172.21.15.102:0/3277988736 shutdown_connections 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 --2- 172.21.15.102:0/3277988736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4108530 0x7fc1c410ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 --2- 172.21.15.102:0/3277988736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c4107be0 0x7fc1c4107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 --2- 172.21.15.102:0/3277988736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c41022a0 0x7fc1c41026b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 -- 172.21.15.102:0/3277988736 >> 172.21.15.102:0/3277988736 conn(0x7fc1c4079ec0 msgr2=0x7fc1c407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.927+0000 7fc1ca599640 1 -- 172.21.15.102:0/3277988736 shutdown_connections 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.928+0000 7fc1ca599640 1 -- 172.21.15.102:0/3277988736 wait complete. 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.928+0000 7fc1ca599640 1 Processor -- start 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.928+0000 7fc1ca599640 1 -- start start 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 0x7fc1c419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4107be0 0x7fc1c419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:17.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111aa0 con 0x7fc1c4108530 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111920 con 0x7fc1c41022a0 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c4111c20 con 0x7fc1c4107be0 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 0x7fc1c419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41158/0 (socket says 172.21.15.102:41158) 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 -- 172.21.15.102:0/2040807557 learned_addr learned my addr 172.21.15.102:0/2040807557 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c37fe640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4107be0 0x7fc1c419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 -- 172.21.15.102:0/2040807557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4107be0 msgr2=0x7fc1c419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4107be0 0x7fc1c419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 -- 172.21.15.102:0/2040807557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 msgr2=0x7fc1c419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 0x7fc1c419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:17.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 -- 172.21.15.102:0/2040807557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c41a0590 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c3fff640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 0x7fc1c419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c8b36640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00eaa0 tx=0x7fc1bc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00cdb0 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc1bc005020 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c41a0880 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.929+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0116d0 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.930+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c41a6fe0 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.931+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c41026b0 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.932+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fc1bc0051d0 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.933+0000 7fc1c17fa640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 0x7fc1ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.933+0000 7fc1c3fff640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 0x7fc1ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.933+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc1bc0e7590 con 0x7fc1c4108530 2024-09-21T03:31:17.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.933+0000 7fc1c3fff640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 0x7fc1ac0b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009230 tx=0x7fc1b40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:17.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:17.936+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1bc016030 con 0x7fc1c4108530 2024-09-21T03:31:18.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.149+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1c419b750 con 0x7fc1c4108530 2024-09-21T03:31:18.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.150+0000 7fc1c17fa640 1 -- 172.21.15.102:0/2040807557 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6403 (secure 0 0 0) 0x7fc1c419b750 con 0x7fc1c4108530 2024-09-21T03:31:18.152 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:18.152 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":8,"btime":"2024-09-21T03:31:17:268685+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T03:31:18.153 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 8 2024-09-21T03:31:18.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 msgr2=0x7fc1ac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:18.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 0x7fc1ac0b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009230 tx=0x7fc1b40058d0 comp rx=0 tx=0).stop 2024-09-21T03:31:18.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 msgr2=0x7fc1c419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00eaa0 tx=0x7fc1bc00ef60 comp rx=0 tx=0).stop 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 shutdown_connections 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc1ac0b6560 0x7fc1ac0b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1c4108530 0x7fc1c419fe60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc1c4107be0 0x7fc1c419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 --2- 172.21.15.102:0/2040807557 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc1c41022a0 0x7fc1c419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 >> 172.21.15.102:0/2040807557 conn(0x7fc1c4079ec0 msgr2=0x7fc1c4105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 shutdown_connections 2024-09-21T03:31:18.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:18.152+0000 7fc1ca599640 1 -- 172.21.15.102:0/2040807557 wait complete. 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mon[34316]: Deploying daemon mds.h on smithi121 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:boot 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mon[34316]: fsmap 7 up:standby 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2040807557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:18.536 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 systemd[1]: Starting Ceph mds.h for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:18.661 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:18 smithi148 ceph-mon[34651]: Deploying daemon mds.h on smithi121 2024-09-21T03:31:18.662 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:18 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:boot 2024-09-21T03:31:18.662 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:18 smithi148 ceph-mon[34651]: fsmap 7 up:standby 2024-09-21T03:31:18.662 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:18 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:31:18.662 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:18 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2040807557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:18.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:18 smithi102 ceph-mon[31392]: Deploying daemon mds.h on smithi121 2024-09-21T03:31:18.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:18 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:boot 2024-09-21T03:31:18.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:18 smithi102 ceph-mon[31392]: fsmap 7 up:standby 2024-09-21T03:31:18.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:18 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:31:18.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:18 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2040807557' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:18.946 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 podman[63430]: 2024-09-21 03:31:18.596528169 +0000 UTC m=+0.015728427 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:18.946 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 podman[63430]: 2024-09-21 03:31:18.70628918 +0000 UTC m=+0.125489427 container create 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T03:31:18.946 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 podman[63430]: 2024-09-21 03:31:18.942275025 +0000 UTC m=+0.361475272 container init 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T03:31:18.947 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 podman[63430]: 2024-09-21 03:31:18.94514245 +0000 UTC m=+0.364342700 container start 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:31:19.284 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-mds[63449]: -- 172.21.15.121:0/1644028233 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561070bcf860 con 0x561074d77a80 2024-09-21T03:31:19.284 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: starting mds.h at 2024-09-21T03:31:19.284 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:19 smithi121 bash[63430]: 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c 2024-09-21T03:31:19.284 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:31:19 smithi121 systemd[1]: Started Ceph mds.h for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:19.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:19.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:19 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:19.637 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:19.637 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.637 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.637 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.638 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:19.638 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:19.638 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:19 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:19 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:20.581 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:20 smithi148 ceph-mon[34651]: Deploying daemon mds.i on smithi148 2024-09-21T03:31:20.581 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:20 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6836/3016052537,v1:172.21.15.121:6837/3016052537] up:boot 2024-09-21T03:31:20.581 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:20 smithi148 ceph-mon[34651]: fsmap 8 up:standby 2024-09-21T03:31:20.581 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:20 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:31:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:20 smithi102 ceph-mon[31392]: Deploying daemon mds.i on smithi148 2024-09-21T03:31:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:20 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6836/3016052537,v1:172.21.15.121:6837/3016052537] up:boot 2024-09-21T03:31:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:20 smithi102 ceph-mon[31392]: fsmap 8 up:standby 2024-09-21T03:31:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:20 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:31:20.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:20 smithi121 ceph-mon[34316]: Deploying daemon mds.i on smithi148 2024-09-21T03:31:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:20 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6836/3016052537,v1:172.21.15.121:6837/3016052537] up:boot 2024-09-21T03:31:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:20 smithi121 ceph-mon[34316]: fsmap 8 up:standby 2024-09-21T03:31:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:20 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:31:20.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:21.084 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:21.244 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 systemd[1]: Starting Ceph mds.i for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:21.470 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:21 smithi102 ceph-mon[31392]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:21.545 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:21 smithi148 ceph-mon[34651]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:21.545 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 podman[64031]: 2024-09-21 03:31:21.173624913 +0000 UTC m=+0.016260660 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:21.545 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 podman[64031]: 2024-09-21 03:31:21.290653345 +0000 UTC m=+0.133289089 container create 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T03:31:21.545 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 podman[64031]: 2024-09-21 03:31:21.544238497 +0000 UTC m=+0.386874252 container init 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:31:21.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 -- 172.21.15.102:0/1858991450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 msgr2=0x7f9ac8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 --2- 172.21.15.102:0/1858991450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac8102ef0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009900 tx=0x7f9ab802a410 comp rx=0 tx=0).stop 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 -- 172.21.15.102:0/1858991450 shutdown_connections 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 --2- 172.21.15.102:0/1858991450 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108d70 0x7f9ac810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 --2- 172.21.15.102:0/1858991450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108420 0x7f9ac8108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 --2- 172.21.15.102:0/1858991450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac8102ef0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 -- 172.21.15.102:0/1858991450 >> 172.21.15.102:0/1858991450 conn(0x7f9ac8079770 msgr2=0x7f9ac8079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 -- 172.21.15.102:0/1858991450 shutdown_connections 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.558+0000 7f9ace452640 1 -- 172.21.15.102:0/1858991450 wait complete. 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 Processor -- start 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 -- start start 2024-09-21T03:31:21.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108420 0x7f9ac819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108d70 0x7f9ac819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8112bd0 con 0x7f9ac8102ae0 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8112a50 con 0x7f9ac8108d70 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ace452640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac8112d50 con 0x7f9ac8108420 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:41168/0 (socket says 172.21.15.102:41168) 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 -- 172.21.15.102:0/2150554711 learned_addr learned my addr 172.21.15.102:0/2150554711 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108420 0x7f9ac819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9acc9ef640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108d70 0x7f9ac819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 -- 172.21.15.102:0/2150554711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108420 msgr2=0x7f9ac819ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108420 0x7f9ac819ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 -- 172.21.15.102:0/2150554711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108d70 msgr2=0x7f9ac819fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108d70 0x7f9ac819fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.559+0000 7f9ac7fff640 1 -- 172.21.15.102:0/2150554711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac81a0600 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ac7fff640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005ab0 tx=0x7f9ab80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab803f030 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ab8003cd0 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac81a0890 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8035070 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.560+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac81a7050 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.561+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac8103d60 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.562+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f9ab8042030 con 0x7f9ac8102ae0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.563+0000 7f9ac57fa640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 0x7f9ab00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.563+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 0x7f9ab00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:21.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.563+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f9ab81077b0 con 0x7f9ac8102ae0 2024-09-21T03:31:21.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.563+0000 7f9ac77fe640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 0x7f9ab00b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ac806cbe0 tx=0x7f9abc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:21.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.566+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ab80ce410 con 0x7f9ac8102ae0 2024-09-21T03:31:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:21 smithi121 ceph-mon[34316]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:21.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.785+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ac8102ef0 con 0x7f9ac8102ae0 2024-09-21T03:31:21.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.786+0000 7f9ac57fa640 1 -- 172.21.15.102:0/2150554711 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7231 (secure 0 0 0) 0x7f9ac8102ef0 con 0x7f9ac8102ae0 2024-09-21T03:31:21.788 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:21.788 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":9,"btime":"2024-09-21T03:31:19:281580+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T03:31:21.789 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 9 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 msgr2=0x7f9ab00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 0x7f9ab00b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ac806cbe0 tx=0x7f9abc008040 comp rx=0 tx=0).stop 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 msgr2=0x7f9ac819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8005ab0 tx=0x7f9ab80042f0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 shutdown_connections 2024-09-21T03:31:21.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab00b6560 0x7f9ab00b8a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ac8108d70 0x7f9ac819fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ac8108420 0x7f9ac819ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 --2- 172.21.15.102:0/2150554711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ac8102ae0 0x7f9ac819a690 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 >> 172.21.15.102:0/2150554711 conn(0x7f9ac8079770 msgr2=0x7f9ac8101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 shutdown_connections 2024-09-21T03:31:21.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:21.789+0000 7f9ace452640 1 -- 172.21.15.102:0/2150554711 wait complete. 2024-09-21T03:31:21.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 podman[64031]: 2024-09-21 03:31:21.547118791 +0000 UTC m=+0.389754540 container start 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:31:21.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 ceph-mds[64051]: -- 172.21.15.148:0/944042322 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d98923f860 con 0x55d98d3e7180 2024-09-21T03:31:21.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: starting mds.i at 2024-09-21T03:31:21.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 bash[64031]: 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 2024-09-21T03:31:21.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:21 smithi148 systemd[1]: Started Ceph mds.i for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: Deploying daemon mds.g on smithi102 2024-09-21T03:31:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2150554711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:22.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:22.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:boot 2024-09-21T03:31:22.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: fsmap 9 up:standby 2024-09-21T03:31:22.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:22 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: Deploying daemon mds.g on smithi102 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2150554711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:22.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:boot 2024-09-21T03:31:22.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: fsmap 9 up:standby 2024-09-21T03:31:22.995 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:22 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: Deploying daemon mds.g on smithi102 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2150554711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:23.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:boot 2024-09-21T03:31:23.037 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: fsmap 9 up:standby 2024-09-21T03:31:23.037 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:22 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:31:24.203 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 systemd[1]: Starting Ceph mds.g for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:24.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:24.523 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 podman[74821]: 2024-09-21 03:31:24.167977662 +0000 UTC m=+0.015779603 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:24.523 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 podman[74821]: 2024-09-21 03:31:24.267873642 +0000 UTC m=+0.115675563 container create d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T03:31:24.732 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:24.852 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 podman[74821]: 2024-09-21 03:31:24.521757537 +0000 UTC m=+0.369559460 container init d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:31:24.853 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 podman[74821]: 2024-09-21 03:31:24.52647609 +0000 UTC m=+0.374278015 container start d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T03:31:24.853 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 ceph-mds[74858]: -- 172.21.15.102:0/3755841516 <== mon.0 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56220a35f860 con 0x56220e507600 2024-09-21T03:31:24.853 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g[74836]: starting mds.g at 2024-09-21T03:31:24.853 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 bash[74821]: d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 2024-09-21T03:31:24.853 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:31:24 smithi102 systemd[1]: Started Ceph mds.g for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 -- 172.21.15.102:0/3523415641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c102a60 msgr2=0x7f064c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 --2- 172.21.15.102:0/3523415641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c102a60 0x7f064c102e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0640009900 tx=0x7f064002a410 comp rx=0 tx=0).stop 2024-09-21T03:31:25.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 -- 172.21.15.102:0/3523415641 shutdown_connections 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 --2- 172.21.15.102:0/3523415641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 --2- 172.21.15.102:0/3523415641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c1083a0 0x7f064c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 --2- 172.21.15.102:0/3523415641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c102a60 0x7f064c102e70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 -- 172.21.15.102:0/3523415641 >> 172.21.15.102:0/3523415641 conn(0x7f064c079730 msgr2=0x7f064c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 -- 172.21.15.102:0/3523415641 shutdown_connections 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.232+0000 7f06511e9640 1 -- 172.21.15.102:0/3523415641 wait complete. 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.233+0000 7f06511e9640 1 Processor -- start 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.233+0000 7f06511e9640 1 -- start start 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c102a60 0x7f064c19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f064c112b00 con 0x7f064c1083a0 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f064c112980 con 0x7f064c102a60 2024-09-21T03:31:25.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f06511e9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f064c112c80 con 0x7f064c108cf0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50210/0 (socket says 172.21.15.102:50210) 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 -- 172.21.15.102:0/3387785733 learned_addr learned my addr 172.21.15.102:0/3387785733 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064ad9d640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c102a60 0x7f064c19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064b59e640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 -- 172.21.15.102:0/3387785733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 msgr2=0x7f064c19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 -- 172.21.15.102:0/3387785733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c102a60 msgr2=0x7f064c19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c102a60 0x7f064c19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 -- 172.21.15.102:0/3387785733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c1a0430 con 0x7f064c1083a0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064b59e640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.234+0000 7f064a59c640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c970 tx=0x7f063c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.235+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c014070 con 0x7f064c1083a0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.235+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c1a0720 con 0x7f064c1083a0 2024-09-21T03:31:25.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.235+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f063c004440 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.235+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c003e40 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.235+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c1a6f40 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.236+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c102e70 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.237+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f063c017070 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.238+0000 7f0633fff640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 0x7f06340b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.238+0000 7f064ad9d640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 0x7f06340b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.238+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f063c0e72a0 con 0x7f064c1083a0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.238+0000 7f064ad9d640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 0x7f06340b8aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0640009230 tx=0x7f06400058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:25.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.241+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f063c01e030 con 0x7f064c1083a0 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:25.434 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:25 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:25.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.467+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f064c19b6b0 con 0x7f064c1083a0 2024-09-21T03:31:25.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.468+0000 7f0633fff640 1 -- 172.21.15.102:0/3387785733 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8890 (secure 0 0 0) 0x7f064c19b6b0 con 0x7f064c1083a0 2024-09-21T03:31:25.470 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:25.470 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":11,"btime":"2024-09-21T03:31:25:266190+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24661,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:31:25.470 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 11 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 msgr2=0x7f06340b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 0x7f06340b8aa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0640009230 tx=0x7f06400058d0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 msgr2=0x7f064c19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f063c00c970 tx=0x7f063c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 shutdown_connections 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06340b6590 0x7f06340b8aa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f064c1083a0 0x7f064c19ab20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f064c108cf0 0x7f064c19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 --2- 172.21.15.102:0/3387785733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f064c102a60 0x7f064c19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:25.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 >> 172.21.15.102:0/3387785733 conn(0x7f064c079730 msgr2=0x7f064c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:25.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 shutdown_connections 2024-09-21T03:31:25.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:25.470+0000 7f06511e9640 1 -- 172.21.15.102:0/3387785733 wait complete. 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:25.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:25 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:25 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:26.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:26 smithi121 ceph-mon[34316]: Deploying daemon mds.a on smithi102 2024-09-21T03:31:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:26 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.102:6838/3219085509,v1:172.21.15.102:6839/3219085509] up:boot 2024-09-21T03:31:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:26 smithi121 ceph-mon[34316]: fsmap 10 up:standby 2024-09-21T03:31:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:26 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:31:26.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:26 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3387785733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:26.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:26 smithi102 ceph-mon[31392]: Deploying daemon mds.a on smithi102 2024-09-21T03:31:26.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:26 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.102:6838/3219085509,v1:172.21.15.102:6839/3219085509] up:boot 2024-09-21T03:31:26.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:26 smithi102 ceph-mon[31392]: fsmap 10 up:standby 2024-09-21T03:31:26.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:26 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:31:26.613 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:26 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3387785733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:26 smithi148 ceph-mon[34651]: Deploying daemon mds.a on smithi102 2024-09-21T03:31:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:26 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.102:6838/3219085509,v1:172.21.15.102:6839/3219085509] up:boot 2024-09-21T03:31:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:26 smithi148 ceph-mon[34651]: fsmap 10 up:standby 2024-09-21T03:31:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:26 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:31:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:26 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3387785733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:27.534 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:27 smithi102 ceph-mon[31392]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:27.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:27 smithi121 ceph-mon[34316]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:27.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:27 smithi148 ceph-mon[34651]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:28.174 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:31:28 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a[75215]: starting mds.a at 2024-09-21T03:31:28.174 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:31:28 smithi102 bash[75200]: f717343ee920feaf41c67396bc9eb4a01a2abbae40706dab12d9fc9b8589fb11 2024-09-21T03:31:28.453 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:31:28 smithi102 systemd[1]: Started Ceph mds.a for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:28.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:28.894 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:29.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:29.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: Deploying daemon mds.b on smithi121 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.102:6840/4025152844,v1:172.21.15.102:6841/4025152844] up:boot 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: fsmap 11 up:standby 2024-09-21T03:31:29.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:29 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: Deploying daemon mds.b on smithi121 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.102:6840/4025152844,v1:172.21.15.102:6841/4025152844] up:boot 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: fsmap 11 up:standby 2024-09-21T03:31:29.327 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:29 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 -- 172.21.15.102:0/1628671505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec102ae0 msgr2=0x7fc9ec102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 --2- 172.21.15.102:0/1628671505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec102ef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009900 tx=0x7fc9e802a410 comp rx=0 tx=0).stop 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 -- 172.21.15.102:0/1628671505 shutdown_connections 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 --2- 172.21.15.102:0/1628671505 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108d70 0x7fc9ec10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 --2- 172.21.15.102:0/1628671505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec108420 0x7fc9ec108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 --2- 172.21.15.102:0/1628671505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec102ef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 -- 172.21.15.102:0/1628671505 >> 172.21.15.102:0/1628671505 conn(0x7fc9ec079770 msgr2=0x7fc9ec079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 -- 172.21.15.102:0/1628671505 shutdown_connections 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.414+0000 7fc9f3435640 1 -- 172.21.15.102:0/1628671505 wait complete. 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 Processor -- start 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 -- start start 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec19a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:29.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108420 0x7fc9ec19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112bb0 con 0x7fc9ec108d70 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112a30 con 0x7fc9ec102ae0 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f3435640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec112d30 con 0x7fc9ec108420 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f11d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec19a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50234/0 (socket says 172.21.15.102:50234) 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f11d1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec19a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:48548/0 (socket says 172.21.15.102:48548) 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 -- 172.21.15.102:0/3665583139 learned_addr learned my addr 172.21.15.102:0/3665583139 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f09d0640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108420 0x7fc9ec19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 -- 172.21.15.102:0/3665583139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108420 msgr2=0x7fc9ec19ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:29.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108420 0x7fc9ec19ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 -- 172.21.15.102:0/3665583139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 msgr2=0x7fc9ec19a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec19a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.415+0000 7fc9f19d2640 1 -- 172.21.15.102:0/3665583139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec1a0560 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9f19d2640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400cce0 tx=0x7fc9e400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400f450 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1a0850 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc9e400fac0 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4018be0 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.416+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a7070 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.417+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec102ef0 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.420+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fc9e400fc70 con 0x7fc9ec108d70 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.420+0000 7fc9e27fc640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 0x7fc9d80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:29.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.420+0000 7fc9f11d1640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 0x7fc9d80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:29.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.420+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fc9e40e76d0 con 0x7fc9ec108d70 2024-09-21T03:31:29.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.421+0000 7fc9f11d1640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 0x7fc9d80b8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009230 tx=0x7fc9e80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:29.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.423+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9e4014030 con 0x7fc9ec108d70 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: Deploying daemon mds.b on smithi121 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.102:6840/4025152844,v1:172.21.15.102:6841/4025152844] up:boot 2024-09-21T03:31:29.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: fsmap 11 up:standby 2024-09-21T03:31:29.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:29 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:31:29.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.637+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9ec19b7e0 con 0x7fc9ec108d70 2024-09-21T03:31:29.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.637+0000 7fc9e27fc640 1 -- 172.21.15.102:0/3665583139 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9719 (secure 0 0 0) 0x7fc9e40ae3c0 con 0x7fc9ec108d70 2024-09-21T03:31:29.640 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:29.640 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":12,"btime":"2024-09-21T03:31:28:283092+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24661,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:31:29.640 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 12 2024-09-21T03:31:29.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 msgr2=0x7fc9d80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:29.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 0x7fc9d80b8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009230 tx=0x7fc9e80058d0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 msgr2=0x7fc9ec19fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:29.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc9e400cce0 tx=0x7fc9e400a620 comp rx=0 tx=0).stop 2024-09-21T03:31:29.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 shutdown_connections 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc9d80b6590 0x7fc9d80b8aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9ec108d70 0x7fc9ec19fef0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc9ec108420 0x7fc9ec19ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 --2- 172.21.15.102:0/3665583139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc9ec102ae0 0x7fc9ec19a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 >> 172.21.15.102:0/3665583139 conn(0x7fc9ec079770 msgr2=0x7fc9ec101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 shutdown_connections 2024-09-21T03:31:29.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:29.640+0000 7fc9f3435640 1 -- 172.21.15.102:0/3665583139 wait complete. 2024-09-21T03:31:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:30 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3665583139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:30.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:30 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3665583139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:30.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:30 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3665583139' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:30.536 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 systemd[1]: Starting Ceph mds.b for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:31:30.831 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 podman[63696]: 2024-09-21 03:31:30.456071269 +0000 UTC m=+0.015405062 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:31:30.831 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 podman[63696]: 2024-09-21 03:31:30.58602399 +0000 UTC m=+0.145357770 container create 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T03:31:30.831 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 podman[63696]: 2024-09-21 03:31:30.829998433 +0000 UTC m=+0.389332219 container init 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T03:31:31.246 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 podman[63696]: 2024-09-21 03:31:30.832877747 +0000 UTC m=+0.392211533 container start 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:31:31.246 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 ceph-mds[63714]: -- 172.21.15.121:0/3913722916 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d6bebef860 con 0x55d6c2d97a80 2024-09-21T03:31:31.246 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: starting mds.b at 2024-09-21T03:31:31.246 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 bash[63696]: 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c 2024-09-21T03:31:31.246 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:31:30 smithi121 systemd[1]: Started Ceph mds.b for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:31:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:31.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:31 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.627 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:31 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:31.629 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:31 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:32.358 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:31:32.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:32 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:boot 2024-09-21T03:31:32.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:32 smithi121 ceph-mon[34316]: fsmap 12 up:standby 2024-09-21T03:31:32.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:32 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:31:32.632 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:32.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:32 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:boot 2024-09-21T03:31:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:32 smithi102 ceph-mon[31392]: fsmap 12 up:standby 2024-09-21T03:31:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:32 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:31:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:32 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:boot 2024-09-21T03:31:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:32 smithi148 ceph-mon[34651]: fsmap 12 up:standby 2024-09-21T03:31:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:32 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:31:33.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.140+0000 7fbc65e43640 1 -- 172.21.15.102:0/1871478837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 msgr2=0x7fbc601105a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:33.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.140+0000 7fbc65e43640 1 --2- 172.21.15.102:0/1871478837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc601105a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009cd0 tx=0x7fbc5802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 -- 172.21.15.102:0/1871478837 shutdown_connections 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 --2- 172.21.15.102:0/1871478837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc601105a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 --2- 172.21.15.102:0/1871478837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 0x7fbc60102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 --2- 172.21.15.102:0/1871478837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc60108b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 -- 172.21.15.102:0/1871478837 >> 172.21.15.102:0/1871478837 conn(0x7fbc60077cc0 msgr2=0x7fbc60078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 -- 172.21.15.102:0/1871478837 shutdown_connections 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 -- 172.21.15.102:0/1871478837 wait complete. 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 Processor -- start 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.141+0000 7fbc65e43640 1 -- start start 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 0x7fbc6019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:33.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc601a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60103fe0 con 0x7fbc60102770 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60103e60 con 0x7fbc60108730 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60104160 con 0x7fbc60101e20 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50252/0 (socket says 172.21.15.102:50252) 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 -- 172.21.15.102:0/646204738 learned_addr learned my addr 172.21.15.102:0/646204738 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5ffff640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc601a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5f7fe640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 0x7fbc6019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 -- 172.21.15.102:0/646204738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 msgr2=0x7fbc6019c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 0x7fbc6019c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 -- 172.21.15.102:0/646204738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 msgr2=0x7fbc601a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc601a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 -- 172.21.15.102:0/646204738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601a2730 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5ffff640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc601a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5effd640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b450 tx=0x7fbc5400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc54015020 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.142+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601a2a20 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.143+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbc54011d60 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.143+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5400f340 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.143+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc601a9180 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.144+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60102230 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.145+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fbc54018020 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.146+0000 7fbc5cff9640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 0x7fbc480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.146+0000 7fbc5f7fe640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 0x7fbc480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.146+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7fbc540e68e0 con 0x7fbc60102770 2024-09-21T03:31:33.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.147+0000 7fbc5f7fe640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 0x7fbc480b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009bd0 tx=0x7fbc50005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:33.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.151+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbc5401f020 con 0x7fbc60102770 2024-09-21T03:31:33.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.386+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc601a94e0 con 0x7fbc60102770 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.388 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.389 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.389 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:33.389 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:33.389 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.389 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:33 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:33.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.386+0000 7fbc5cff9640 1 -- 172.21.15.102:0/646204738 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10545 (secure 0 0 0) 0x7fbc5400d040 con 0x7fbc60102770 2024-09-21T03:31:33.389 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:33.390 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":13,"btime":"2024-09-21T03:31:31:235467+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24611,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24628,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24632,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24661,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:31:33.390 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 13 2024-09-21T03:31:33.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 msgr2=0x7fbc480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:33.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 0x7fbc480b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009bd0 tx=0x7fbc50005f90 comp rx=0 tx=0).stop 2024-09-21T03:31:33.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 msgr2=0x7fbc6019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:33.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b450 tx=0x7fbc5400b910 comp rx=0 tx=0).stop 2024-09-21T03:31:33.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 shutdown_connections 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbc480b6560 0x7fbc480b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbc60102770 0x7fbc6019cd60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbc60108730 0x7fbc601a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 --2- 172.21.15.102:0/646204738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbc60101e20 0x7fbc6019c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 >> 172.21.15.102:0/646204738 conn(0x7fbc60077cc0 msgr2=0x7fbc60105a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 shutdown_connections 2024-09-21T03:31:33.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:33.389+0000 7fbc65e43640 1 -- 172.21.15.102:0/646204738 wait complete. 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:33 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:33.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:33.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:33.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:33 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:31:34.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:34 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/646204738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:34.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:34 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:34 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:34 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:34 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.554 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:34 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/646204738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:34.554 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:34 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.554 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:34 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.554 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:34 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.554 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:34 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T03:31:34.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:34 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/646204738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:31:34.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:34 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:34 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:34 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:34 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:34.851 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 -- 172.21.15.102:0/3487977017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 msgr2=0x7f80b810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 --2- 172.21.15.102:0/3487977017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b810f540 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009900 tx=0x7f80b002a410 comp rx=0 tx=0).stop 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 -- 172.21.15.102:0/3487977017 shutdown_connections 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 --2- 172.21.15.102:0/3487977017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b810f540 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 --2- 172.21.15.102:0/3487977017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 0x7f80b81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 --2- 172.21.15.102:0/3487977017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 -- 172.21.15.102:0/3487977017 >> 172.21.15.102:0/3487977017 conn(0x7f80b8079740 msgr2=0x7f80b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 -- 172.21.15.102:0/3487977017 shutdown_connections 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.336+0000 7f80c058b640 1 -- 172.21.15.102:0/3487977017 wait complete. 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.337+0000 7f80c058b640 1 Processor -- start 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.337+0000 7f80c058b640 1 -- start start 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.337+0000 7f80c058b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.337+0000 7f80c058b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 0x7f80b819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.337+0000 7f80c058b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80c058b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112aa0 con 0x7f80b8108d10 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80c058b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112920 con 0x7f80b81083c0 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80c058b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f80b8112c20 con 0x7f80b8102a80 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51424/0 (socket says 172.21.15.102:51424) 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 -- 172.21.15.102:0/1539175836 learned_addr learned my addr 172.21.15.102:0/1539175836 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:35.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80bdb26640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 0x7f80b819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80be327640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 -- 172.21.15.102:0/1539175836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 msgr2=0x7f80b819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 -- 172.21.15.102:0/1539175836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 msgr2=0x7f80b819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 0x7f80b819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 -- 172.21.15.102:0/1539175836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80b81a0410 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80be327640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80beb28640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80b0005ab0 tx=0x7f80b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b003f030 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80b0003cd0 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b0035070 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80b81a06a0 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.338+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80b81a0bd0 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.339+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80b8103d00 con 0x7f80b8108d10 2024-09-21T03:31:35.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.341+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f80b0042030 con 0x7f80b8108d10 2024-09-21T03:31:35.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.342+0000 7f80b77fe640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 0x7f80a00b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:35.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.342+0000 7f80be327640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 0x7f80a00b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:35.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.342+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f80b0107650 con 0x7f80b8108d10 2024-09-21T03:31:35.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.342+0000 7f80be327640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 0x7f80a00b8b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007e70 tx=0x7f80a8007850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:35.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.345+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80b81a0bd0 con 0x7f80b8108d10 2024-09-21T03:31:35.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:35 smithi121 ceph-mon[34316]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:35.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:35 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:35.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.540+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f80b8102e90 con 0x7f80b8108d10 2024-09-21T03:31:35.542 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:35 smithi102 ceph-mon[31392]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:35.542 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:35 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.540+0000 7f80b77fe640 1 -- 172.21.15.102:0/1539175836 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7f80b8102e90 con 0x7f80b8108d10 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout:[ 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout: "poolnum": 1, 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout: "poolname": ".mgr" 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:31:35.543 INFO:teuthology.orchestra.run.smithi102.stdout:] 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 msgr2=0x7f80a00b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 0x7f80a00b8b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007e70 tx=0x7f80a8007850 comp rx=0 tx=0).stop 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 msgr2=0x7f80b819fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f80b0005ab0 tx=0x7f80b00042f0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 shutdown_connections 2024-09-21T03:31:35.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80a00b6610 0x7f80a00b8b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80b8108d10 0x7f80b819fda0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80b81083c0 0x7f80b819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 --2- 172.21.15.102:0/1539175836 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80b8102a80 0x7f80b819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 >> 172.21.15.102:0/1539175836 conn(0x7f80b8079740 msgr2=0x7f80b806be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 shutdown_connections 2024-09-21T03:31:35.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:35.543+0000 7f80c058b640 1 -- 172.21.15.102:0/1539175836 wait complete. 2024-09-21T03:31:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:35 smithi148 ceph-mon[34651]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:35 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.248 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:31:36.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:31:36.511 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:36.631 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1539175836' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:31:36.632 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:36 smithi102 ceph-mon[31392]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1539175836' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:31:36.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:36 smithi148 ceph-mon[34651]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:31:36.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:31:36.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:31:36.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1539175836' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T03:31:36.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:36 smithi121 ceph-mon[34316]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:37.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 -- 172.21.15.102:0/3474888131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 msgr2=0x7f70dc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 --2- 172.21.15.102:0/3474888131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc102e90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f70cc009900 tx=0x7f70cc02a410 comp rx=0 tx=0).stop 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 -- 172.21.15.102:0/3474888131 shutdown_connections 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 --2- 172.21.15.102:0/3474888131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc108d10 0x7f70dc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 --2- 172.21.15.102:0/3474888131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc1083c0 0x7f70dc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 --2- 172.21.15.102:0/3474888131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc102e90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 -- 172.21.15.102:0/3474888131 >> 172.21.15.102:0/3474888131 conn(0x7f70dc079740 msgr2=0x7f70dc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 -- 172.21.15.102:0/3474888131 shutdown_connections 2024-09-21T03:31:37.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.011+0000 7f70e3035640 1 -- 172.21.15.102:0/3474888131 wait complete. 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 Processor -- start 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 -- start start 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 0x7f70dc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc108d10 0x7f70dc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc113bc0 con 0x7f70dc102a80 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc113a40 con 0x7f70dc1083c0 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e3035640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f70dc113d40 con 0x7f70dc108d10 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e0dd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e0dd1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51440/0 (socket says 172.21.15.102:51440) 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.012+0000 7f70e0dd1640 1 -- 172.21.15.102:0/2166309290 learned_addr learned my addr 172.21.15.102:0/2166309290 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70dbfff640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 0x7f70dc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e15d2640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc108d10 0x7f70dc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:37.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 -- 172.21.15.102:0/2166309290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc108d10 msgr2=0x7f70dc19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc108d10 0x7f70dc19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 -- 172.21.15.102:0/2166309290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 msgr2=0x7f70dc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 0x7f70dc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 -- 172.21.15.102:0/2166309290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70dc1a0520 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70dbfff640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 0x7f70dc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e0dd1640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005ab0 tx=0x7f70cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc03f030 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70dc1a07b0 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f70cc003cd0 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70cc035070 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.013+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70dc1a6f70 con 0x7f70dc102a80 2024-09-21T03:31:37.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.015+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70dc103d00 con 0x7f70dc102a80 2024-09-21T03:31:37.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.016+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f70cc042030 con 0x7f70dc102a80 2024-09-21T03:31:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.017+0000 7f70d9ffb640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 0x7f70c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.017+0000 7f70dbfff640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 0x7f70c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:37.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.017+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7342+0+0 (secure 0 0 0) 0x7f70cc1078a0 con 0x7f70dc102a80 2024-09-21T03:31:37.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.018+0000 7f70dbfff640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 0x7f70c80b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70c40058c0 tx=0x7f70c4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:37.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.021+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70cc0ce460 con 0x7f70dc102a80 2024-09-21T03:31:37.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.198+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f70dc102e90 con 0x7f70dc102a80 2024-09-21T03:31:37.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:37 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:31:37.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.455+0000 7f70d9ffb640 1 -- 172.21.15.102:0/2166309290 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7f70cc0d2840 con 0x7f70dc102a80 2024-09-21T03:31:37.457 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' created 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.457+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 msgr2=0x7f70c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.457+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 0x7f70c80b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f70c40058c0 tx=0x7f70c4005850 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.457+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 msgr2=0x7f70dc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.457+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70cc005ab0 tx=0x7f70cc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 shutdown_connections 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f70c80b6560 0x7f70c80b8a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f70dc108d10 0x7f70dc19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70dc1083c0 0x7f70dc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 --2- 172.21.15.102:0/2166309290 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f70dc102a80 0x7f70dc19a5b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 >> 172.21.15.102:0/2166309290 conn(0x7f70dc079740 msgr2=0x7f70dc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 shutdown_connections 2024-09-21T03:31:37.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:37.458+0000 7f70e3035640 1 -- 172.21.15.102:0/2166309290 wait complete. 2024-09-21T03:31:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:37 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:31:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:37 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T03:31:38.136 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T03:31:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:38.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:31:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:38 smithi148 ceph-mon[34651]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:31:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:38 smithi148 ceph-mon[34651]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:38.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:31:38.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:38 smithi102 ceph-mon[31392]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:31:38.762 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:38 smithi102 ceph-mon[31392]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2166309290' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T03:31:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:38 smithi121 ceph-mon[34316]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T03:31:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:38 smithi121 ceph-mon[34316]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 -- 172.21.15.102:0/3298272017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848102ae0 msgr2=0x7f5848102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 --2- 172.21.15.102:0/3298272017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848102ae0 0x7f5848102ef0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5838009900 tx=0x7f583802a410 comp rx=0 tx=0).stop 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 -- 172.21.15.102:0/3298272017 shutdown_connections 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 --2- 172.21.15.102:0/3298272017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848108d70 0x7f584810f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 --2- 172.21.15.102:0/3298272017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 0x7f5848108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 --2- 172.21.15.102:0/3298272017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848102ae0 0x7f5848102ef0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:38.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 -- 172.21.15.102:0/3298272017 >> 172.21.15.102:0/3298272017 conn(0x7f5848079770 msgr2=0x7f5848079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 -- 172.21.15.102:0/3298272017 shutdown_connections 2024-09-21T03:31:38.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.856+0000 7f58507bb640 1 -- 172.21.15.102:0/3298272017 wait complete. 2024-09-21T03:31:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 Processor -- start 2024-09-21T03:31:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 -- start start 2024-09-21T03:31:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848102ae0 0x7f584819b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 0x7f584819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:38.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5848112bd0 con 0x7f5848108d70 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5848112a50 con 0x7f5848102ae0 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f58507bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5848112d50 con 0x7f5848108420 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51458/0 (socket says 172.21.15.102:51458) 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 -- 172.21.15.102:0/443836418 learned_addr learned my addr 172.21.15.102:0/443836418 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584dd56640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 0x7f584819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584e557640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848102ae0 0x7f584819b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 -- 172.21.15.102:0/443836418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 msgr2=0x7f584819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 0x7f584819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 -- 172.21.15.102:0/443836418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848102ae0 msgr2=0x7f584819b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848102ae0 0x7f584819b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:38.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.857+0000 7f584ed58640 1 -- 172.21.15.102:0/443836418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58481a6770 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f584ed58640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584000b970 tx=0x7f584000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5840019070 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5840014440 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58481a6a60 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58400075d0 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.858+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58481a6fa0 con 0x7f5848108d70 2024-09-21T03:31:38.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.859+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5848103d60 con 0x7f5848108d70 2024-09-21T03:31:38.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.861+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f584001c070 con 0x7f5848108d70 2024-09-21T03:31:38.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.861+0000 7f58477fe640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 0x7f58300b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:38.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.862+0000 7f584e557640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 0x7f58300b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:38.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.862+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7712+0+0 (secure 0 0 0) 0x7f58400e69d0 con 0x7f5848108d70 2024-09-21T03:31:38.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.862+0000 7f584e557640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 0x7f58300b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f5838005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:38.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:38.865+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58400ad4c0 con 0x7f5848108d70 2024-09-21T03:31:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.043+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5848102ef0 con 0x7f5848108d70 2024-09-21T03:31:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.461+0000 7f58477fe640 1 -- 172.21.15.102:0/443836418 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) ==== 170+0+0 (secure 0 0 0) 0x7f5848102ef0 con 0x7f5848108d70 2024-09-21T03:31:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' created 2024-09-21T03:31:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 msgr2=0x7f58300b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 0x7f58300b8af0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5838000c00 tx=0x7f5838005d50 comp rx=0 tx=0).stop 2024-09-21T03:31:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 msgr2=0x7f584819bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f584000b970 tx=0x7f584000bd70 comp rx=0 tx=0).stop 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 shutdown_connections 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58300b65e0 0x7f58300b8af0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5848108d70 0x7f584819bfc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5848108420 0x7f584819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 --2- 172.21.15.102:0/443836418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5848102ae0 0x7f584819b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 >> 172.21.15.102:0/443836418 conn(0x7f5848079770 msgr2=0x7f5848106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 shutdown_connections 2024-09-21T03:31:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:39.464+0000 7f58507bb640 1 -- 172.21.15.102:0/443836418 wait complete. 2024-09-21T03:31:39.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:39 smithi148 ceph-mon[34651]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:31:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:31:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:31:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:39 smithi148 ceph-mon[34651]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:31:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:39 smithi121 ceph-mon[34316]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:31:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:31:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:31:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:39 smithi121 ceph-mon[34316]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:31:39.798 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:39 smithi102 ceph-mon[31392]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T03:31:39.799 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T03:31:39.799 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/443836418' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T03:31:39.799 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:39 smithi102 ceph-mon[31392]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T03:31:40.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T03:31:40.378 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:40 smithi148 ceph-mon[34651]: pgmap v261: 97 pgs: 7 creating+peering, 82 unknown, 8 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:40 smithi148 ceph-mon[34651]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:31:40.781 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:40 smithi102 ceph-mon[31392]: pgmap v261: 97 pgs: 7 creating+peering, 82 unknown, 8 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:40.781 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:40 smithi102 ceph-mon[31392]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:31:40.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:40 smithi121 ceph-mon[34316]: pgmap v261: 97 pgs: 7 creating+peering, 82 unknown, 8 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:40.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:40 smithi121 ceph-mon[34316]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T03:31:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 -- 172.21.15.102:0/1765054883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c1083a0 msgr2=0x7ff28c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 --2- 172.21.15.102:0/1765054883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c1083a0 0x7ff28c1087b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff274009900 tx=0x7ff27402a410 comp rx=0 tx=0).stop 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 -- 172.21.15.102:0/1765054883 shutdown_connections 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 --2- 172.21.15.102:0/1765054883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c1083a0 0x7ff28c1087b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 --2- 172.21.15.102:0/1765054883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c108cf0 0x7ff28c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 --2- 172.21.15.102:0/1765054883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 0x7ff28c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 -- 172.21.15.102:0/1765054883 >> 172.21.15.102:0/1765054883 conn(0x7ff28c079730 msgr2=0x7ff28c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.870+0000 7ff290ca6640 1 -- 172.21.15.102:0/1765054883 shutdown_connections 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.871+0000 7ff290ca6640 1 -- 172.21.15.102:0/1765054883 wait complete. 2024-09-21T03:31:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.871+0000 7ff290ca6640 1 Processor -- start 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.871+0000 7ff290ca6640 1 -- start start 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 0x7ff28c19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c1083a0 0x7ff28c19ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112a80 con 0x7ff28c108cf0 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112900 con 0x7ff28c1083a0 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff290ca6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c112c00 con 0x7ff28c102a60 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51470/0 (socket says 172.21.15.102:51470) 2024-09-21T03:31:40.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 -- 172.21.15.102:0/2779521824 learned_addr learned my addr 172.21.15.102:0/2779521824 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28a59c640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 0x7ff28c19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff281d9b640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c1083a0 0x7ff28c19ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 -- 172.21.15.102:0/2779521824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 msgr2=0x7ff28c19a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 0x7ff28c19a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 -- 172.21.15.102:0/2779521824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c1083a0 msgr2=0x7ff28c19ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c1083a0 0x7ff28c19ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 -- 172.21.15.102:0/2779521824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c1a0510 con 0x7ff28c108cf0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.872+0000 7ff28ad9d640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff28400eb10 tx=0x7ff28400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.873+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284004b20 con 0x7ff28c108cf0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.873+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28c1a0800 con 0x7ff28c108cf0 2024-09-21T03:31:40.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.873+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff284004cc0 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.873+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284010720 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.873+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28c1a6f60 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.874+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28c102e70 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.875+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7ff2840108c0 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.876+0000 7ff283fff640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 0x7ff2780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.876+0000 7ff28a59c640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 0x7ff2780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.876+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8094+0+0 (secure 0 0 0) 0x7ff2840e7950 con 0x7ff28c108cf0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.877+0000 7ff28a59c640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 0x7ff2780b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009bd0 tx=0x7ff27c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:40.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:40.879+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff284056710 con 0x7ff28c108cf0 2024-09-21T03:31:41.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.099+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff28c1a71a0 con 0x7ff28c108cf0 2024-09-21T03:31:41.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.497+0000 7ff283fff640 1 -- 172.21.15.102:0/2779521824 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7ff2840ae2c0 con 0x7ff28c108cf0 2024-09-21T03:31:41.499 INFO:teuthology.orchestra.run.smithi102.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T03:31:41.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 msgr2=0x7ff2780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:41.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 0x7ff2780b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009bd0 tx=0x7ff27c005f90 comp rx=0 tx=0).stop 2024-09-21T03:31:41.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 msgr2=0x7ff28c19fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:41.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff28400eb10 tx=0x7ff28400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 shutdown_connections 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff2780b6560 0x7ff2780b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff28c108cf0 0x7ff28c19fde0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff28c1083a0 0x7ff28c19ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 --2- 172.21.15.102:0/2779521824 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff28c102a60 0x7ff28c19a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 >> 172.21.15.102:0/2779521824 conn(0x7ff28c079730 msgr2=0x7ff28c101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 shutdown_connections 2024-09-21T03:31:41.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:41.500+0000 7ff290ca6640 1 -- 172.21.15.102:0/2779521824 wait complete. 2024-09-21T03:31:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:41 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:31:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:41 smithi148 ceph-mon[34651]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T03:31:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:41 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:31:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:41 smithi121 ceph-mon[34316]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T03:31:41.809 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:41 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T03:31:41.809 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:41 smithi102 ceph-mon[31392]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-21T03:31:42.139 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:31:42.384 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: 2024-09-21T03:31:42.307+0000 7f6a0d592640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:active 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:42 smithi148 ceph-mon[34651]: pgmap v264: 97 pgs: 17 creating+peering, 31 unknown, 49 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:31:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:31:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T03:31:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T03:31:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:active 2024-09-21T03:31:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:42 smithi121 ceph-mon[34316]: pgmap v264: 97 pgs: 17 creating+peering, 31 unknown, 49 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:42.822 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2779521824' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] up:active 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:42.823 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:42 smithi102 ceph-mon[31392]: pgmap v264: 97 pgs: 17 creating+peering, 31 unknown, 49 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 -- 172.21.15.102:0/981661687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 msgr2=0x7f8de4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 --2- 172.21.15.102:0/981661687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de4102e70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009900 tx=0x7f8dd402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 -- 172.21.15.102:0/981661687 shutdown_connections 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 --2- 172.21.15.102:0/981661687 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 0x7f8de410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 --2- 172.21.15.102:0/981661687 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 0x7f8de41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 --2- 172.21.15.102:0/981661687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de4102e70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 -- 172.21.15.102:0/981661687 >> 172.21.15.102:0/981661687 conn(0x7f8de4079720 msgr2=0x7f8de4079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:42.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 -- 172.21.15.102:0/981661687 shutdown_connections 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.909+0000 7f8de9e94640 1 -- 172.21.15.102:0/981661687 wait complete. 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.910+0000 7f8de9e94640 1 Processor -- start 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.910+0000 7f8de9e94640 1 -- start start 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.910+0000 7f8de9e94640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.910+0000 7f8de9e94640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 0x7f8de419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 0x7f8de419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112b00 con 0x7f8de4102a60 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112980 con 0x7f8de41083a0 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4112c80 con 0x7f8de4108cf0 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51482/0 (socket says 172.21.15.102:51482) 2024-09-21T03:31:42.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 -- 172.21.15.102:0/4275264299 learned_addr learned my addr 172.21.15.102:0/4275264299 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de3fff640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 0x7f8de419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de2ffd640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 0x7f8de419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 -- 172.21.15.102:0/4275264299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 msgr2=0x7f8de419be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 0x7f8de419be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 -- 172.21.15.102:0/4275264299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 msgr2=0x7f8de419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 0x7f8de419b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 -- 172.21.15.102:0/4275264299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de41a6640 con 0x7f8de4102a60 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de37fe640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006010 tx=0x7f8dd4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd403f070 con 0x7f8de4102a60 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8dd4031e10 con 0x7f8de4102a60 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de41a68d0 con 0x7f8de4102a60 2024-09-21T03:31:42.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4035030 con 0x7f8de4102a60 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.911+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de41a6e30 con 0x7f8de4102a60 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.912+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4103ce0 con 0x7f8de4102a60 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.914+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f8dd4042070 con 0x7f8de4102a60 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.915+0000 7f8de0ff9640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 0x7f8dcc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.915+0000 7f8de2ffd640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 0x7f8dcc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.915+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f8dd4108480 con 0x7f8de4102a60 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.915+0000 7f8de2ffd640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 0x7f8dcc0b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8de4100bd0 tx=0x7f8dd80072f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:42.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:42.918+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8dd40ced30 con 0x7f8de4102a60 2024-09-21T03:31:43.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.095+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8de4102e70 con 0x7f8de4102a60 2024-09-21T03:31:43.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.096+0000 7f8de0ff9640 1 -- 172.21.15.102:0/4275264299 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22670 (secure 0 0 0) 0x7f8de4102e70 con 0x7f8de4102a60 2024-09-21T03:31:43.098 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:43.099 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":77,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:31:41.100749+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:31:43.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 msgr2=0x7f8dcc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:43.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 0x7f8dcc0b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8de4100bd0 tx=0x7f8dd80072f0 comp rx=0 tx=0).stop 2024-09-21T03:31:43.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 msgr2=0x7f8de419b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:43.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006010 tx=0x7f8dd4004430 comp rx=0 tx=0).stop 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 shutdown_connections 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8dcc0b6560 0x7f8dcc0b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8de4108cf0 0x7f8de419be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8de41083a0 0x7f8de419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 --2- 172.21.15.102:0/4275264299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8de4102a60 0x7f8de419b410 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 >> 172.21.15.102:0/4275264299 conn(0x7f8de4079720 msgr2=0x7f8de4101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 shutdown_connections 2024-09-21T03:31:43.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:43.099+0000 7f8de9e94640 1 -- 172.21.15.102:0/4275264299 wait complete. 2024-09-21T03:31:43.697 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:31:43.943 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:43.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:43 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4275264299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:44.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:43 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4275264299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:44.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:43 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4275264299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 -- 172.21.15.102:0/93476116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 msgr2=0x7fa77c103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 --2- 172.21.15.102:0/93476116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c103620 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009900 tx=0x7fa76c02a410 comp rx=0 tx=0).stop 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 -- 172.21.15.102:0/93476116 shutdown_connections 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 --2- 172.21.15.102:0/93476116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 --2- 172.21.15.102:0/93476116 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 --2- 172.21.15.102:0/93476116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c103620 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 -- 172.21.15.102:0/93476116 >> 172.21.15.102:0/93476116 conn(0x7fa77c079ec0 msgr2=0x7fa77c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.450+0000 7fa781eaa640 1 -- 172.21.15.102:0/93476116 shutdown_connections 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.451+0000 7fa781eaa640 1 -- 172.21.15.102:0/93476116 wait complete. 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.451+0000 7fa781eaa640 1 Processor -- start 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.451+0000 7fa781eaa640 1 -- start start 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c112c70 con 0x7fa77c103210 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c112af0 con 0x7fa77c105b70 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c112df0 con 0x7fa77c105220 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36304/0 (socket says 172.21.15.102:36304) 2024-09-21T03:31:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 -- 172.21.15.102:0/2655384276 learned_addr learned my addr 172.21.15.102:0/2655384276 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77bfff640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77affd640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 -- 172.21.15.102:0/2655384276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 msgr2=0x7fa77c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 -- 172.21.15.102:0/2655384276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 msgr2=0x7fa77c19bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c19bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 -- 172.21.15.102:0/2655384276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c1a6780 con 0x7fa77c103210 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77bfff640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77affd640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa77b7fe640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa76c006010 tx=0x7fa76c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c03f070 con 0x7fa77c103210 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c1a6a10 con 0x7fa77c103210 2024-09-21T03:31:44.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.452+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa76c031e10 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.453+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c035030 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.453+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c1a6fc0 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.454+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77c103620 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.455+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fa76c042070 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.456+0000 7fa778ff9640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 0x7fa7640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.456+0000 7fa77affd640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 0x7fa7640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.456+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7fa76c108460 con 0x7fa77c103210 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.456+0000 7fa77affd640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 0x7fa7640b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa770006fd0 tx=0x7fa770008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:44.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.459+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa76c0ced10 con 0x7fa77c103210 2024-09-21T03:31:44.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.639+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa77c10a580 con 0x7fa77c103210 2024-09-21T03:31:44.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.641+0000 7fa778ff9640 1 -- 172.21.15.102:0/2655384276 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22670 (secure 0 0 0) 0x7fa76c0d30f0 con 0x7fa77c103210 2024-09-21T03:31:44.643 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:31:44.643 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":77,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:31:41.100749+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 msgr2=0x7fa7640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 0x7fa7640b8a70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa770006fd0 tx=0x7fa770008040 comp rx=0 tx=0).stop 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 msgr2=0x7fa77c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa76c006010 tx=0x7fa76c004430 comp rx=0 tx=0).stop 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 shutdown_connections 2024-09-21T03:31:44.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa7640b6560 0x7fa7640b8a70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa77c105b70 0x7fa77c19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa77c105220 0x7fa77c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 --2- 172.21.15.102:0/2655384276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa77c103210 0x7fa77c19b4c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 >> 172.21.15.102:0/2655384276 conn(0x7fa77c079ec0 msgr2=0x7fa77c1073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 shutdown_connections 2024-09-21T03:31:44.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:44.643+0000 7fa781eaa640 1 -- 172.21.15.102:0/2655384276 wait complete. 2024-09-21T03:31:44.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:44 smithi102 ceph-mon[31392]: pgmap v265: 97 pgs: 17 creating+peering, 21 unknown, 59 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s wr, 3 op/s 2024-09-21T03:31:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2655384276' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:45.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:44 smithi121 ceph-mon[34316]: pgmap v265: 97 pgs: 17 creating+peering, 21 unknown, 59 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s wr, 3 op/s 2024-09-21T03:31:45.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2655384276' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:45.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:44 smithi148 ceph-mon[34651]: pgmap v265: 97 pgs: 17 creating+peering, 21 unknown, 59 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 177 B/s wr, 3 op/s 2024-09-21T03:31:45.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2655384276' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:31:45.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T03:31:45.587 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 -- 172.21.15.102:0/844437388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70102aa0 msgr2=0x7f8e70102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/844437388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70102aa0 0x7f8e70102eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009900 tx=0x7f8e6002a410 comp rx=0 tx=0).stop 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 -- 172.21.15.102:0/844437388 shutdown_connections 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/844437388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e70108d30 0x7f8e7010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/844437388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e701083e0 0x7f8e701087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:46.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/844437388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70102aa0 0x7f8e70102eb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 -- 172.21.15.102:0/844437388 >> 172.21.15.102:0/844437388 conn(0x7f8e700797e0 msgr2=0x7f8e70079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 -- 172.21.15.102:0/844437388 shutdown_connections 2024-09-21T03:31:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.112+0000 7f8e75eb8640 1 -- 172.21.15.102:0/844437388 wait complete. 2024-09-21T03:31:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.113+0000 7f8e75eb8640 1 Processor -- start 2024-09-21T03:31:46.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.113+0000 7f8e75eb8640 1 -- start start 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 0x7f8e7019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 0x7f8e7019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70111a40 con 0x7f8e70108d30 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e701118c0 con 0x7f8e70102aa0 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e75eb8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8e70111bc0 con 0x7f8e701083e0 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36316/0 (socket says 172.21.15.102:36316) 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 -- 172.21.15.102:0/3984109750 learned_addr learned my addr 172.21.15.102:0/3984109750 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e66ffd640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 0x7f8e7019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:46.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6f7fe640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 0x7f8e7019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 -- 172.21.15.102:0/3984109750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 msgr2=0x7f8e7019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 0x7f8e7019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 -- 172.21.15.102:0/3984109750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 msgr2=0x7f8e7019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 0x7f8e7019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 -- 172.21.15.102:0/3984109750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e701a2790 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e66ffd640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 0x7f8e7019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6f7fe640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 0x7f8e7019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.114+0000 7f8e6ffff640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009fd0 tx=0x7f8e6800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.115+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68017070 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.115+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e68003e40 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.115+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e701a2a80 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.115+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68004820 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.115+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e701a91e0 con 0x7f8e70108d30 2024-09-21T03:31:46.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.116+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e70102eb0 con 0x7f8e70108d30 2024-09-21T03:31:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.117+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f8e68003970 con 0x7f8e70108d30 2024-09-21T03:31:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.118+0000 7f8e6d7fa640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 0x7f8e5c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:46.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.118+0000 7f8e6f7fe640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 0x7f8e5c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:46.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.118+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f8e680e7270 con 0x7f8e70108d30 2024-09-21T03:31:46.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.119+0000 7f8e6f7fe640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 0x7f8e5c0b8a60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e60032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:46.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.121+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e68003c60 con 0x7f8e70108d30 2024-09-21T03:31:46.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:46.337+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8e7019d950 con 0x7f8e70108d30 2024-09-21T03:31:47.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.276+0000 7f8e6d7fa640 1 -- 172.21.15.102:0/3984109750 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f8e7019d950 con 0x7f8e70108d30 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 msgr2=0x7f8e5c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 0x7f8e5c0b8a60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e60032c70 comp rx=0 tx=0).stop 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 msgr2=0x7f8e701a2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009fd0 tx=0x7f8e6800b260 comp rx=0 tx=0).stop 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 shutdown_connections 2024-09-21T03:31:47.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e5c0b6550 0x7f8e5c0b8a60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e70108d30 0x7f8e701a2060 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e701083e0 0x7f8e7019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 --2- 172.21.15.102:0/3984109750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e70102aa0 0x7f8e7019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 >> 172.21.15.102:0/3984109750 conn(0x7f8e700797e0 msgr2=0x7f8e70101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 shutdown_connections 2024-09-21T03:31:47.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:47.280+0000 7f8e75eb8640 1 -- 172.21.15.102:0/3984109750 wait complete. 2024-09-21T03:31:47.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:47 smithi121 ceph-mon[34316]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T03:31:47.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:47 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:31:47.594 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:47 smithi102 ceph-mon[31392]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T03:31:47.594 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:47 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:31:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:47 smithi148 ceph-mon[34651]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 6 op/s 2024-09-21T03:31:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:47 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T03:31:47.975 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T03:31:47.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T03:31:48.234 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:31:48.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:48 smithi121 ceph-mon[34316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:48.538 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:31:48.538 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:48 smithi102 ceph-mon[31392]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3984109750' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T03:31:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:48 smithi148 ceph-mon[34651]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:48.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 -- 172.21.15.102:0/2140689186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494102a60 msgr2=0x7fa494102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:48.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 --2- 172.21.15.102:0/2140689186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494102a60 0x7fa494102e70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa490009860 tx=0x7fa49002a340 comp rx=0 tx=0).stop 2024-09-21T03:31:48.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 -- 172.21.15.102:0/2140689186 shutdown_connections 2024-09-21T03:31:48.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 --2- 172.21.15.102:0/2140689186 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494108cf0 0x7fa49410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 --2- 172.21.15.102:0/2140689186 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 0x7fa4941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 --2- 172.21.15.102:0/2140689186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494102a60 0x7fa494102e70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 -- 172.21.15.102:0/2140689186 >> 172.21.15.102:0/2140689186 conn(0x7fa494079730 msgr2=0x7fa494079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 -- 172.21.15.102:0/2140689186 shutdown_connections 2024-09-21T03:31:48.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.752+0000 7fa49b665640 1 -- 172.21.15.102:0/2140689186 wait complete. 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 Processor -- start 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 -- start start 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 0x7fa49419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 0x7fa49419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa494112aa0 con 0x7fa494108cf0 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa494112920 con 0x7fa4941083a0 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa499c02640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:48.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa49b665640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa494112c20 con 0x7fa494102a60 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa499c02640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36332/0 (socket says 172.21.15.102:36332) 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa499c02640 1 -- 172.21.15.102:0/1707882726 learned_addr learned my addr 172.21.15.102:0/1707882726 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa499401640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 0x7fa49419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.753+0000 7fa498c00640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 0x7fa49419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 -- 172.21.15.102:0/1707882726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 msgr2=0x7fa49419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 0x7fa49419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 -- 172.21.15.102:0/1707882726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 msgr2=0x7fa49419b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 0x7fa49419b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 -- 172.21.15.102:0/1707882726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4941a65c0 con 0x7fa494108cf0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499401640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 0x7fa49419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa499c02640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00eb10 tx=0x7fa48c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c00ce20 con 0x7fa494108cf0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa48c005020 con 0x7fa494108cf0 2024-09-21T03:31:48.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4941a68b0 con 0x7fa494108cf0 2024-09-21T03:31:48.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48c010670 con 0x7fa494108cf0 2024-09-21T03:31:48.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.754+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4941a6e40 con 0x7fa494108cf0 2024-09-21T03:31:48.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.755+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa494102e70 con 0x7fa494108cf0 2024-09-21T03:31:48.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.757+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fa48c005560 con 0x7fa494108cf0 2024-09-21T03:31:48.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.757+0000 7fa48a7fc640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 0x7fa4800b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:48.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.757+0000 7fa499401640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 0x7fa4800b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:48.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.758+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7fa48c0e79d0 con 0x7fa494108cf0 2024-09-21T03:31:48.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.758+0000 7fa499401640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 0x7fa4800b8b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa490009830 tx=0x7fa4900058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:48.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.761+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa48c056710 con 0x7fa494108cf0 2024-09-21T03:31:48.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:48.977+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fa49402e640 con 0x7fa494108cf0 2024-09-21T03:31:49.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.287+0000 7fa48a7fc640 1 -- 172.21.15.102:0/1707882726 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7fa48c0ae280 con 0x7fa494108cf0 2024-09-21T03:31:49.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.289+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 msgr2=0x7fa4800b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.289+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 0x7fa4800b8b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa490009830 tx=0x7fa4900058d0 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.289+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 msgr2=0x7fa49419bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.289+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa48c00eb10 tx=0x7fa48c00ef10 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 shutdown_connections 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4800b6610 0x7fa4800b8b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa494108cf0 0x7fa49419bdb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4941083a0 0x7fa49419b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 --2- 172.21.15.102:0/1707882726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa494102a60 0x7fa49419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 >> 172.21.15.102:0/1707882726 conn(0x7fa494079730 msgr2=0x7fa4941013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 shutdown_connections 2024-09-21T03:31:49.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:49.290+0000 7fa49b665640 1 -- 172.21.15.102:0/1707882726 wait complete. 2024-09-21T03:31:49.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:49 smithi121 ceph-mon[34316]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:31:49.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:49 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:31:49.631 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:49 smithi102 ceph-mon[31392]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:31:49.631 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:49 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:31:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:49 smithi148 ceph-mon[34651]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T03:31:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:49 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T03:31:49.948 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T03:31:50.195 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:50.618 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:31:50.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:31:50.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:31:50.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:50.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T03:31:50.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:50 smithi102 ceph-mon[31392]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 -- 172.21.15.102:0/96698206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174109df0 msgr2=0x7f3174110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 --2- 172.21.15.102:0/96698206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174109df0 0x7f3174110620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f316c009900 tx=0x7f316c02a410 comp rx=0 tx=0).stop 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 -- 172.21.15.102:0/96698206 shutdown_connections 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 --2- 172.21.15.102:0/96698206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174109df0 0x7f3174110620 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 --2- 172.21.15.102:0/96698206 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 0x7f31741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 --2- 172.21.15.102:0/96698206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174103b60 0x7f3174103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 -- 172.21.15.102:0/96698206 >> 172.21.15.102:0/96698206 conn(0x7f317407b850 msgr2=0x7f317407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 -- 172.21.15.102:0/96698206 shutdown_connections 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.709+0000 7f3178c5c640 1 -- 172.21.15.102:0/96698206 wait complete. 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 Processor -- start 2024-09-21T03:31:50.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 -- start start 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 0x7f3174075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 0x7f3174076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113bf0 con 0x7f3174103b60 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113a70 con 0x7f3174109df0 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3178c5c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3174113d70 con 0x7f31741094a0 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36346/0 (socket says 172.21.15.102:36346) 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 -- 172.21.15.102:0/316450528 learned_addr learned my addr 172.21.15.102:0/316450528 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3171d9b640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 0x7f3174075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3172d9d640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 0x7f3174076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 -- 172.21.15.102:0/316450528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 msgr2=0x7f3174075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 0x7f3174075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:50.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 -- 172.21.15.102:0/316450528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 msgr2=0x7f3174076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 0x7f3174076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 -- 172.21.15.102:0/316450528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31741a8840 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f3172d9d640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 0x7f3174076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.710+0000 7f317259c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f316400c890 tx=0x7f316400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.711+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164004220 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.711+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f31640043c0 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.711+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31741a8b30 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.711+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640049c0 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.711+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a9070 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.712+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3174103f70 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.714+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f3164005140 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.715+0000 7f31637fe640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 0x7f315c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.715+0000 7f3171d9b640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 0x7f315c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.715+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f31640e74c0 con 0x7f3174103b60 2024-09-21T03:31:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.715+0000 7f3171d9b640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 0x7f315c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f316800a2e0 tx=0x7f316800a270 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.718+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3164014030 con 0x7f3174103b60 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T03:31:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:50 smithi148 ceph-mon[34651]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T03:31:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T03:31:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1707882726' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T03:31:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T03:31:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-21T03:31:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-09-21T03:31:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:50 smithi121 ceph-mon[34316]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-09-21T03:31:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:50.933+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f317402e640 con 0x7f3174103b60 2024-09-21T03:31:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.310+0000 7f31637fe640 1 -- 172.21.15.102:0/316450528 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7f31640add70 con 0x7f3174103b60 2024-09-21T03:31:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 msgr2=0x7f315c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 0x7f315c0b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f316800a2e0 tx=0x7f316800a270 comp rx=0 tx=0).stop 2024-09-21T03:31:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 msgr2=0x7f3174075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f316400c890 tx=0x7f316400cd50 comp rx=0 tx=0).stop 2024-09-21T03:31:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 shutdown_connections 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f315c0b6560 0x7f315c0b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3174109df0 0x7f3174076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f31741094a0 0x7f3174075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 --2- 172.21.15.102:0/316450528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3174103b60 0x7f3174075710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 >> 172.21.15.102:0/316450528 conn(0x7f317407b850 msgr2=0x7f3174107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 shutdown_connections 2024-09-21T03:31:51.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:51.312+0000 7f3178c5c640 1 -- 172.21.15.102:0/316450528 wait complete. 2024-09-21T03:31:51.681 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T03:31:51.681 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:active 2024-09-21T03:31:51.681 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:31:51.681 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:31:51.681 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: Cluster is now healthy 2024-09-21T03:31:51.682 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T03:31:51.682 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T03:31:51.682 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T03:31:51.682 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:51 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:active 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: Cluster is now healthy 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T03:31:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:51 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:31:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: pgmap v268: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] up:active 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: Cluster is now healthy 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T03:31:51.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:51 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T03:31:52.057 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T03:31:52.308 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:52.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:52 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:31:52.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:52 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:active 2024-09-21T03:31:52.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:52 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T03:31:52.579 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:52 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:52.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:52 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:31:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:52 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:active 2024-09-21T03:31:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:52 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T03:31:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:52 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:52 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/316450528' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T03:31:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:52 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] up:active 2024-09-21T03:31:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:52 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 9 up:standby 2024-09-21T03:31:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:52 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:52.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/202001095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e410de10 msgr2=0x7fb5e4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:52.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/202001095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e410de10 0x7fb5e4110300 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009ca0 tx=0x7fb5dc02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/202001095 shutdown_connections 2024-09-21T03:31:52.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/202001095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e410de10 0x7fb5e4110300 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/202001095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e4105300 0x7fb5e410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/202001095 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e41049b0 0x7fb5e4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/202001095 >> 172.21.15.102:0/202001095 conn(0x7fb5e4079730 msgr2=0x7fb5e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/202001095 shutdown_connections 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.785+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/202001095 wait complete. 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.786+0000 7fb5ec2bc640 1 Processor -- start 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.786+0000 7fb5ec2bc640 1 -- start start 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.786+0000 7fb5ec2bc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.786+0000 7fb5ec2bc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 0x7fb5e419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.786+0000 7fb5ec2bc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e410de10 0x7fb5e419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ec2bc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113bc0 con 0x7fb5e41049b0 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ec2bc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113a40 con 0x7fb5e410de10 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ec2bc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113d40 con 0x7fb5e4105300 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36370/0 (socket says 172.21.15.102:36370) 2024-09-21T03:31:52.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 -- 172.21.15.102:0/4209097751 learned_addr learned my addr 172.21.15.102:0/4209097751 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 -- 172.21.15.102:0/4209097751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 msgr2=0x7fb5e419aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5e9857640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 0x7fb5e419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea859640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e410de10 0x7fb5e419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 0x7fb5e419aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 -- 172.21.15.102:0/4209097751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e410de10 msgr2=0x7fb5e419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e410de10 0x7fb5e419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 -- 172.21.15.102:0/4209097751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e41a0400 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5e9857640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 0x7fb5e419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ea058640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c970 tx=0x7fb5e000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0007c10 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e41a06f0 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb5e0007db0 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000f910 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.787+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e41a6f10 con 0x7fb5e41049b0 2024-09-21T03:31:52.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.788+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e4104dc0 con 0x7fb5e41049b0 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.790+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7fb5e000fab0 con 0x7fb5e41049b0 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.790+0000 7fb5d77fe640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 0x7fb5d00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.790+0000 7fb5e9857640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 0x7fb5d00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.791+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7fb5e00e7a00 con 0x7fb5e41049b0 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.791+0000 7fb5e9857640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 0x7fb5d00b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8006fd0 tx=0x7fb5d8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:52.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:52.794+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5e00ae3d0 con 0x7fb5e41049b0 2024-09-21T03:31:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.012+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fb5e402e640 con 0x7fb5e41049b0 2024-09-21T03:31:53.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.321+0000 7fb5d77fe640 1 -- 172.21.15.102:0/4209097751 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7fb5e00b27b0 con 0x7fb5e41049b0 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 msgr2=0x7fb5d00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 0x7fb5d00b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8006fd0 tx=0x7fb5d8008040 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 msgr2=0x7fb5e419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000c970 tx=0x7fb5e000ce30 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 shutdown_connections 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5d00b6590 0x7fb5d00b8aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5e410de10 0x7fb5e419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5e4105300 0x7fb5e419aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 --2- 172.21.15.102:0/4209097751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5e41049b0 0x7fb5e419a550 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 >> 172.21.15.102:0/4209097751 conn(0x7fb5e4079730 msgr2=0x7fb5e40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 shutdown_connections 2024-09-21T03:31:53.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:53.325+0000 7fb5ec2bc640 1 -- 172.21.15.102:0/4209097751 wait complete. 2024-09-21T03:31:53.673 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:53 smithi102 ceph-mon[31392]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 9 op/s 2024-09-21T03:31:53.673 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:53 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:31:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:53 smithi148 ceph-mon[34651]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 9 op/s 2024-09-21T03:31:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:53 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:31:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:53 smithi121 ceph-mon[34316]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 9 op/s 2024-09-21T03:31:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:53 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T03:31:53.960 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T03:31:53.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T03:31:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:54.611 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:31:54.612 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 -- 172.21.15.102:0/1137005974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b20109e20 msgr2=0x7f0b20110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 --2- 172.21.15.102:0/1137005974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b20109e20 0x7f0b20110650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0b18009900 tx=0x7f0b1802a410 comp rx=0 tx=0).stop 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 -- 172.21.15.102:0/1137005974 shutdown_connections 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 --2- 172.21.15.102:0/1137005974 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b20109e20 0x7f0b20110650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 --2- 172.21.15.102:0/1137005974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b201094d0 0x7f0b201098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 --2- 172.21.15.102:0/1137005974 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20103b90 0x7f0b20103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 -- 172.21.15.102:0/1137005974 >> 172.21.15.102:0/1137005974 conn(0x7f0b200ff600 msgr2=0x7f0b20101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 -- 172.21.15.102:0/1137005974 shutdown_connections 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.701+0000 7f0b28446640 1 -- 172.21.15.102:0/1137005974 wait complete. 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 Processor -- start 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 -- start start 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 0x7f0b20075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20109e20 0x7f0b20076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20113c80 con 0x7f0b201094d0 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20113b00 con 0x7f0b20103b90 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b28446640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20113e00 con 0x7f0b20109e20 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b259e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b259e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46640/0 (socket says 172.21.15.102:46640) 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b259e1640 1 -- 172.21.15.102:0/3792229256 learned_addr learned my addr 172.21.15.102:0/3792229256 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.702+0000 7f0b261e2640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 0x7f0b20075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 -- 172.21.15.102:0/3792229256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20109e20 msgr2=0x7f0b20076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20109e20 0x7f0b20076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 -- 172.21.15.102:0/3792229256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 msgr2=0x7f0b20075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 0x7f0b20075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 -- 172.21.15.102:0/3792229256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b201a8830 con 0x7f0b201094d0 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b261e2640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 0x7f0b20075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:31:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b259e1640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400d740 tx=0x7f0b1400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b14017070 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0b1400de50 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b201a8b20 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400f620 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.703+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b201a9060 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.704+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b20103fa0 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.706+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 20) ==== 154530+0+0 (secure 0 0 0) 0x7f0b1401a070 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.706+0000 7f0b1f7fe640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 0x7f0b080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.706+0000 7f0b261e2640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 0x7f0b080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.706+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f0b140e6dd0 con 0x7f0b201094d0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.707+0000 7f0b261e2640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 0x7f0b080b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b20077160 tx=0x7f0b10009570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.709+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b140ad680 con 0x7f0b201094d0 2024-09-21T03:31:54.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:54 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:31:54.788 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:54 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:54.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:54 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4209097751' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T03:31:54.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:54 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:31:54.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.910+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0b2002e6a0 con 0x7f0b080b6560 2024-09-21T03:31:54.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.941+0000 7f0b1f7fe640 1 -- 172.21.15.102:0/3792229256 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0b2002e6a0 con 0x7f0b080b6560 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 msgr2=0x7f0b080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 0x7f0b080b8a70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b20077160 tx=0x7f0b10009570 comp rx=0 tx=0).stop 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 msgr2=0x7f0b20075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400d740 tx=0x7f0b1400dc00 comp rx=0 tx=0).stop 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 shutdown_connections 2024-09-21T03:31:54.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0b080b6560 0x7f0b080b8a70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0b201094d0 0x7f0b20075c50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0b20109e20 0x7f0b20076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 --2- 172.21.15.102:0/3792229256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0b20103b90 0x7f0b20075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 >> 172.21.15.102:0/3792229256 conn(0x7f0b200ff600 msgr2=0x7f0b20108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 shutdown_connections 2024-09-21T03:31:54.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:54.943+0000 7f0b28446640 1 -- 172.21.15.102:0/3792229256 wait complete. 2024-09-21T03:31:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:31:54.916+0000 7fbff5feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:31:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:31:54.916+0000 7fbff5feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:31:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:31:54.916+0000 7fbff5feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:31:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:31:54.916+0000 7fbff5feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:31:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:31:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:31:54.916+0000 7fbff5feb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:31:55.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:55 smithi102 ceph-mon[31392]: pgmap v270: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T03:31:55.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T03:31:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:55 smithi148 ceph-mon[34651]: pgmap v270: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T03:31:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:55 smithi121 ceph-mon[34316]: pgmap v270: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-21T03:31:55.894 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 -- 172.21.15.102:0/2940347514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 msgr2=0x7f49d0102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 --2- 172.21.15.102:0/2940347514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d0102600 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009900 tx=0x7f49c002a410 comp rx=0 tx=0).stop 2024-09-21T03:31:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 -- 172.21.15.102:0/2940347514 shutdown_connections 2024-09-21T03:31:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 --2- 172.21.15.102:0/2940347514 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 0x7f49d010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 --2- 172.21.15.102:0/2940347514 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 --2- 172.21.15.102:0/2940347514 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d0102600 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 -- 172.21.15.102:0/2940347514 >> 172.21.15.102:0/2940347514 conn(0x7f49d0077c60 msgr2=0x7f49d00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 -- 172.21.15.102:0/2940347514 shutdown_connections 2024-09-21T03:31:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.423+0000 7f49d4f13640 1 -- 172.21.15.102:0/2940347514 wait complete. 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 Processor -- start 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 -- start start 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 0x7f49d019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0112280 con 0x7f49d01021f0 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0112100 con 0x7f49d0107b30 2024-09-21T03:31:56.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49d4f13640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49d0112400 con 0x7f49d0108480 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46684/0 (socket says 172.21.15.102:46684) 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 -- 172.21.15.102:0/513805090 learned_addr learned my addr 172.21.15.102:0/513805090 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49cdd9b640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ced9d640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 0x7f49d019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 -- 172.21.15.102:0/513805090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 msgr2=0x7f49d019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 0x7f49d019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 -- 172.21.15.102:0/513805090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 msgr2=0x7f49d019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49ce59c640 1 -- 172.21.15.102:0/513805090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d01a0520 con 0x7f49d01021f0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.424+0000 7f49cdd9b640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49ce59c640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49c0005ab0 tx=0x7f49c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c003f030 con 0x7f49d01021f0 2024-09-21T03:31:56.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d01a07b0 con 0x7f49d01021f0 2024-09-21T03:31:56.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49c0003cd0 con 0x7f49d01021f0 2024-09-21T03:31:56.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0035070 con 0x7f49d01021f0 2024-09-21T03:31:56.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.425+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d01a6f70 con 0x7f49d01021f0 2024-09-21T03:31:56.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.426+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d0103470 con 0x7f49d01021f0 2024-09-21T03:31:56.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.428+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f49c0042030 con 0x7f49d01021f0 2024-09-21T03:31:56.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.429+0000 7f49bf7fe640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 0x7f49b80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:56.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.429+0000 7f49cdd9b640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 0x7f49b80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:56.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.429+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f49c0107d40 con 0x7f49d01021f0 2024-09-21T03:31:56.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.429+0000 7f49cdd9b640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 0x7f49b80b8b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49d006ac90 tx=0x7f49c8009510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:56.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.432+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49c00ce490 con 0x7f49d01021f0 2024-09-21T03:31:56.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.640+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f49d0063800 con 0x7f49b80b65f0 2024-09-21T03:31:56.642 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:56 smithi102 ceph-mon[31392]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:56.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.667+0000 7f49bf7fe640 1 -- 172.21.15.102:0/513805090 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f49d0063800 con 0x7f49b80b65f0 2024-09-21T03:31:56.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 msgr2=0x7f49b80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:56.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 0x7f49b80b8b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f49d006ac90 tx=0x7f49c8009510 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 msgr2=0x7f49d019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49c0005ab0 tx=0x7f49c00042f0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 shutdown_connections 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f49b80b65f0 0x7f49b80b8b00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49d0108480 0x7f49d019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49d0107b30 0x7f49d019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 --2- 172.21.15.102:0/513805090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49d01021f0 0x7f49d019a5b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 >> 172.21.15.102:0/513805090 conn(0x7f49d0077c60 msgr2=0x7f49d0108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 shutdown_connections 2024-09-21T03:31:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:56.669+0000 7f49d4f13640 1 -- 172.21.15.102:0/513805090 wait complete. 2024-09-21T03:31:56.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:56 smithi148 ceph-mon[34651]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:56.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:56 smithi121 ceph-mon[34316]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:57.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T03:31:57.567 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:57.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:57 smithi102 ceph-mon[31392]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T03:31:57.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:57 smithi102 ceph-mon[31392]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T03:31:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:57 smithi148 ceph-mon[34651]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T03:31:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:57 smithi148 ceph-mon[34651]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T03:31:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:57 smithi121 ceph-mon[34316]: pgmap v271: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T03:31:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:57 smithi121 ceph-mon[34316]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2375800241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105170 msgr2=0x7f1fa0105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2375800241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105170 0x7f1fa0105580 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009900 tx=0x7f1f8c02a410 comp rx=0 tx=0).stop 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2375800241 shutdown_connections 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2375800241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105170 0x7f1fa0105580 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2375800241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105ac0 0x7f1fa010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2375800241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 0x7f1fa0103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2375800241 >> 172.21.15.102:0/2375800241 conn(0x7f1fa0077c60 msgr2=0x7f1fa00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2375800241 shutdown_connections 2024-09-21T03:31:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2375800241 wait complete. 2024-09-21T03:31:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.064+0000 7f1fa70c4640 1 Processor -- start 2024-09-21T03:31:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 -- start start 2024-09-21T03:31:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 0x7f1fa0199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105170 0x7f1fa01999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa0112ae0 con 0x7f1fa0105ac0 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa0112960 con 0x7f1fa0105170 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa70c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa0112c60 con 0x7f1fa0103160 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46704/0 (socket says 172.21.15.102:46704) 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 -- 172.21.15.102:0/2094229017 learned_addr learned my addr 172.21.15.102:0/2094229017 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1f9ffff640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105170 0x7f1fa01999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa4e60640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 0x7f1fa0199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 -- 172.21.15.102:0/2094229017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 msgr2=0x7f1fa0199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 0x7f1fa0199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 -- 172.21.15.102:0/2094229017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105170 msgr2=0x7f1fa01999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:58.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105170 0x7f1fa01999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.065+0000 7f1fa5661640 1 -- 172.21.15.102:0/2094229017 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa019f3c0 con 0x7f1fa0105ac0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1fa5661640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800cad0 tx=0x7f1f9800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800ae20 con 0x7f1fa0105ac0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa019f6b0 con 0x7f1fa0105ac0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1f98005020 con 0x7f1fa0105ac0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9800f6b0 con 0x7f1fa0105ac0 2024-09-21T03:31:58.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.066+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa01a5e10 con 0x7f1fa0105ac0 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.067+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa0103570 con 0x7f1fa0105ac0 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.068+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f1f980051d0 con 0x7f1fa0105ac0 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.069+0000 7f1f9dffb640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 0x7f1f900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.069+0000 7f1fa4e60640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 0x7f1f900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.069+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f1f980e7530 con 0x7f1fa0105ac0 2024-09-21T03:31:58.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.069+0000 7f1fa4e60640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 0x7f1f900b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.073+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f98014030 con 0x7f1fa0105ac0 2024-09-21T03:31:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.281+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1fa0063800 con 0x7f1f900b65f0 2024-09-21T03:31:58.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.287+0000 7f1f9dffb640 1 -- 172.21.15.102:0/2094229017 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1fa0063800 con 0x7f1f900b65f0 2024-09-21T03:31:58.289 INFO:teuthology.orchestra.run.smithi102.stdout:/volumes/qa/sv_0/91b63599-2a55-440b-96f5-346658fd5c5b 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 msgr2=0x7f1f900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 0x7f1f900b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f94005fd0 tx=0x7f1f94005e20 comp rx=0 tx=0).stop 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 msgr2=0x7f1fa019ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800cad0 tx=0x7f1f9800cf90 comp rx=0 tx=0).stop 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 shutdown_connections 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1f900b65f0 0x7f1f900b8b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fa0105ac0 0x7f1fa019ec90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fa0105170 0x7f1fa01999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 --2- 172.21.15.102:0/2094229017 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fa0103160 0x7f1fa0199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:58.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 >> 172.21.15.102:0/2094229017 conn(0x7f1fa0077c60 msgr2=0x7f1fa0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:58.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 shutdown_connections 2024-09-21T03:31:58.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:58.289+0000 7f1fa70c4640 1 -- 172.21.15.102:0/2094229017 wait complete. 2024-09-21T03:31:58.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:58 smithi121 ceph-mon[34316]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:58.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:58 smithi102 ceph-mon[31392]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:58.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:58 smithi148 ceph-mon[34651]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:59.039 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T03:31:59.283 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:31:59.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:59 smithi102 ceph-mon[31392]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T03:31:59.607 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:31:59 smithi102 ceph-mon[31392]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:59 smithi148 ceph-mon[34651]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T03:31:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:31:59 smithi148 ceph-mon[34651]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:59 smithi121 ceph-mon[34316]: pgmap v272: 97 pgs: 97 active+clean; 588 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T03:31:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:31:59 smithi121 ceph-mon[34316]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 -- 172.21.15.102:0/1163004787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c108420 msgr2=0x7fdd1c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/1163004787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c108420 0x7fdd1c108830 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fdd10009900 tx=0x7fdd1002a410 comp rx=0 tx=0).stop 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 -- 172.21.15.102:0/1163004787 shutdown_connections 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/1163004787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c108420 0x7fdd1c108830 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/1163004787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108d70 0x7fdd1c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/1163004787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:59.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 -- 172.21.15.102:0/1163004787 >> 172.21.15.102:0/1163004787 conn(0x7fdd1c079770 msgr2=0x7fdd1c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:31:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 -- 172.21.15.102:0/1163004787 shutdown_connections 2024-09-21T03:31:59.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.806+0000 7fdd20d8e640 1 -- 172.21.15.102:0/1163004787 wait complete. 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 Processor -- start 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 -- start start 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108420 0x7fdd1c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 0x7fdd1c19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c112b90 con 0x7fdd1c102ae0 2024-09-21T03:31:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c112a10 con 0x7fdd1c108d70 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd20d8e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c112d10 con 0x7fdd1c108420 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46728/0 (socket says 172.21.15.102:46728) 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1a59c640 1 -- 172.21.15.102:0/2185009606 learned_addr learned my addr 172.21.15.102:0/2185009606 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd19d9b640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108420 0x7fdd1c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1ad9d640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 0x7fdd1c19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1a59c640 1 -- 172.21.15.102:0/2185009606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108420 msgr2=0x7fdd1c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.807+0000 7fdd1a59c640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108420 0x7fdd1c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd1a59c640 1 -- 172.21.15.102:0/2185009606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 msgr2=0x7fdd1c19bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd1a59c640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 0x7fdd1c19bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:31:59.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd1a59c640 1 -- 172.21.15.102:0/2185009606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c1a6690 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd1ad9d640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 0x7fdd1c19bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd1a59c640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c920 tx=0x7fdd0c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c007c70 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c1a6980 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd0c007e10 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0188c0 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.808+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1a6ee0 con 0x7fdd1c102ae0 2024-09-21T03:31:59.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.809+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c103d60 con 0x7fdd1c102ae0 2024-09-21T03:31:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.810+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fdd0c018a80 con 0x7fdd1c102ae0 2024-09-21T03:31:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.811+0000 7fdd0b7fe640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 0x7fdd040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:31:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.811+0000 7fdd19d9b640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 0x7fdd040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:31:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.811+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7fdd0c0e78a0 con 0x7fdd1c102ae0 2024-09-21T03:31:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.812+0000 7fdd19d9b640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 0x7fdd040b8b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd10005940 tx=0x7fdd100058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:31:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:31:59.814+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd0c014030 con 0x7fdd1c102ae0 2024-09-21T03:32:00.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.017+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdd1c063800 con 0x7fdd040b65f0 2024-09-21T03:32:00.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.047+0000 7fdd0b7fe640 1 -- 172.21.15.102:0/2185009606 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdd1c063800 con 0x7fdd040b65f0 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 msgr2=0x7fdd040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 0x7fdd040b8b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdd10005940 tx=0x7fdd100058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 msgr2=0x7fdd1c19b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c920 tx=0x7fdd0c00cde0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 shutdown_connections 2024-09-21T03:32:00.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd040b65f0 0x7fdd040b8b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1c108d70 0x7fdd1c19bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd1c108420 0x7fdd1c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 --2- 172.21.15.102:0/2185009606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd1c102ae0 0x7fdd1c19b460 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 >> 172.21.15.102:0/2185009606 conn(0x7fdd1c079770 msgr2=0x7fdd1c106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 shutdown_connections 2024-09-21T03:32:00.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:00.049+0000 7fdd20d8e640 1 -- 172.21.15.102:0/2185009606 wait complete. 2024-09-21T03:32:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:00 smithi102 ceph-mon[31392]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:00 smithi102 ceph-mon[31392]: pgmap v273: 97 pgs: 97 active+clean; 589 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T03:32:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:00 smithi148 ceph-mon[34651]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:00 smithi148 ceph-mon[34651]: pgmap v273: 97 pgs: 97 active+clean; 589 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T03:32:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:00 smithi121 ceph-mon[34316]: from='client.14952 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:00 smithi121 ceph-mon[34316]: pgmap v273: 97 pgs: 97 active+clean; 589 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T03:32:00.814 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T03:32:01.061 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:01.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 -- 172.21.15.102:0/1331336859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 msgr2=0x7ff8ec103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 --2- 172.21.15.102:0/1331336859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec103fa0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009ca0 tx=0x7ff8dc02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 -- 172.21.15.102:0/1331336859 shutdown_connections 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 --2- 172.21.15.102:0/1331336859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ec109e20 0x7ff8ec110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 --2- 172.21.15.102:0/1331336859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec1094d0 0x7ff8ec1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 --2- 172.21.15.102:0/1331336859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec103fa0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 -- 172.21.15.102:0/1331336859 >> 172.21.15.102:0/1331336859 conn(0x7ff8ec0ff600 msgr2=0x7ff8ec101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 -- 172.21.15.102:0/1331336859 shutdown_connections 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 -- 172.21.15.102:0/1331336859 wait complete. 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.550+0000 7ff8f220a640 1 Processor -- start 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 -- start start 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ec1094d0 0x7ff8ec19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:01.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec109e20 0x7ff8ec19ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec113c90 con 0x7ff8ec103b90 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec113b10 con 0x7ff8ec109e20 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8f220a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec113e10 con 0x7ff8ec1094d0 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46754/0 (socket says 172.21.15.102:46754) 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 -- 172.21.15.102:0/3733970051 learned_addr learned my addr 172.21.15.102:0/3733970051 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 -- 172.21.15.102:0/3733970051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ec1094d0 msgr2=0x7ff8ec19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ec1094d0 0x7ff8ec19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 -- 172.21.15.102:0/3733970051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec109e20 msgr2=0x7ff8ec19ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8ebfff640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec109e20 0x7ff8ec19ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec109e20 0x7ff8ec19ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 -- 172.21.15.102:0/3733970051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ec1a0650 con 0x7ff8ec103b90 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.551+0000 7ff8eb7fe640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc006010 tx=0x7ff8dc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.552+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc004040 con 0x7ff8ec103b90 2024-09-21T03:32:01.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.552+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ec1a08e0 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.552+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8dc0046b0 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.552+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc03b400 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.552+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ec1a70a0 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.553+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ec104020 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.554+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7ff8dc030700 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.555+0000 7ff8e8ff9640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 0x7ff8d40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.555+0000 7ff8eaffd640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 0x7ff8d40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.555+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7ff8dc108a00 con 0x7ff8ec103b90 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.556+0000 7ff8eaffd640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 0x7ff8d40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec109080 tx=0x7ff8e0006c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:01.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.558+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8dc0cf150 con 0x7ff8ec103b90 2024-09-21T03:32:01.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.763+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7ff8ec063800 con 0x7ff8d40b65f0 2024-09-21T03:32:01.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.768+0000 7ff8e8ff9640 1 -- 172.21.15.102:0/3733970051 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7ff8ec063800 con 0x7ff8d40b65f0 2024-09-21T03:32:01.770 INFO:teuthology.orchestra.run.smithi102.stdout:/volumes/qa/sv_1/0cee5881-3719-455f-8534-f9c9b7a77e8e 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 msgr2=0x7ff8d40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 0x7ff8d40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec109080 tx=0x7ff8e0006c90 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 msgr2=0x7ff8ec19a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc006010 tx=0x7ff8dc003ba0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 shutdown_connections 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8d40b65f0 0x7ff8d40b8b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8ec109e20 0x7ff8ec19ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8ec1094d0 0x7ff8ec19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 --2- 172.21.15.102:0/3733970051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8ec103b90 0x7ff8ec19a6e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.770+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 >> 172.21.15.102:0/3733970051 conn(0x7ff8ec0ff600 msgr2=0x7ff8ec101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.771+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 shutdown_connections 2024-09-21T03:32:01.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:01.771+0000 7ff8f220a640 1 -- 172.21.15.102:0/3733970051 wait complete. 2024-09-21T03:32:02.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:32:02.771 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1859991528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105b70 msgr2=0x7f0c9c10f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1859991528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105b70 0x7f0c9c10f5e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c94009ca0 tx=0x7f0c9402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1859991528 shutdown_connections 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1859991528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105b70 0x7f0c9c10f5e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1859991528 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105220 0x7f0c9c105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1859991528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1859991528 >> 172.21.15.102:0/1859991528 conn(0x7f0c9c079ec0 msgr2=0x7f0c9c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1859991528 shutdown_connections 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.198+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1859991528 wait complete. 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 Processor -- start 2024-09-21T03:32:03.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 -- start start 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105b70 0x7f0c9c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c112bb0 con 0x7f0c9c105220 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c112a30 con 0x7f0c9c103210 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0ca1d62640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9c112d30 con 0x7f0c9c105b70 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0c9affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.199+0000 7f0c9affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46772/0 (socket says 172.21.15.102:46772) 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 -- 172.21.15.102:0/1133133062 learned_addr learned my addr 172.21.15.102:0/1133133062 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9b7fe640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9bfff640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105b70 0x7f0c9c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 -- 172.21.15.102:0/1133133062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105b70 msgr2=0x7f0c9c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105b70 0x7f0c9c19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 -- 172.21.15.102:0/1133133062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 msgr2=0x7f0c9c199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 -- 172.21.15.102:0/1133133062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9c19f470 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9b7fe640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c9affd640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d750 tx=0x7f0c9000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90017070 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9c19f760 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0c900054f0 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90004d90 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.200+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9c1a5ec0 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.201+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c9c103620 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.203+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f0c90004f30 con 0x7f0c9c105220 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.204+0000 7f0c98ff9640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 0x7f0c840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.204+0000 7f0c9b7fe640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 0x7f0c840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:03.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.204+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8194+0+0 (secure 0 0 0) 0x7f0c900e73e0 con 0x7f0c9c105220 2024-09-21T03:32:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.204+0000 7f0c9b7fe640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 0x7f0c840b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009b40 tx=0x7f0c8c005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:03.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.207+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c900adb30 con 0x7f0c9c105220 2024-09-21T03:32:03.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.422+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c9c10aba0 con 0x7f0c9c105220 2024-09-21T03:32:03.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.422+0000 7f0c98ff9640 1 -- 172.21.15.102:0/1133133062 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7f0c900b1f10 con 0x7f0c9c105220 2024-09-21T03:32:03.424 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:03.425 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:32:03.425 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 msgr2=0x7f0c840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 0x7f0c840b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c009b40 tx=0x7f0c8c005e50 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 msgr2=0x7f0c9c199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000d750 tx=0x7f0c9000dc10 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 shutdown_connections 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0c840b65f0 0x7f0c840b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c9c105220 0x7f0c9c199aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0c9c105b70 0x7f0c9c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 --2- 172.21.15.102:0/1133133062 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0c9c103210 0x7f0c9c199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.424+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 >> 172.21.15.102:0/1133133062 conn(0x7f0c9c079ec0 msgr2=0x7f0c9c106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:03.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.425+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 shutdown_connections 2024-09-21T03:32:03.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:03.425+0000 7f0ca1d62640 1 -- 172.21.15.102:0/1133133062 wait complete. 2024-09-21T03:32:03.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:03 smithi102 ceph-mon[31392]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:03.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:03 smithi102 ceph-mon[31392]: pgmap v274: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T03:32:03.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:03 smithi121 ceph-mon[34316]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:03 smithi121 ceph-mon[34316]: pgmap v274: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T03:32:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:03 smithi148 ceph-mon[34651]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:32:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:03 smithi148 ceph-mon[34651]: pgmap v274: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-09-21T03:32:04.247 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:32:04.504 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1133133062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-21T03:32:04.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.626 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1133133062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]} : dispatch 2024-09-21T03:32:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1133133062' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:32:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-21T03:32:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]} : dispatch 2024-09-21T03:32:04.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- 172.21.15.102:0/3865872052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 msgr2=0x7f43ec102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:05.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 --2- 172.21.15.102:0/3865872052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec102f20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009900 tx=0x7f43dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- 172.21.15.102:0/3865872052 shutdown_connections 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 --2- 172.21.15.102:0/3865872052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 --2- 172.21.15.102:0/3865872052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec108450 0x7f43ec108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 --2- 172.21.15.102:0/3865872052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec102f20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- 172.21.15.102:0/3865872052 >> 172.21.15.102:0/3865872052 conn(0x7f43ec0796d0 msgr2=0x7f43ec079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- 172.21.15.102:0/3865872052 shutdown_connections 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- 172.21.15.102:0/3865872052 wait complete. 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 Processor -- start 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.970+0000 7f43f2363640 1 -- start start 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:05.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec108450 0x7f43ec19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec19bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112c00 con 0x7f43ec102b10 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112a80 con 0x7f43ec108450 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f43ec112d80 con 0x7f43ec108da0 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38564/0 (socket says 172.21.15.102:38564) 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 -- 172.21.15.102:0/2420207615 learned_addr learned my addr 172.21.15.102:0/2420207615 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f0900640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec19bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:05.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 -- 172.21.15.102:0/2420207615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 msgr2=0x7f43ec19bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec19bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 -- 172.21.15.102:0/2420207615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec108450 msgr2=0x7f43ec19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec108450 0x7f43ec19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 -- 172.21.15.102:0/2420207615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ec1a67c0 con 0x7f43ec102b10 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f0900640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec19bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43ebfff640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f43dc005ab0 tx=0x7f43dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc03f030 con 0x7f43ec102b10 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.971+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ec1a6a50 con 0x7f43ec102b10 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.972+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f43dc003cd0 con 0x7f43ec102b10 2024-09-21T03:32:05.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.972+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43dc035070 con 0x7f43ec102b10 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.972+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ec1a6f80 con 0x7f43ec102b10 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.972+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec102f20 con 0x7f43ec102b10 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.974+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f43dc042030 con 0x7f43ec102b10 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.975+0000 7f43e9ffb640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 0x7f43d80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.975+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 0x7f43d80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.975+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8484+0+0 (secure 0 0 0) 0x7f43dc107e30 con 0x7f43ec102b10 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.975+0000 7f43e3fff640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 0x7f43d80b8b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005fd0 tx=0x7f43d4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:05.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:04.978+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43dc0ce460 con 0x7f43ec102b10 2024-09-21T03:32:05.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.155+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43ec02e640 con 0x7f43ec102b10 2024-09-21T03:32:05.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.157+0000 7f43e9ffb640 1 -- 172.21.15.102:0/2420207615 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+23198 (secure 0 0 0) 0x7f43dc0d2840 con 0x7f43ec102b10 2024-09-21T03:32:05.159 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:05.159 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":78,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:32:04.276908+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 msgr2=0x7f43d80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 0x7f43d80b8b30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43d4005fd0 tx=0x7f43d4005850 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 msgr2=0x7f43ec19b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f43dc005ab0 tx=0x7f43dc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 shutdown_connections 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43d80b6620 0x7f43d80b8b30 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43ec108da0 0x7f43ec19bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43ec108450 0x7f43ec19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 --2- 172.21.15.102:0/2420207615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43ec102b10 0x7f43ec19b530 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 >> 172.21.15.102:0/2420207615 conn(0x7f43ec0796d0 msgr2=0x7f43ec1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:05.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 shutdown_connections 2024-09-21T03:32:05.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:05.160+0000 7f43f2363640 1 -- 172.21.15.102:0/2420207615 wait complete. 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: pgmap v275: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T03:32:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-21T03:32:05.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:32:05.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:05 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2420207615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: pgmap v275: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:32:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:05 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2420207615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: pgmap v275: 97 pgs: 97 active+clean; 625 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 5.7 KiB/s wr, 10 op/s 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 6]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 6]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 8]}]': finished 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T03:32:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:05 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2420207615' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:05.861 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:32:05.861 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:06.103 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:06.502 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:06 smithi102 ceph-mon[31392]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 -- 172.21.15.102:0/1427357741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 msgr2=0x7ff19410d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 --2- 172.21.15.102:0/1427357741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19410d860 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff188009900 tx=0x7ff18802a410 comp rx=0 tx=0).stop 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 -- 172.21.15.102:0/1427357741 shutdown_connections 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 --2- 172.21.15.102:0/1427357741 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19410d860 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 --2- 172.21.15.102:0/1427357741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff19410de20 0x7ff194110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 --2- 172.21.15.102:0/1427357741 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff1941049c0 0x7ff194104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 -- 172.21.15.102:0/1427357741 >> 172.21.15.102:0/1427357741 conn(0x7ff194079710 msgr2=0x7ff194079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 -- 172.21.15.102:0/1427357741 shutdown_connections 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.588+0000 7ff199bef640 1 -- 172.21.15.102:0/1427357741 wait complete. 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 Processor -- start 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 -- start start 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1941049c0 0x7ff19419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff19410de20 0x7ff19419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff194113ba0 con 0x7ff194105310 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff194113a20 con 0x7ff1941049c0 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.589+0000 7ff199bef640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff194113d20 con 0x7ff19410de20 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38578/0 (socket says 172.21.15.102:38578) 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 -- 172.21.15.102:0/2094724044 learned_addr learned my addr 172.21.15.102:0/2094724044 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:06.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff1937fe640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1941049c0 0x7ff19419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff193fff640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff19410de20 0x7ff19419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 -- 172.21.15.102:0/2094724044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff19410de20 msgr2=0x7ff19419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff19410de20 0x7ff19419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 -- 172.21.15.102:0/2094724044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1941049c0 msgr2=0x7ff19419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1941049c0 0x7ff19419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 -- 172.21.15.102:0/2094724044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1941a04c0 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff192ffd640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff188005940 tx=0x7ff1880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18803f030 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff1880318f0 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1941a0750 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff188035070 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.590+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1941a6f10 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.591+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19406c280 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.594+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7ff188042030 con 0x7ff194105310 2024-09-21T03:32:06.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.594+0000 7ff190ff9640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 0x7ff17c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.595+0000 7ff1937fe640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 0x7ff17c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.595+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7ff188107c10 con 0x7ff194105310 2024-09-21T03:32:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.595+0000 7ff1937fe640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 0x7ff17c0b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff184009bd0 tx=0x7ff184005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:06.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.598+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff1880d2620 con 0x7ff194105310 2024-09-21T03:32:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:06 smithi148 ceph-mon[34651]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:32:06.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.774+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff194108050 con 0x7ff17c0b65f0 2024-09-21T03:32:06.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.781+0000 7ff190ff9640 1 -- 172.21.15.102:0/2094724044 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258834 (secure 0 0 0) 0x7ff194108050 con 0x7ff17c0b65f0 2024-09-21T03:32:06.785 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:06 smithi121 ceph-mon[34316]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T03:32:06.788 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:06.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 msgr2=0x7ff17c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:06.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 0x7ff17c0b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff184009bd0 tx=0x7ff184005f90 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 msgr2=0x7ff19419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff188005940 tx=0x7ff1880042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 shutdown_connections 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff17c0b65f0 0x7ff17c0b8b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff194105310 0x7ff19419aaf0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff19410de20 0x7ff19419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 --2- 172.21.15.102:0/2094724044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1941049c0 0x7ff19419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 >> 172.21.15.102:0/2094724044 conn(0x7ff194079710 msgr2=0x7ff194107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.784+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 shutdown_connections 2024-09-21T03:32:06.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:06.785+0000 7ff199bef640 1 -- 172.21.15.102:0/2094724044 wait complete. 2024-09-21T03:32:07.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:07 smithi102 ceph-mon[31392]: pgmap v278: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.6 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%) 2024-09-21T03:32:07.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:07 smithi102 ceph-mon[31392]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2024-09-21T03:32:07.530 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T03:32:06.223907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645934,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":185,"num_read_kb":178,"num_write":277,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355364,"kb_used_data":10252,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124586460,"statfs":{"total":1151940427776,"available":1151576535040,"internally_reserved":0,"allocated":10498048,"data_stored":6854135,"data_compressed":130630,"data_compressed_allocated":172032,"data_compressed_original":1843200,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":43353,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":76,"num_write":23,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002237"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288975+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:04.288975+0000","last_peered":"2024-09-21T03:32:04.288975+0000","last_clean":"2024-09-21T03:32:04.288975+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:04.288975+0000","last_undegraded":"2024-09-21T03:32:04.288975+0000","last_fullsized":"2024-09-21T03:32:04.288975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508440+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:31:41.508440+0000","last_peered":"2024-09-21T03:31:41.508440+0000","last_clean":"2024-09-21T03:31:41.508440+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:31:41.508440+0000","last_undegraded":"2024-09-21T03:31:41.508440+0000","last_fullsized":"2024-09-21T03:31:41.508440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509622+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:31:41.509622+0000","last_peered":"2024-09-21T03:31:41.509622+0000","last_clean":"2024-09-21T03:31:41.509622+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:31:41.509622+0000","last_undegraded":"2024-09-21T03:31:41.509622+0000","last_fullsized":"2024-09-21T03:31:41.509622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508553+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:31:41.508553+0000","last_peered":"2024-09-21T03:31:41.508553+0000","last_clean":"2024-09-21T03:31:41.508553+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:31:41.508553+0000","last_undegraded":"2024-09-21T03:31:41.508553+0000","last_fullsized":"2024-09-21T03:31:41.508553+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509274+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:31:41.509274+0000","last_peered":"2024-09-21T03:31:41.509274+0000","last_clean":"2024-09-21T03:31:41.509274+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:31:41.509274+0000","last_undegraded":"2024-09-21T03:31:41.509274+0000","last_fullsized":"2024-09-21T03:31:41.509274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492148+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:31:41.492148+0000","last_peered":"2024-09-21T03:31:41.492148+0000","last_clean":"2024-09-21T03:31:41.492148+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:31:41.492148+0000","last_undegraded":"2024-09-21T03:31:41.492148+0000","last_fullsized":"2024-09-21T03:31:41.492148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509522+0000","last_change":"2024-09-21T03:31:40.495831+0000","last_active":"2024-09-21T03:31:41.509522+0000","last_peered":"2024-09-21T03:31:41.509522+0000","last_clean":"2024-09-21T03:31:41.509522+0000","last_became_active":"2024-09-21T03:31:40.495475+0000","last_became_peered":"2024-09-21T03:31:40.495475+0000","last_unstale":"2024-09-21T03:31:41.509522+0000","last_undegraded":"2024-09-21T03:31:41.509522+0000","last_fullsized":"2024-09-21T03:31:41.509522+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:44.212293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509603+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:31:41.509603+0000","last_peered":"2024-09-21T03:31:41.509603+0000","last_clean":"2024-09-21T03:31:41.509603+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:31:41.509603+0000","last_undegraded":"2024-09-21T03:31:41.509603+0000","last_fullsized":"2024-09-21T03:31:41.509603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.507880+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:31:41.507880+0000","last_peered":"2024-09-21T03:31:41.507880+0000","last_clean":"2024-09-21T03:31:41.507880+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:31:41.507880+0000","last_undegraded":"2024-09-21T03:31:41.507880+0000","last_fullsized":"2024-09-21T03:31:41.507880+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508486+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:31:41.508486+0000","last_peered":"2024-09-21T03:31:41.508486+0000","last_clean":"2024-09-21T03:31:41.508486+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:31:41.508486+0000","last_undegraded":"2024-09-21T03:31:41.508486+0000","last_fullsized":"2024-09-21T03:31:41.508486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509249+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:31:41.509249+0000","last_peered":"2024-09-21T03:31:41.509249+0000","last_clean":"2024-09-21T03:31:41.509249+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:31:41.509249+0000","last_undegraded":"2024-09-21T03:31:41.509249+0000","last_fullsized":"2024-09-21T03:31:41.509249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.507416+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:31:41.507416+0000","last_peered":"2024-09-21T03:31:41.507416+0000","last_clean":"2024-09-21T03:31:41.507416+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:31:41.507416+0000","last_undegraded":"2024-09-21T03:31:41.507416+0000","last_fullsized":"2024-09-21T03:31:41.507416+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.289109+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:04.289109+0000","last_peered":"2024-09-21T03:32:04.289109+0000","last_clean":"2024-09-21T03:32:04.289109+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:04.289109+0000","last_undegraded":"2024-09-21T03:32:04.289109+0000","last_fullsized":"2024-09-21T03:32:04.289109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:41.489103+0000","last_change":"2024-09-21T03:32:04.288889+0000","last_active":"2024-09-21T03:32:04.288889+0000","last_peered":"2024-09-21T03:31:41.489103+0000","last_clean":"2024-09-21T03:31:41.489103+0000","last_became_active":"2024-09-21T03:31:40.491623+0000","last_became_peered":"2024-09-21T03:31:40.491623+0000","last_unstale":"2024-09-21T03:31:41.489103+0000","last_undegraded":"2024-09-21T03:31:41.489103+0000","last_fullsized":"2024-09-21T03:31:41.489103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508008+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:31:41.508008+0000","last_peered":"2024-09-21T03:31:41.508008+0000","last_clean":"2024-09-21T03:31:41.508008+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:31:41.508008+0000","last_undegraded":"2024-09-21T03:31:41.508008+0000","last_fullsized":"2024-09-21T03:31:41.508008+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508045+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:31:41.508045+0000","last_peered":"2024-09-21T03:31:41.508045+0000","last_clean":"2024-09-21T03:31:41.508045+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:31:41.508045+0000","last_undegraded":"2024-09-21T03:31:41.508045+0000","last_fullsized":"2024-09-21T03:31:41.508045+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492165+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:31:41.492165+0000","last_peered":"2024-09-21T03:31:41.492165+0000","last_clean":"2024-09-21T03:31:41.492165+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:31:41.492165+0000","last_undegraded":"2024-09-21T03:31:41.492165+0000","last_fullsized":"2024-09-21T03:31:41.492165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294281+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:04.294281+0000","last_peered":"2024-09-21T03:32:04.294281+0000","last_clean":"2024-09-21T03:32:04.294281+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:04.294281+0000","last_undegraded":"2024-09-21T03:32:04.294281+0000","last_fullsized":"2024-09-21T03:32:04.294281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492799+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:31:41.492799+0000","last_peered":"2024-09-21T03:31:41.492799+0000","last_clean":"2024-09-21T03:31:41.492799+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:31:41.492799+0000","last_undegraded":"2024-09-21T03:31:41.492799+0000","last_fullsized":"2024-09-21T03:31:41.492799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288947+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:04.288947+0000","last_peered":"2024-09-21T03:32:04.288947+0000","last_clean":"2024-09-21T03:32:04.288947+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:04.288947+0000","last_undegraded":"2024-09-21T03:32:04.288947+0000","last_fullsized":"2024-09-21T03:32:04.288947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508750+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:31:41.508750+0000","last_peered":"2024-09-21T03:31:41.508750+0000","last_clean":"2024-09-21T03:31:41.508750+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:31:41.508750+0000","last_undegraded":"2024-09-21T03:31:41.508750+0000","last_fullsized":"2024-09-21T03:31:41.508750+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509825+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:31:41.509825+0000","last_peered":"2024-09-21T03:31:41.509825+0000","last_clean":"2024-09-21T03:31:41.509825+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:31:41.509825+0000","last_undegraded":"2024-09-21T03:31:41.509825+0000","last_fullsized":"2024-09-21T03:31:41.509825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.287789+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:04.287789+0000","last_peered":"2024-09-21T03:32:04.287789+0000","last_clean":"2024-09-21T03:32:04.287789+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:04.287789+0000","last_undegraded":"2024-09-21T03:32:04.287789+0000","last_fullsized":"2024-09-21T03:32:04.287789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509652+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:31:41.509652+0000","last_peered":"2024-09-21T03:31:41.509652+0000","last_clean":"2024-09-21T03:31:41.509652+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:31:41.509652+0000","last_undegraded":"2024-09-21T03:31:41.509652+0000","last_fullsized":"2024-09-21T03:31:41.509652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294668+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:04.294668+0000","last_peered":"2024-09-21T03:32:04.294668+0000","last_clean":"2024-09-21T03:32:04.294668+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:04.294668+0000","last_undegraded":"2024-09-21T03:32:04.294668+0000","last_fullsized":"2024-09-21T03:32:04.294668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294582+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:04.294582+0000","last_peered":"2024-09-21T03:32:04.294582+0000","last_clean":"2024-09-21T03:32:04.294582+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:04.294582+0000","last_undegraded":"2024-09-21T03:32:04.294582+0000","last_fullsized":"2024-09-21T03:32:04.294582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"activating+degraded","last_fresh":"2024-09-21T03:32:05.288234+0000","last_change":"2024-09-21T03:32:05.289962+0000","last_active":"2024-09-21T03:32:04.287803+0000","last_peered":"2024-09-21T03:31:50.319328+0000","last_clean":"2024-09-21T03:31:50.319328+0000","last_became_active":"2024-09-21T03:31:38.478377+0000","last_became_peered":"2024-09-21T03:31:38.478377+0000","last_unstale":"2024-09-21T03:32:05.288234+0000","last_undegraded":"2024-09-21T03:32:05.288234+0000","last_fullsized":"2024-09-21T03:32:05.288234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","6","8"],"object_location_counts":[{"shards":"6,10","objects":1}],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:50.317862+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:31:50.317862+0000","last_peered":"2024-09-21T03:31:50.317862+0000","last_clean":"2024-09-21T03:31:50.317862+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:31:50.317862+0000","last_undegraded":"2024-09-21T03:31:50.317862+0000","last_fullsized":"2024-09-21T03:31:50.317862+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492232+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:31:41.492232+0000","last_peered":"2024-09-21T03:31:41.492232+0000","last_clean":"2024-09-21T03:31:41.492232+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:31:41.492232+0000","last_undegraded":"2024-09-21T03:31:41.492232+0000","last_fullsized":"2024-09-21T03:31:41.492232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294708+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:04.294708+0000","last_peered":"2024-09-21T03:32:04.294708+0000","last_clean":"2024-09-21T03:32:04.294708+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:04.294708+0000","last_undegraded":"2024-09-21T03:32:04.294708+0000","last_fullsized":"2024-09-21T03:32:04.294708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288761+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:05.288761+0000","last_peered":"2024-09-21T03:32:05.288761+0000","last_clean":"2024-09-21T03:32:05.288761+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:05.288761+0000","last_undegraded":"2024-09-21T03:32:05.288761+0000","last_fullsized":"2024-09-21T03:32:05.288761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508860+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:31:41.508860+0000","last_peered":"2024-09-21T03:31:41.508860+0000","last_clean":"2024-09-21T03:31:41.508860+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:31:41.508860+0000","last_undegraded":"2024-09-21T03:31:41.508860+0000","last_fullsized":"2024-09-21T03:31:41.508860+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.304885+0000","last_change":"2024-09-21T03:31:38.477843+0000","last_active":"2024-09-21T03:31:49.304885+0000","last_peered":"2024-09-21T03:31:49.304885+0000","last_clean":"2024-09-21T03:31:49.304885+0000","last_became_active":"2024-09-21T03:31:38.477437+0000","last_became_peered":"2024-09-21T03:31:38.477437+0000","last_unstale":"2024-09-21T03:31:49.304885+0000","last_undegraded":"2024-09-21T03:31:49.304885+0000","last_fullsized":"2024-09-21T03:31:49.304885+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.467989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510304+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:31:41.510304+0000","last_peered":"2024-09-21T03:31:41.510304+0000","last_clean":"2024-09-21T03:31:41.510304+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:31:41.510304+0000","last_undegraded":"2024-09-21T03:31:41.510304+0000","last_fullsized":"2024-09-21T03:31:41.510304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295164+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:04.295164+0000","last_peered":"2024-09-21T03:32:04.295164+0000","last_clean":"2024-09-21T03:32:04.295164+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:04.295164+0000","last_undegraded":"2024-09-21T03:32:04.295164+0000","last_fullsized":"2024-09-21T03:32:04.295164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508550+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:31:41.508550+0000","last_peered":"2024-09-21T03:31:41.508550+0000","last_clean":"2024-09-21T03:31:41.508550+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:31:41.508550+0000","last_undegraded":"2024-09-21T03:31:41.508550+0000","last_fullsized":"2024-09-21T03:31:41.508550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'22","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288518+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:05.288518+0000","last_peered":"2024-09-21T03:32:05.288518+0000","last_clean":"2024-09-21T03:32:05.288518+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:05.288518+0000","last_undegraded":"2024-09-21T03:32:05.288518+0000","last_fullsized":"2024-09-21T03:32:05.288518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":66,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510185+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:31:41.510185+0000","last_peered":"2024-09-21T03:31:41.510185+0000","last_clean":"2024-09-21T03:31:41.510185+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:31:41.510185+0000","last_undegraded":"2024-09-21T03:31:41.510185+0000","last_fullsized":"2024-09-21T03:31:41.510185+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.507126+0000","last_change":"2024-09-21T03:31:40.487349+0000","last_active":"2024-09-21T03:31:41.507126+0000","last_peered":"2024-09-21T03:31:41.507126+0000","last_clean":"2024-09-21T03:31:41.507126+0000","last_became_active":"2024-09-21T03:31:40.487007+0000","last_became_peered":"2024-09-21T03:31:40.487007+0000","last_unstale":"2024-09-21T03:31:41.507126+0000","last_undegraded":"2024-09-21T03:31:41.507126+0000","last_fullsized":"2024-09-21T03:31:41.507126+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:07:25.780012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294423+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:04.294423+0000","last_peered":"2024-09-21T03:32:04.294423+0000","last_clean":"2024-09-21T03:32:04.294423+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:04.294423+0000","last_undegraded":"2024-09-21T03:32:04.294423+0000","last_fullsized":"2024-09-21T03:32:04.294423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509696+0000","last_change":"2024-09-21T03:31:40.489253+0000","last_active":"2024-09-21T03:31:41.509696+0000","last_peered":"2024-09-21T03:31:41.509696+0000","last_clean":"2024-09-21T03:31:41.509696+0000","last_became_active":"2024-09-21T03:31:40.488400+0000","last_became_peered":"2024-09-21T03:31:40.488400+0000","last_unstale":"2024-09-21T03:31:41.509696+0000","last_undegraded":"2024-09-21T03:31:41.509696+0000","last_fullsized":"2024-09-21T03:31:41.509696+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:56.701472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294052+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:04.294052+0000","last_peered":"2024-09-21T03:32:04.294052+0000","last_clean":"2024-09-21T03:32:04.294052+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:04.294052+0000","last_undegraded":"2024-09-21T03:32:04.294052+0000","last_fullsized":"2024-09-21T03:32:04.294052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509401+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:31:41.509401+0000","last_peered":"2024-09-21T03:31:41.509401+0000","last_clean":"2024-09-21T03:31:41.509401+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:31:41.509401+0000","last_undegraded":"2024-09-21T03:31:41.509401+0000","last_fullsized":"2024-09-21T03:31:41.509401+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":35,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:50.320180+0000","last_change":"2024-09-21T03:31:39.129325+0000","last_active":"2024-09-21T03:31:50.320180+0000","last_peered":"2024-09-21T03:31:50.320180+0000","last_clean":"2024-09-21T03:31:50.320180+0000","last_became_active":"2024-09-21T03:31:39.128895+0000","last_became_peered":"2024-09-21T03:31:39.128895+0000","last_unstale":"2024-09-21T03:31:50.320180+0000","last_undegraded":"2024-09-21T03:31:50.320180+0000","last_fullsized":"2024-09-21T03:31:50.320180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:23.909677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294405+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:04.294405+0000","last_peered":"2024-09-21T03:32:04.294405+0000","last_clean":"2024-09-21T03:32:04.294405+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:04.294405+0000","last_undegraded":"2024-09-21T03:32:04.294405+0000","last_fullsized":"2024-09-21T03:32:04.294405+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:51.324853+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:31:51.324853+0000","last_peered":"2024-09-21T03:31:51.324853+0000","last_clean":"2024-09-21T03:31:51.324853+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:31:51.324853+0000","last_undegraded":"2024-09-21T03:31:51.324853+0000","last_fullsized":"2024-09-21T03:31:51.324853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288751+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:04.288751+0000","last_peered":"2024-09-21T03:32:04.288751+0000","last_clean":"2024-09-21T03:32:04.288751+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:04.288751+0000","last_undegraded":"2024-09-21T03:32:04.288751+0000","last_fullsized":"2024-09-21T03:32:04.288751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.515869+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:31:41.515869+0000","last_peered":"2024-09-21T03:31:41.515869+0000","last_clean":"2024-09-21T03:31:41.515869+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:31:41.515869+0000","last_undegraded":"2024-09-21T03:31:41.515869+0000","last_fullsized":"2024-09-21T03:31:41.515869+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510751+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:31:41.510751+0000","last_peered":"2024-09-21T03:31:41.510751+0000","last_clean":"2024-09-21T03:31:41.510751+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:31:41.510751+0000","last_undegraded":"2024-09-21T03:31:41.510751+0000","last_fullsized":"2024-09-21T03:31:41.510751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295189+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:04.295189+0000","last_peered":"2024-09-21T03:32:04.295189+0000","last_clean":"2024-09-21T03:32:04.295189+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:04.295189+0000","last_undegraded":"2024-09-21T03:32:04.295189+0000","last_fullsized":"2024-09-21T03:32:04.295189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":15,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510060+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:31:41.510060+0000","last_peered":"2024-09-21T03:31:41.510060+0000","last_clean":"2024-09-21T03:31:41.510060+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:31:41.510060+0000","last_undegraded":"2024-09-21T03:31:41.510060+0000","last_fullsized":"2024-09-21T03:31:41.510060+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510917+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:31:41.510917+0000","last_peered":"2024-09-21T03:31:41.510917+0000","last_clean":"2024-09-21T03:31:41.510917+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:31:41.510917+0000","last_undegraded":"2024-09-21T03:31:41.510917+0000","last_fullsized":"2024-09-21T03:31:41.510917+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":93,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510222+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:31:41.510222+0000","last_peered":"2024-09-21T03:31:41.510222+0000","last_clean":"2024-09-21T03:31:41.510222+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:31:41.510222+0000","last_undegraded":"2024-09-21T03:31:41.510222+0000","last_fullsized":"2024-09-21T03:31:41.510222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294112+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:04.294112+0000","last_peered":"2024-09-21T03:32:04.294112+0000","last_clean":"2024-09-21T03:32:04.294112+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:04.294112+0000","last_undegraded":"2024-09-21T03:32:04.294112+0000","last_fullsized":"2024-09-21T03:32:04.294112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492377+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:31:41.492377+0000","last_peered":"2024-09-21T03:31:41.492377+0000","last_clean":"2024-09-21T03:31:41.492377+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:31:41.492377+0000","last_undegraded":"2024-09-21T03:31:41.492377+0000","last_fullsized":"2024-09-21T03:31:41.492377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:50.319339+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:31:50.319339+0000","last_peered":"2024-09-21T03:31:50.319339+0000","last_clean":"2024-09-21T03:31:50.319339+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:31:50.319339+0000","last_undegraded":"2024-09-21T03:31:50.319339+0000","last_fullsized":"2024-09-21T03:31:50.319339+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.507390+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:31:41.507390+0000","last_peered":"2024-09-21T03:31:41.507390+0000","last_clean":"2024-09-21T03:31:41.507390+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:31:41.507390+0000","last_undegraded":"2024-09-21T03:31:41.507390+0000","last_fullsized":"2024-09-21T03:31:41.507390+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:59.339400+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:31:59.339400+0000","last_peered":"2024-09-21T03:31:59.339400+0000","last_clean":"2024-09-21T03:31:59.339400+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:31:59.339400+0000","last_undegraded":"2024-09-21T03:31:59.339400+0000","last_fullsized":"2024-09-21T03:31:59.339400+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294370+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:04.294370+0000","last_peered":"2024-09-21T03:32:04.294370+0000","last_clean":"2024-09-21T03:32:04.294370+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:04.294370+0000","last_undegraded":"2024-09-21T03:32:04.294370+0000","last_fullsized":"2024-09-21T03:32:04.294370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":20,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510449+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:31:41.510449+0000","last_peered":"2024-09-21T03:31:41.510449+0000","last_clean":"2024-09-21T03:31:41.510449+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:31:41.510449+0000","last_undegraded":"2024-09-21T03:31:41.510449+0000","last_fullsized":"2024-09-21T03:31:41.510449+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":2,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-21T03:31:42.300399+0000","last_change":"2024-09-21T03:32:05.072959+0000","last_active":"2024-09-21T03:32:05.072959+0000","last_peered":"2024-09-21T03:31:42.300399+0000","last_clean":"2024-09-21T03:31:42.300399+0000","last_became_active":"2024-09-21T03:31:39.127799+0000","last_became_peered":"2024-09-21T03:31:39.127799+0000","last_unstale":"2024-09-21T03:31:42.300399+0000","last_undegraded":"2024-09-21T03:31:42.300399+0000","last_fullsized":"2024-09-21T03:31:42.300399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509014+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:31:41.509014+0000","last_peered":"2024-09-21T03:31:41.509014+0000","last_clean":"2024-09-21T03:31:41.509014+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:31:41.509014+0000","last_undegraded":"2024-09-21T03:31:41.509014+0000","last_fullsized":"2024-09-21T03:31:41.509014+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'8","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294364+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:05.294364+0000","last_peered":"2024-09-21T03:32:05.294364+0000","last_clean":"2024-09-21T03:32:05.294364+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:05.294364+0000","last_undegraded":"2024-09-21T03:32:05.294364+0000","last_fullsized":"2024-09-21T03:32:05.294364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.493033+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:31:41.493033+0000","last_peered":"2024-09-21T03:31:41.493033+0000","last_clean":"2024-09-21T03:31:41.493033+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:31:41.493033+0000","last_undegraded":"2024-09-21T03:31:41.493033+0000","last_fullsized":"2024-09-21T03:31:41.493033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.293022+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:04.293022+0000","last_peered":"2024-09-21T03:32:04.293022+0000","last_clean":"2024-09-21T03:32:04.293022+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:04.293022+0000","last_undegraded":"2024-09-21T03:32:04.293022+0000","last_fullsized":"2024-09-21T03:32:04.293022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509909+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:31:41.509909+0000","last_peered":"2024-09-21T03:31:41.509909+0000","last_clean":"2024-09-21T03:31:41.509909+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:31:41.509909+0000","last_undegraded":"2024-09-21T03:31:41.509909+0000","last_fullsized":"2024-09-21T03:31:41.509909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.304589+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:31:49.304589+0000","last_peered":"2024-09-21T03:31:49.304589+0000","last_clean":"2024-09-21T03:31:49.304589+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:31:49.304589+0000","last_undegraded":"2024-09-21T03:31:49.304589+0000","last_fullsized":"2024-09-21T03:31:49.304589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509272+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:31:41.509272+0000","last_peered":"2024-09-21T03:31:41.509272+0000","last_clean":"2024-09-21T03:31:41.509272+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:31:41.509272+0000","last_undegraded":"2024-09-21T03:31:41.509272+0000","last_fullsized":"2024-09-21T03:31:41.509272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.304606+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:31:49.304606+0000","last_peered":"2024-09-21T03:31:49.304606+0000","last_clean":"2024-09-21T03:31:49.304606+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:31:49.304606+0000","last_undegraded":"2024-09-21T03:31:49.304606+0000","last_fullsized":"2024-09-21T03:31:49.304606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288533+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:04.288533+0000","last_peered":"2024-09-21T03:32:04.288533+0000","last_clean":"2024-09-21T03:32:04.288533+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:04.288533+0000","last_undegraded":"2024-09-21T03:32:04.288533+0000","last_fullsized":"2024-09-21T03:32:04.288533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492528+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:31:41.492528+0000","last_peered":"2024-09-21T03:31:41.492528+0000","last_clean":"2024-09-21T03:31:41.492528+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:31:41.492528+0000","last_undegraded":"2024-09-21T03:31:41.492528+0000","last_fullsized":"2024-09-21T03:31:41.492528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.305666+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:31:49.305666+0000","last_peered":"2024-09-21T03:31:49.305666+0000","last_clean":"2024-09-21T03:31:49.305666+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:31:49.305666+0000","last_undegraded":"2024-09-21T03:31:49.305666+0000","last_fullsized":"2024-09-21T03:31:49.305666+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510301+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:31:41.510301+0000","last_peered":"2024-09-21T03:31:41.510301+0000","last_clean":"2024-09-21T03:31:41.510301+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:31:41.510301+0000","last_undegraded":"2024-09-21T03:31:41.510301+0000","last_fullsized":"2024-09-21T03:31:41.510301+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:44.303931+0000","last_change":"2024-09-21T03:32:04.294831+0000","last_active":"2024-09-21T03:32:04.294831+0000","last_peered":"2024-09-21T03:31:44.303931+0000","last_clean":"2024-09-21T03:31:44.303931+0000","last_became_active":"2024-09-21T03:31:40.498283+0000","last_became_peered":"2024-09-21T03:31:40.498283+0000","last_unstale":"2024-09-21T03:31:44.303931+0000","last_undegraded":"2024-09-21T03:31:44.303931+0000","last_fullsized":"2024-09-21T03:31:44.303931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.516938+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:31:41.516938+0000","last_peered":"2024-09-21T03:31:41.516938+0000","last_clean":"2024-09-21T03:31:41.516938+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:31:41.516938+0000","last_undegraded":"2024-09-21T03:31:41.516938+0000","last_fullsized":"2024-09-21T03:31:41.516938+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508444+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:31:41.508444+0000","last_peered":"2024-09-21T03:31:41.508444+0000","last_clean":"2024-09-21T03:31:41.508444+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:31:41.508444+0000","last_undegraded":"2024-09-21T03:31:41.508444+0000","last_fullsized":"2024-09-21T03:31:41.508444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":23,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:50.316704+0000","last_change":"2024-09-21T03:31:38.475190+0000","last_active":"2024-09-21T03:31:50.316704+0000","last_peered":"2024-09-21T03:31:50.316704+0000","last_clean":"2024-09-21T03:31:50.316704+0000","last_became_active":"2024-09-21T03:31:38.474755+0000","last_became_peered":"2024-09-21T03:31:38.474755+0000","last_unstale":"2024-09-21T03:31:50.316704+0000","last_undegraded":"2024-09-21T03:31:50.316704+0000","last_fullsized":"2024-09-21T03:31:50.316704+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:47:01.791091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510178+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:31:41.510178+0000","last_peered":"2024-09-21T03:31:41.510178+0000","last_clean":"2024-09-21T03:31:41.510178+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:31:41.510178+0000","last_undegraded":"2024-09-21T03:31:41.510178+0000","last_fullsized":"2024-09-21T03:31:41.510178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508843+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:31:41.508843+0000","last_peered":"2024-09-21T03:31:41.508843+0000","last_clean":"2024-09-21T03:31:41.508843+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:31:41.508843+0000","last_undegraded":"2024-09-21T03:31:41.508843+0000","last_fullsized":"2024-09-21T03:31:41.508843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492740+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:31:41.492740+0000","last_peered":"2024-09-21T03:31:41.492740+0000","last_clean":"2024-09-21T03:31:41.492740+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:31:41.492740+0000","last_undegraded":"2024-09-21T03:31:41.492740+0000","last_fullsized":"2024-09-21T03:31:41.492740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":104,"num_read_kb":109,"num_write":152,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":160147,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":415261,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":1058073,"data_compressed":40663,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037788,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":406443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397540,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":998764,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561066,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":405912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":998057,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":847872,"data_stored":415714,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":406223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":467360,"data_compressed":4779,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":450908,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":407183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":45203,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52569,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52909,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:07.535 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:07 smithi148 ceph-mon[34651]: pgmap v278: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.6 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%) 2024-09-21T03:32:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:07 smithi148 ceph-mon[34651]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2024-09-21T03:32:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:07 smithi121 ceph-mon[34316]: pgmap v278: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.6 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%) 2024-09-21T03:32:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:07 smithi121 ceph-mon[34316]: Health check failed: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded (PG_DEGRADED) 2024-09-21T03:32:07.812 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/1441908643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a41083a0 msgr2=0x7fb5a41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/1441908643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a41083a0 0x7fb5a41087b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb594009900 tx=0x7fb59402a410 comp rx=0 tx=0).stop 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/1441908643 shutdown_connections 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/1441908643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a41083a0 0x7fb5a41087b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/1441908643 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a4108cf0 0x7fb5a410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/1441908643 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 0x7fb5a4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/1441908643 >> 172.21.15.102:0/1441908643 conn(0x7fb5a4079730 msgr2=0x7fb5a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:08.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/1441908643 shutdown_connections 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.344+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/1441908643 wait complete. 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 Processor -- start 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 -- start start 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 0x7fb5a419b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a41083a0 0x7fb5a419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4112b60 con 0x7fb5a4108cf0 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a41129e0 con 0x7fb5a4102a60 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5ac4ce640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a4112ce0 con 0x7fb5a41083a0 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.345+0000 7fb5aaa6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38596/0 (socket says 172.21.15.102:38596) 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 -- 172.21.15.102:0/410907321 learned_addr learned my addr 172.21.15.102:0/410907321 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5a9a69640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a41083a0 0x7fb5a419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:08.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aa26a640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 0x7fb5a419b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 -- 172.21.15.102:0/410907321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a41083a0 msgr2=0x7fb5a419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a41083a0 0x7fb5a419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 -- 172.21.15.102:0/410907321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 msgr2=0x7fb5a419b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 0x7fb5a419b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 -- 172.21.15.102:0/410907321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a41a6740 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5aaa6b640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00b970 tx=0x7fb59c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c019070 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a41a6a30 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb59c00cb40 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c007650 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.346+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a41a6fc0 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.347+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a4102ef0 con 0x7fb5a4108cf0 2024-09-21T03:32:08.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.349+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fb59c01c070 con 0x7fb5a4108cf0 2024-09-21T03:32:08.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.349+0000 7fb59b7fe640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 0x7fb5900b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:08.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.349+0000 7fb5aa26a640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 0x7fb5900b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:08.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.350+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fb59c0e6fb0 con 0x7fb5a4108cf0 2024-09-21T03:32:08.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.350+0000 7fb5aa26a640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 0x7fb5900b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5a406b9c0 tx=0x7fb5a0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:08.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.353+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb59c0ad5e0 con 0x7fb5a4108cf0 2024-09-21T03:32:08.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.529+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5a4063800 con 0x7fb5900b6620 2024-09-21T03:32:08.531 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:08 smithi102 ceph-mon[31392]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:08.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.533+0000 7fb59b7fe640 1 -- 172.21.15.102:0/410907321 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258869 (secure 0 0 0) 0x7fb5a4063800 con 0x7fb5900b6620 2024-09-21T03:32:08.537 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:08.538 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 msgr2=0x7fb5900b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:08.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 0x7fb5900b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5a406b9c0 tx=0x7fb5a0008040 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 msgr2=0x7fb5a419bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00b970 tx=0x7fb59c00be30 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 shutdown_connections 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb5900b6620 0x7fb5900b8b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb5a4108cf0 0x7fb5a419bf30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb5a41083a0 0x7fb5a419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 --2- 172.21.15.102:0/410907321 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb5a4102a60 0x7fb5a419b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 >> 172.21.15.102:0/410907321 conn(0x7fb5a4079730 msgr2=0x7fb5a41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.536+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 shutdown_connections 2024-09-21T03:32:08.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:08.537+0000 7fb5ac4ce640 1 -- 172.21.15.102:0/410907321 wait complete. 2024-09-21T03:32:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:08 smithi148 ceph-mon[34651]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:08.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:08 smithi121 ceph-mon[34316]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:09.214 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T03:32:08.224469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645934,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":277,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2951952,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359648,"kb_used_data":10352,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582176,"statfs":{"total":1151940427776,"available":1151572148224,"internally_reserved":0,"allocated":10600448,"data_stored":6930706,"data_compressed":153682,"data_compressed_allocated":204800,"data_compressed_original":1908736,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42962,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":80,"num_write":22,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288975+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:04.288975+0000","last_peered":"2024-09-21T03:32:04.288975+0000","last_clean":"2024-09-21T03:32:04.288975+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:04.288975+0000","last_undegraded":"2024-09-21T03:32:04.288975+0000","last_fullsized":"2024-09-21T03:32:04.288975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508440+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:31:41.508440+0000","last_peered":"2024-09-21T03:31:41.508440+0000","last_clean":"2024-09-21T03:31:41.508440+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:31:41.508440+0000","last_undegraded":"2024-09-21T03:31:41.508440+0000","last_fullsized":"2024-09-21T03:31:41.508440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509622+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:31:41.509622+0000","last_peered":"2024-09-21T03:31:41.509622+0000","last_clean":"2024-09-21T03:31:41.509622+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:31:41.509622+0000","last_undegraded":"2024-09-21T03:31:41.509622+0000","last_fullsized":"2024-09-21T03:31:41.509622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492148+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:31:41.492148+0000","last_peered":"2024-09-21T03:31:41.492148+0000","last_clean":"2024-09-21T03:31:41.492148+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:31:41.492148+0000","last_undegraded":"2024-09-21T03:31:41.492148+0000","last_fullsized":"2024-09-21T03:31:41.492148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508486+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:31:41.508486+0000","last_peered":"2024-09-21T03:31:41.508486+0000","last_clean":"2024-09-21T03:31:41.508486+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:31:41.508486+0000","last_undegraded":"2024-09-21T03:31:41.508486+0000","last_fullsized":"2024-09-21T03:31:41.508486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509249+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:31:41.509249+0000","last_peered":"2024-09-21T03:31:41.509249+0000","last_clean":"2024-09-21T03:31:41.509249+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:31:41.509249+0000","last_undegraded":"2024-09-21T03:31:41.509249+0000","last_fullsized":"2024-09-21T03:31:41.509249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.289109+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:04.289109+0000","last_peered":"2024-09-21T03:32:04.289109+0000","last_clean":"2024-09-21T03:32:04.289109+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:04.289109+0000","last_undegraded":"2024-09-21T03:32:04.289109+0000","last_fullsized":"2024-09-21T03:32:04.289109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:41.489103+0000","last_change":"2024-09-21T03:32:04.288889+0000","last_active":"2024-09-21T03:32:04.288889+0000","last_peered":"2024-09-21T03:31:41.489103+0000","last_clean":"2024-09-21T03:31:41.489103+0000","last_became_active":"2024-09-21T03:31:40.491623+0000","last_became_peered":"2024-09-21T03:31:40.491623+0000","last_unstale":"2024-09-21T03:31:41.489103+0000","last_undegraded":"2024-09-21T03:31:41.489103+0000","last_fullsized":"2024-09-21T03:31:41.489103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492165+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:31:41.492165+0000","last_peered":"2024-09-21T03:31:41.492165+0000","last_clean":"2024-09-21T03:31:41.492165+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:31:41.492165+0000","last_undegraded":"2024-09-21T03:31:41.492165+0000","last_fullsized":"2024-09-21T03:31:41.492165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294281+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:04.294281+0000","last_peered":"2024-09-21T03:32:04.294281+0000","last_clean":"2024-09-21T03:32:04.294281+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:04.294281+0000","last_undegraded":"2024-09-21T03:32:04.294281+0000","last_fullsized":"2024-09-21T03:32:04.294281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492799+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:31:41.492799+0000","last_peered":"2024-09-21T03:31:41.492799+0000","last_clean":"2024-09-21T03:31:41.492799+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:31:41.492799+0000","last_undegraded":"2024-09-21T03:31:41.492799+0000","last_fullsized":"2024-09-21T03:31:41.492799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288947+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:04.288947+0000","last_peered":"2024-09-21T03:32:04.288947+0000","last_clean":"2024-09-21T03:32:04.288947+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:04.288947+0000","last_undegraded":"2024-09-21T03:32:04.288947+0000","last_fullsized":"2024-09-21T03:32:04.288947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509825+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:31:41.509825+0000","last_peered":"2024-09-21T03:31:41.509825+0000","last_clean":"2024-09-21T03:31:41.509825+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:31:41.509825+0000","last_undegraded":"2024-09-21T03:31:41.509825+0000","last_fullsized":"2024-09-21T03:31:41.509825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.287789+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:04.287789+0000","last_peered":"2024-09-21T03:32:04.287789+0000","last_clean":"2024-09-21T03:32:04.287789+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:04.287789+0000","last_undegraded":"2024-09-21T03:32:04.287789+0000","last_fullsized":"2024-09-21T03:32:04.287789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294668+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:04.294668+0000","last_peered":"2024-09-21T03:32:04.294668+0000","last_clean":"2024-09-21T03:32:04.294668+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:04.294668+0000","last_undegraded":"2024-09-21T03:32:04.294668+0000","last_fullsized":"2024-09-21T03:32:04.294668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294582+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:04.294582+0000","last_peered":"2024-09-21T03:32:04.294582+0000","last_clean":"2024-09-21T03:32:04.294582+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:04.294582+0000","last_undegraded":"2024-09-21T03:32:04.294582+0000","last_fullsized":"2024-09-21T03:32:04.294582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"activating+degraded","last_fresh":"2024-09-21T03:32:05.288234+0000","last_change":"2024-09-21T03:32:05.289962+0000","last_active":"2024-09-21T03:32:04.287803+0000","last_peered":"2024-09-21T03:31:50.319328+0000","last_clean":"2024-09-21T03:31:50.319328+0000","last_became_active":"2024-09-21T03:31:38.478377+0000","last_became_peered":"2024-09-21T03:31:38.478377+0000","last_unstale":"2024-09-21T03:32:05.288234+0000","last_undegraded":"2024-09-21T03:32:05.288234+0000","last_fullsized":"2024-09-21T03:32:05.288234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","6","8"],"object_location_counts":[{"shards":"6,10","objects":1}],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492232+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:31:41.492232+0000","last_peered":"2024-09-21T03:31:41.492232+0000","last_clean":"2024-09-21T03:31:41.492232+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:31:41.492232+0000","last_undegraded":"2024-09-21T03:31:41.492232+0000","last_fullsized":"2024-09-21T03:31:41.492232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294708+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:04.294708+0000","last_peered":"2024-09-21T03:32:04.294708+0000","last_clean":"2024-09-21T03:32:04.294708+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:04.294708+0000","last_undegraded":"2024-09-21T03:32:04.294708+0000","last_fullsized":"2024-09-21T03:32:04.294708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288761+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:05.288761+0000","last_peered":"2024-09-21T03:32:05.288761+0000","last_clean":"2024-09-21T03:32:05.288761+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:05.288761+0000","last_undegraded":"2024-09-21T03:32:05.288761+0000","last_fullsized":"2024-09-21T03:32:05.288761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510304+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:31:41.510304+0000","last_peered":"2024-09-21T03:31:41.510304+0000","last_clean":"2024-09-21T03:31:41.510304+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:31:41.510304+0000","last_undegraded":"2024-09-21T03:31:41.510304+0000","last_fullsized":"2024-09-21T03:31:41.510304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295164+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:04.295164+0000","last_peered":"2024-09-21T03:32:04.295164+0000","last_clean":"2024-09-21T03:32:04.295164+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:04.295164+0000","last_undegraded":"2024-09-21T03:32:04.295164+0000","last_fullsized":"2024-09-21T03:32:04.295164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'22","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288518+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:05.288518+0000","last_peered":"2024-09-21T03:32:05.288518+0000","last_clean":"2024-09-21T03:32:05.288518+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:05.288518+0000","last_undegraded":"2024-09-21T03:32:05.288518+0000","last_fullsized":"2024-09-21T03:32:05.288518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":66,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294423+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:04.294423+0000","last_peered":"2024-09-21T03:32:04.294423+0000","last_clean":"2024-09-21T03:32:04.294423+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:04.294423+0000","last_undegraded":"2024-09-21T03:32:04.294423+0000","last_fullsized":"2024-09-21T03:32:04.294423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294052+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:04.294052+0000","last_peered":"2024-09-21T03:32:04.294052+0000","last_clean":"2024-09-21T03:32:04.294052+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:04.294052+0000","last_undegraded":"2024-09-21T03:32:04.294052+0000","last_fullsized":"2024-09-21T03:32:04.294052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294405+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:04.294405+0000","last_peered":"2024-09-21T03:32:04.294405+0000","last_clean":"2024-09-21T03:32:04.294405+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:04.294405+0000","last_undegraded":"2024-09-21T03:32:04.294405+0000","last_fullsized":"2024-09-21T03:32:04.294405+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288751+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:04.288751+0000","last_peered":"2024-09-21T03:32:04.288751+0000","last_clean":"2024-09-21T03:32:04.288751+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:04.288751+0000","last_undegraded":"2024-09-21T03:32:04.288751+0000","last_fullsized":"2024-09-21T03:32:04.288751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295189+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:04.295189+0000","last_peered":"2024-09-21T03:32:04.295189+0000","last_clean":"2024-09-21T03:32:04.295189+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:04.295189+0000","last_undegraded":"2024-09-21T03:32:04.295189+0000","last_fullsized":"2024-09-21T03:32:04.295189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294112+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:04.294112+0000","last_peered":"2024-09-21T03:32:04.294112+0000","last_clean":"2024-09-21T03:32:04.294112+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:04.294112+0000","last_undegraded":"2024-09-21T03:32:04.294112+0000","last_fullsized":"2024-09-21T03:32:04.294112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492377+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:31:41.492377+0000","last_peered":"2024-09-21T03:31:41.492377+0000","last_clean":"2024-09-21T03:31:41.492377+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:31:41.492377+0000","last_undegraded":"2024-09-21T03:31:41.492377+0000","last_fullsized":"2024-09-21T03:31:41.492377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285517+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:05.285517+0000","last_peered":"2024-09-21T03:32:05.285517+0000","last_clean":"2024-09-21T03:32:05.285517+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:05.285517+0000","last_undegraded":"2024-09-21T03:32:05.285517+0000","last_fullsized":"2024-09-21T03:32:05.285517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294370+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:04.294370+0000","last_peered":"2024-09-21T03:32:04.294370+0000","last_clean":"2024-09-21T03:32:04.294370+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:04.294370+0000","last_undegraded":"2024-09-21T03:32:04.294370+0000","last_fullsized":"2024-09-21T03:32:04.294370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":2,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-21T03:31:42.300399+0000","last_change":"2024-09-21T03:32:05.072959+0000","last_active":"2024-09-21T03:32:05.072959+0000","last_peered":"2024-09-21T03:31:42.300399+0000","last_clean":"2024-09-21T03:31:42.300399+0000","last_became_active":"2024-09-21T03:31:39.127799+0000","last_became_peered":"2024-09-21T03:31:39.127799+0000","last_unstale":"2024-09-21T03:31:42.300399+0000","last_undegraded":"2024-09-21T03:31:42.300399+0000","last_fullsized":"2024-09-21T03:31:42.300399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'8","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294364+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:05.294364+0000","last_peered":"2024-09-21T03:32:05.294364+0000","last_clean":"2024-09-21T03:32:05.294364+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:05.294364+0000","last_undegraded":"2024-09-21T03:32:05.294364+0000","last_fullsized":"2024-09-21T03:32:05.294364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.493033+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:31:41.493033+0000","last_peered":"2024-09-21T03:31:41.493033+0000","last_clean":"2024-09-21T03:31:41.493033+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:31:41.493033+0000","last_undegraded":"2024-09-21T03:31:41.493033+0000","last_fullsized":"2024-09-21T03:31:41.493033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.293022+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:04.293022+0000","last_peered":"2024-09-21T03:32:04.293022+0000","last_clean":"2024-09-21T03:32:04.293022+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:04.293022+0000","last_undegraded":"2024-09-21T03:32:04.293022+0000","last_fullsized":"2024-09-21T03:32:04.293022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509909+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:31:41.509909+0000","last_peered":"2024-09-21T03:31:41.509909+0000","last_clean":"2024-09-21T03:31:41.509909+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:31:41.509909+0000","last_undegraded":"2024-09-21T03:31:41.509909+0000","last_fullsized":"2024-09-21T03:31:41.509909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.304606+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:31:49.304606+0000","last_peered":"2024-09-21T03:31:49.304606+0000","last_clean":"2024-09-21T03:31:49.304606+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:31:49.304606+0000","last_undegraded":"2024-09-21T03:31:49.304606+0000","last_fullsized":"2024-09-21T03:31:49.304606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288533+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:04.288533+0000","last_peered":"2024-09-21T03:32:04.288533+0000","last_clean":"2024-09-21T03:32:04.288533+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:04.288533+0000","last_undegraded":"2024-09-21T03:32:04.288533+0000","last_fullsized":"2024-09-21T03:32:04.288533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492528+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:31:41.492528+0000","last_peered":"2024-09-21T03:31:41.492528+0000","last_clean":"2024-09-21T03:31:41.492528+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:31:41.492528+0000","last_undegraded":"2024-09-21T03:31:41.492528+0000","last_fullsized":"2024-09-21T03:31:41.492528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:44.303931+0000","last_change":"2024-09-21T03:32:04.294831+0000","last_active":"2024-09-21T03:32:04.294831+0000","last_peered":"2024-09-21T03:31:44.303931+0000","last_clean":"2024-09-21T03:31:44.303931+0000","last_became_active":"2024-09-21T03:31:40.498283+0000","last_became_peered":"2024-09-21T03:31:40.498283+0000","last_unstale":"2024-09-21T03:31:44.303931+0000","last_undegraded":"2024-09-21T03:31:44.303931+0000","last_fullsized":"2024-09-21T03:31:44.303931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510178+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:31:41.510178+0000","last_peered":"2024-09-21T03:31:41.510178+0000","last_clean":"2024-09-21T03:31:41.510178+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:31:41.510178+0000","last_undegraded":"2024-09-21T03:31:41.510178+0000","last_fullsized":"2024-09-21T03:31:41.510178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508843+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:31:41.508843+0000","last_peered":"2024-09-21T03:31:41.508843+0000","last_clean":"2024-09-21T03:31:41.508843+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:31:41.508843+0000","last_undegraded":"2024-09-21T03:31:41.508843+0000","last_fullsized":"2024-09-21T03:31:41.508843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492740+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:31:41.492740+0000","last_peered":"2024-09-21T03:31:41.492740+0000","last_clean":"2024-09-21T03:31:41.492740+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:31:41.492740+0000","last_undegraded":"2024-09-21T03:31:41.492740+0000","last_fullsized":"2024-09-21T03:31:41.492740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":114,"num_write":152,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":165862,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":415261,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":1058073,"data_compressed":40663,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037788,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":998057,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":847872,"data_stored":415714,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":406223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":467360,"data_compressed":4779,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":474359,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":407183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":50940,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52569,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52909,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:09.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:09.464 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:09.584 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:09 smithi102 ceph-mon[31392]: pgmap v279: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%); 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:09.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:09 smithi148 ceph-mon[34651]: pgmap v279: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%); 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:09 smithi121 ceph-mon[34316]: pgmap v279: 97 pgs: 1 activating+degraded, 3 peering, 93 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 KiB/s wr, 10 op/s; 1/192 objects degraded (0.521%); 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 -- 172.21.15.102:0/4159899220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 msgr2=0x7faa041098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 --2- 172.21.15.102:0/4159899220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa041098b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8009900 tx=0x7fa9f802a410 comp rx=0 tx=0).stop 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 -- 172.21.15.102:0/4159899220 shutdown_connections 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 --2- 172.21.15.102:0/4159899220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa041098b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 --2- 172.21.15.102:0/4159899220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 0x7faa04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 --2- 172.21.15.102:0/4159899220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 0x7faa04103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 -- 172.21.15.102:0/4159899220 >> 172.21.15.102:0/4159899220 conn(0x7faa0407b850 msgr2=0x7faa0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 -- 172.21.15.102:0/4159899220 shutdown_connections 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.943+0000 7faa08a8f640 1 -- 172.21.15.102:0/4159899220 wait complete. 2024-09-21T03:32:09.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 Processor -- start 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 -- start start 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 0x7faa0419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 0x7faa0419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faa04113c10 con 0x7faa041094a0 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa04113a90 con 0x7faa04103b60 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa08a8f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa04113d90 con 0x7faa04109df0 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38604/0 (socket says 172.21.15.102:38604) 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 -- 172.21.15.102:0/295773263 learned_addr learned my addr 172.21.15.102:0/295773263 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:09.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa0259c640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 0x7faa0419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa02d9d640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 0x7faa0419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 -- 172.21.15.102:0/295773263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 msgr2=0x7faa0419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 0x7faa0419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 -- 172.21.15.102:0/295773263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 msgr2=0x7faa0419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 0x7faa0419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.944+0000 7faa01d9b640 1 -- 172.21.15.102:0/295773263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa041a0570 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7faa01d9b640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005940 tx=0x7fa9f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f803f030 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa9f8031910 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8035070 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa041a0800 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.945+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa041a6fc0 con 0x7faa041094a0 2024-09-21T03:32:09.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.946+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa04103f70 con 0x7faa041094a0 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.948+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fa9f8042030 con 0x7faa041094a0 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.949+0000 7fa9f37fe640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 0x7fa9ec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.949+0000 7faa0259c640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 0x7fa9ec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.949+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fa9f8107c90 con 0x7faa041094a0 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.949+0000 7faa0259c640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 0x7fa9ec0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400bbe0 tx=0x7fa9f400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:09.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:09.952+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9f80d26a0 con 0x7faa041094a0 2024-09-21T03:32:10.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.132+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa04063800 con 0x7fa9ec0b65f0 2024-09-21T03:32:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.136+0000 7fa9f37fe640 1 -- 172.21.15.102:0/295773263 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258869 (secure 0 0 0) 0x7faa04063800 con 0x7fa9ec0b65f0 2024-09-21T03:32:10.140 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:10.141 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:10.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 msgr2=0x7fa9ec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:10.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 0x7fa9ec0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400bbe0 tx=0x7fa9f400b390 comp rx=0 tx=0).stop 2024-09-21T03:32:10.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 msgr2=0x7faa0419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8005940 tx=0x7fa9f80042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 shutdown_connections 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9ec0b65f0 0x7fa9ec0b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa041094a0 0x7faa0419aba0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa04109df0 0x7faa0419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 --2- 172.21.15.102:0/295773263 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa04103b60 0x7faa0419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 >> 172.21.15.102:0/295773263 conn(0x7faa0407b850 msgr2=0x7faa04107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 shutdown_connections 2024-09-21T03:32:10.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:10.140+0000 7faa08a8f640 1 -- 172.21.15.102:0/295773263 wait complete. 2024-09-21T03:32:10.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:10 smithi102 ceph-mon[31392]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:10.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:10 smithi148 ceph-mon[34651]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:10 smithi121 ceph-mon[34316]: from='client.14982 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:10.976 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T03:32:08.224469+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":645934,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":190,"num_read_kb":183,"num_write":277,"num_write_kb":2251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2951952,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":292,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359648,"kb_used_data":10352,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582176,"statfs":{"total":1151940427776,"available":1151572148224,"internally_reserved":0,"allocated":10600448,"data_stored":6930706,"data_compressed":153682,"data_compressed_allocated":204800,"data_compressed_original":1908736,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42962,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":59,"num_read_kb":80,"num_write":22,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288975+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:04.288975+0000","last_peered":"2024-09-21T03:32:04.288975+0000","last_clean":"2024-09-21T03:32:04.288975+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:04.288975+0000","last_undegraded":"2024-09-21T03:32:04.288975+0000","last_fullsized":"2024-09-21T03:32:04.288975+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508440+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:31:41.508440+0000","last_peered":"2024-09-21T03:31:41.508440+0000","last_clean":"2024-09-21T03:31:41.508440+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:31:41.508440+0000","last_undegraded":"2024-09-21T03:31:41.508440+0000","last_fullsized":"2024-09-21T03:31:41.508440+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509622+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:31:41.509622+0000","last_peered":"2024-09-21T03:31:41.509622+0000","last_clean":"2024-09-21T03:31:41.509622+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:31:41.509622+0000","last_undegraded":"2024-09-21T03:31:41.509622+0000","last_fullsized":"2024-09-21T03:31:41.509622+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492148+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:31:41.492148+0000","last_peered":"2024-09-21T03:31:41.492148+0000","last_clean":"2024-09-21T03:31:41.492148+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:31:41.492148+0000","last_undegraded":"2024-09-21T03:31:41.492148+0000","last_fullsized":"2024-09-21T03:31:41.492148+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.292667+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:04.292667+0000","last_peered":"2024-09-21T03:32:04.292667+0000","last_clean":"2024-09-21T03:32:04.292667+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:04.292667+0000","last_undegraded":"2024-09-21T03:32:04.292667+0000","last_fullsized":"2024-09-21T03:32:04.292667+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508486+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:31:41.508486+0000","last_peered":"2024-09-21T03:31:41.508486+0000","last_clean":"2024-09-21T03:31:41.508486+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:31:41.508486+0000","last_undegraded":"2024-09-21T03:31:41.508486+0000","last_fullsized":"2024-09-21T03:31:41.508486+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509249+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:31:41.509249+0000","last_peered":"2024-09-21T03:31:41.509249+0000","last_clean":"2024-09-21T03:31:41.509249+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:31:41.509249+0000","last_undegraded":"2024-09-21T03:31:41.509249+0000","last_fullsized":"2024-09-21T03:31:41.509249+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.289109+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:04.289109+0000","last_peered":"2024-09-21T03:32:04.289109+0000","last_clean":"2024-09-21T03:32:04.289109+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:04.289109+0000","last_undegraded":"2024-09-21T03:32:04.289109+0000","last_fullsized":"2024-09-21T03:32:04.289109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:41.489103+0000","last_change":"2024-09-21T03:32:04.288889+0000","last_active":"2024-09-21T03:32:04.288889+0000","last_peered":"2024-09-21T03:31:41.489103+0000","last_clean":"2024-09-21T03:31:41.489103+0000","last_became_active":"2024-09-21T03:31:40.491623+0000","last_became_peered":"2024-09-21T03:31:40.491623+0000","last_unstale":"2024-09-21T03:31:41.489103+0000","last_undegraded":"2024-09-21T03:31:41.489103+0000","last_fullsized":"2024-09-21T03:31:41.489103+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,8,9],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492165+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:31:41.492165+0000","last_peered":"2024-09-21T03:31:41.492165+0000","last_clean":"2024-09-21T03:31:41.492165+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:31:41.492165+0000","last_undegraded":"2024-09-21T03:31:41.492165+0000","last_fullsized":"2024-09-21T03:31:41.492165+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294281+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:04.294281+0000","last_peered":"2024-09-21T03:32:04.294281+0000","last_clean":"2024-09-21T03:32:04.294281+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:04.294281+0000","last_undegraded":"2024-09-21T03:32:04.294281+0000","last_fullsized":"2024-09-21T03:32:04.294281+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492799+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:31:41.492799+0000","last_peered":"2024-09-21T03:31:41.492799+0000","last_clean":"2024-09-21T03:31:41.492799+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:31:41.492799+0000","last_undegraded":"2024-09-21T03:31:41.492799+0000","last_fullsized":"2024-09-21T03:31:41.492799+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288947+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:04.288947+0000","last_peered":"2024-09-21T03:32:04.288947+0000","last_clean":"2024-09-21T03:32:04.288947+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:04.288947+0000","last_undegraded":"2024-09-21T03:32:04.288947+0000","last_fullsized":"2024-09-21T03:32:04.288947+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509825+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:31:41.509825+0000","last_peered":"2024-09-21T03:31:41.509825+0000","last_clean":"2024-09-21T03:31:41.509825+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:31:41.509825+0000","last_undegraded":"2024-09-21T03:31:41.509825+0000","last_fullsized":"2024-09-21T03:31:41.509825+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.287789+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:04.287789+0000","last_peered":"2024-09-21T03:32:04.287789+0000","last_clean":"2024-09-21T03:32:04.287789+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:04.287789+0000","last_undegraded":"2024-09-21T03:32:04.287789+0000","last_fullsized":"2024-09-21T03:32:04.287789+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294668+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:04.294668+0000","last_peered":"2024-09-21T03:32:04.294668+0000","last_clean":"2024-09-21T03:32:04.294668+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:04.294668+0000","last_undegraded":"2024-09-21T03:32:04.294668+0000","last_fullsized":"2024-09-21T03:32:04.294668+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294582+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:04.294582+0000","last_peered":"2024-09-21T03:32:04.294582+0000","last_clean":"2024-09-21T03:32:04.294582+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:04.294582+0000","last_undegraded":"2024-09-21T03:32:04.294582+0000","last_fullsized":"2024-09-21T03:32:04.294582+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"activating+degraded","last_fresh":"2024-09-21T03:32:05.288234+0000","last_change":"2024-09-21T03:32:05.289962+0000","last_active":"2024-09-21T03:32:04.287803+0000","last_peered":"2024-09-21T03:31:50.319328+0000","last_clean":"2024-09-21T03:31:50.319328+0000","last_became_active":"2024-09-21T03:31:38.478377+0000","last_became_peered":"2024-09-21T03:31:38.478377+0000","last_unstale":"2024-09-21T03:32:05.288234+0000","last_undegraded":"2024-09-21T03:32:05.288234+0000","last_fullsized":"2024-09-21T03:32:05.288234+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":["10","6","8"],"object_location_counts":[{"shards":"6,10","objects":1}],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492232+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:31:41.492232+0000","last_peered":"2024-09-21T03:31:41.492232+0000","last_clean":"2024-09-21T03:31:41.492232+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:31:41.492232+0000","last_undegraded":"2024-09-21T03:31:41.492232+0000","last_fullsized":"2024-09-21T03:31:41.492232+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294708+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:04.294708+0000","last_peered":"2024-09-21T03:32:04.294708+0000","last_clean":"2024-09-21T03:32:04.294708+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:04.294708+0000","last_undegraded":"2024-09-21T03:32:04.294708+0000","last_fullsized":"2024-09-21T03:32:04.294708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288761+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:05.288761+0000","last_peered":"2024-09-21T03:32:05.288761+0000","last_clean":"2024-09-21T03:32:05.288761+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:05.288761+0000","last_undegraded":"2024-09-21T03:32:05.288761+0000","last_fullsized":"2024-09-21T03:32:05.288761+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510304+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:31:41.510304+0000","last_peered":"2024-09-21T03:31:41.510304+0000","last_clean":"2024-09-21T03:31:41.510304+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:31:41.510304+0000","last_undegraded":"2024-09-21T03:31:41.510304+0000","last_fullsized":"2024-09-21T03:31:41.510304+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295164+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:04.295164+0000","last_peered":"2024-09-21T03:32:04.295164+0000","last_clean":"2024-09-21T03:32:04.295164+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:04.295164+0000","last_undegraded":"2024-09-21T03:32:04.295164+0000","last_fullsized":"2024-09-21T03:32:04.295164+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'22","reported_seq":79,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288518+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:05.288518+0000","last_peered":"2024-09-21T03:32:05.288518+0000","last_clean":"2024-09-21T03:32:05.288518+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:05.288518+0000","last_undegraded":"2024-09-21T03:32:05.288518+0000","last_fullsized":"2024-09-21T03:32:05.288518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50940,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":66,"num_write":23,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294423+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:04.294423+0000","last_peered":"2024-09-21T03:32:04.294423+0000","last_clean":"2024-09-21T03:32:04.294423+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:04.294423+0000","last_undegraded":"2024-09-21T03:32:04.294423+0000","last_fullsized":"2024-09-21T03:32:04.294423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":42,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294052+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:04.294052+0000","last_peered":"2024-09-21T03:32:04.294052+0000","last_clean":"2024-09-21T03:32:04.294052+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:04.294052+0000","last_undegraded":"2024-09-21T03:32:04.294052+0000","last_fullsized":"2024-09-21T03:32:04.294052+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294405+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:04.294405+0000","last_peered":"2024-09-21T03:32:04.294405+0000","last_clean":"2024-09-21T03:32:04.294405+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:04.294405+0000","last_undegraded":"2024-09-21T03:32:04.294405+0000","last_fullsized":"2024-09-21T03:32:04.294405+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288751+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:04.288751+0000","last_peered":"2024-09-21T03:32:04.288751+0000","last_clean":"2024-09-21T03:32:04.288751+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:04.288751+0000","last_undegraded":"2024-09-21T03:32:04.288751+0000","last_fullsized":"2024-09-21T03:32:04.288751+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.295189+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:04.295189+0000","last_peered":"2024-09-21T03:32:04.295189+0000","last_clean":"2024-09-21T03:32:04.295189+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:04.295189+0000","last_undegraded":"2024-09-21T03:32:04.295189+0000","last_fullsized":"2024-09-21T03:32:04.295189+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294112+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:04.294112+0000","last_peered":"2024-09-21T03:32:04.294112+0000","last_clean":"2024-09-21T03:32:04.294112+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:04.294112+0000","last_undegraded":"2024-09-21T03:32:04.294112+0000","last_fullsized":"2024-09-21T03:32:04.294112+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492377+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:31:41.492377+0000","last_peered":"2024-09-21T03:31:41.492377+0000","last_clean":"2024-09-21T03:31:41.492377+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:31:41.492377+0000","last_undegraded":"2024-09-21T03:31:41.492377+0000","last_fullsized":"2024-09-21T03:31:41.492377+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":42,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285517+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:05.285517+0000","last_peered":"2024-09-21T03:32:05.285517+0000","last_clean":"2024-09-21T03:32:05.285517+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:05.285517+0000","last_undegraded":"2024-09-21T03:32:05.285517+0000","last_fullsized":"2024-09-21T03:32:05.285517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.294370+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:04.294370+0000","last_peered":"2024-09-21T03:32:04.294370+0000","last_clean":"2024-09-21T03:32:04.294370+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:04.294370+0000","last_undegraded":"2024-09-21T03:32:04.294370+0000","last_fullsized":"2024-09-21T03:32:04.294370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":2,"reported_epoch":78,"state":"peering","last_fresh":"2024-09-21T03:31:42.300399+0000","last_change":"2024-09-21T03:32:05.072959+0000","last_active":"2024-09-21T03:32:05.072959+0000","last_peered":"2024-09-21T03:31:42.300399+0000","last_clean":"2024-09-21T03:31:42.300399+0000","last_became_active":"2024-09-21T03:31:39.127799+0000","last_became_peered":"2024-09-21T03:31:39.127799+0000","last_unstale":"2024-09-21T03:31:42.300399+0000","last_undegraded":"2024-09-21T03:31:42.300399+0000","last_fullsized":"2024-09-21T03:31:42.300399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'8","reported_seq":31,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294364+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:05.294364+0000","last_peered":"2024-09-21T03:32:05.294364+0000","last_clean":"2024-09-21T03:32:05.294364+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:05.294364+0000","last_undegraded":"2024-09-21T03:32:05.294364+0000","last_fullsized":"2024-09-21T03:32:05.294364+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.493033+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:31:41.493033+0000","last_peered":"2024-09-21T03:31:41.493033+0000","last_clean":"2024-09-21T03:31:41.493033+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:31:41.493033+0000","last_undegraded":"2024-09-21T03:31:41.493033+0000","last_fullsized":"2024-09-21T03:31:41.493033+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.293022+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:04.293022+0000","last_peered":"2024-09-21T03:32:04.293022+0000","last_clean":"2024-09-21T03:32:04.293022+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:04.293022+0000","last_undegraded":"2024-09-21T03:32:04.293022+0000","last_fullsized":"2024-09-21T03:32:04.293022+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.509909+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:31:41.509909+0000","last_peered":"2024-09-21T03:31:41.509909+0000","last_clean":"2024-09-21T03:31:41.509909+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:31:41.509909+0000","last_undegraded":"2024-09-21T03:31:41.509909+0000","last_fullsized":"2024-09-21T03:31:41.509909+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":22,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:49.304606+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:31:49.304606+0000","last_peered":"2024-09-21T03:31:49.304606+0000","last_clean":"2024-09-21T03:31:49.304606+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:31:49.304606+0000","last_undegraded":"2024-09-21T03:31:49.304606+0000","last_fullsized":"2024-09-21T03:31:49.304606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T03:32:04.288533+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:04.288533+0000","last_peered":"2024-09-21T03:32:04.288533+0000","last_clean":"2024-09-21T03:32:04.288533+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:04.288533+0000","last_undegraded":"2024-09-21T03:32:04.288533+0000","last_fullsized":"2024-09-21T03:32:04.288533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492528+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:31:41.492528+0000","last_peered":"2024-09-21T03:31:41.492528+0000","last_clean":"2024-09-21T03:31:41.492528+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:31:41.492528+0000","last_undegraded":"2024-09-21T03:31:41.492528+0000","last_fullsized":"2024-09-21T03:31:41.492528+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":77,"state":"peering","last_fresh":"2024-09-21T03:31:44.303931+0000","last_change":"2024-09-21T03:32:04.294831+0000","last_active":"2024-09-21T03:32:04.294831+0000","last_peered":"2024-09-21T03:31:44.303931+0000","last_clean":"2024-09-21T03:31:44.303931+0000","last_became_active":"2024-09-21T03:31:40.498283+0000","last_became_peered":"2024-09-21T03:31:40.498283+0000","last_unstale":"2024-09-21T03:31:44.303931+0000","last_undegraded":"2024-09-21T03:31:44.303931+0000","last_fullsized":"2024-09-21T03:31:44.303931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.510178+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:31:41.510178+0000","last_peered":"2024-09-21T03:31:41.510178+0000","last_clean":"2024-09-21T03:31:41.510178+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:31:41.510178+0000","last_undegraded":"2024-09-21T03:31:41.510178+0000","last_fullsized":"2024-09-21T03:31:41.510178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":21,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.508843+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:31:41.508843+0000","last_peered":"2024-09-21T03:31:41.508843+0000","last_clean":"2024-09-21T03:31:41.508843+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:31:41.508843+0000","last_undegraded":"2024-09-21T03:31:41.508843+0000","last_fullsized":"2024-09-21T03:31:41.508843+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T03:31:41.492740+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:31:41.492740+0000","last_peered":"2024-09-21T03:31:41.492740+0000","last_clean":"2024-09-21T03:31:41.492740+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:31:41.492740+0000","last_undegraded":"2024-09-21T03:31:41.492740+0000","last_fullsized":"2024-09-21T03:31:41.492740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":55332,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":109,"num_read_kb":114,"num_write":152,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":165862,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678034,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":839680,"data_stored":415261,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874262,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":978944,"data_stored":1058073,"data_compressed":40663,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037788,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397541,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561067,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757295,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":998057,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":847872,"data_stored":415714,"data_compressed":2878,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32012,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713140,"statfs":{"total":95995035648,"available":95962255360,"internally_reserved":0,"allocated":847872,"data_stored":406223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378687,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":917504,"data_stored":467360,"data_compressed":4779,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509504,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":905216,"data_stored":474359,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":407183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":50940,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":52569,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":52909,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:10.979 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-21T03:32:10.979 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 77, 'state': 'peering', 'last_fresh': '2024-09-21T03:31:41.489103+0000', 'last_change': '2024-09-21T03:32:04.288889+0000', 'last_active': '2024-09-21T03:32:04.288889+0000', 'last_peered': '2024-09-21T03:31:41.489103+0000', 'last_clean': '2024-09-21T03:31:41.489103+0000', 'last_became_active': '2024-09-21T03:31:40.491623+0000', 'last_became_peered': '2024-09-21T03:31:40.491623+0000', 'last_unstale': '2024-09-21T03:31:41.489103+0000', 'last_undegraded': '2024-09-21T03:31:41.489103+0000', 'last_fullsized': '2024-09-21T03:31:41.489103+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 76, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'last_clean_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 9, 8], 'acting': [11, 9, 8], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4, 8, 9], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.1a', 'version': "77'3", 'reported_seq': 26, 'reported_epoch': 79, 'state': 'activating+degraded', 'last_fresh': '2024-09-21T03:32:05.288234+0000', 'last_change': '2024-09-21T03:32:05.289962+0000', 'last_active': '2024-09-21T03:32:04.287803+0000', 'last_peered': '2024-09-21T03:31:50.319328+0000', 'last_clean': '2024-09-21T03:31:50.319328+0000', 'last_became_active': '2024-09-21T03:31:38.478377+0000', 'last_became_peered': '2024-09-21T03:31:38.478377+0000', 'last_unstale': '2024-09-21T03:32:05.288234+0000', 'last_undegraded': '2024-09-21T03:32:05.288234+0000', 'last_fullsized': '2024-09-21T03:32:05.288234+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'last_clean_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'objects_scrubbed': 0, 'log_size': 3, 'log_dups_size': 0, 'ondisk_log_size': 3, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 1, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 3, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 1, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [10, 1, 6], 'acting': [10, 1, 6], 'avail_no_missing': ['10', '6', '8'], 'object_location_counts': [{'shards': '6,10', 'objects': 1}], 'blocked_by': [], 'up_primary': 10, 'acting_primary': 10, 'purged_snaps': []} 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '2.5', 'version': "77'1", 'reported_seq': 2, 'reported_epoch': 78, 'state': 'peering', 'last_fresh': '2024-09-21T03:31:42.300399+0000', 'last_change': '2024-09-21T03:32:05.072959+0000', 'last_active': '2024-09-21T03:32:05.072959+0000', 'last_peered': '2024-09-21T03:31:42.300399+0000', 'last_clean': '2024-09-21T03:31:42.300399+0000', 'last_became_active': '2024-09-21T03:31:39.127799+0000', 'last_became_peered': '2024-09-21T03:31:39.127799+0000', 'last_unstale': '2024-09-21T03:31:42.300399+0000', 'last_undegraded': '2024-09-21T03:31:42.300399+0000', 'last_fullsized': '2024-09-21T03:31:42.300399+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 74, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'last_clean_scrub_stamp': '2024-09-21T03:31:37.445666+0000', 'objects_scrubbed': 0, 'log_size': 1, 'log_dups_size': 0, 'ondisk_log_size': 1, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 22, 'num_objects': 1, 'num_object_clones': 0, 'num_object_copies': 3, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 1, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 1, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 1, 'num_write_kb': 1, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [11, 0, 9], 'acting': [11, 0, 9], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 11, 'acting_primary': 11, 'purged_snaps': []} 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-21T03:32:10.980 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 15, 'reported_epoch': 77, 'state': 'peering', 'last_fresh': '2024-09-21T03:31:44.303931+0000', 'last_change': '2024-09-21T03:32:04.294831+0000', 'last_active': '2024-09-21T03:32:04.294831+0000', 'last_peered': '2024-09-21T03:31:44.303931+0000', 'last_clean': '2024-09-21T03:31:44.303931+0000', 'last_became_active': '2024-09-21T03:31:40.498283+0000', 'last_became_peered': '2024-09-21T03:31:40.498283+0000', 'last_unstale': '2024-09-21T03:31:44.303931+0000', 'last_undegraded': '2024-09-21T03:31:44.303931+0000', 'last_fullsized': '2024-09-21T03:31:44.303931+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 75, 'last_epoch_clean': 76, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'last_clean_scrub_stamp': '2024-09-21T03:31:39.459947+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6, 1], 'acting': [5, 6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1, 4, 6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-21T03:32:10.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph status --format=json 2024-09-21T03:32:11.226 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:11.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:11 smithi102 ceph-mon[31392]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:11.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:11 smithi102 ceph-mon[31392]: pgmap v280: 97 pgs: 1 activating+degraded, 96 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 5 op/s; 1/192 objects degraded (0.521%); 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:11.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 -- 172.21.15.102:0/541252720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc102200 msgr2=0x7feecc102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:11.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 --2- 172.21.15.102:0/541252720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc102200 0x7feecc102610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7feebc009900 tx=0x7feebc02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:11.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 -- 172.21.15.102:0/541252720 shutdown_connections 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 --2- 172.21.15.102:0/541252720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc108490 0x7feecc10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 --2- 172.21.15.102:0/541252720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc107b40 0x7feecc107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 --2- 172.21.15.102:0/541252720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc102200 0x7feecc102610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 -- 172.21.15.102:0/541252720 >> 172.21.15.102:0/541252720 conn(0x7feecc077ca0 msgr2=0x7feecc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 -- 172.21.15.102:0/541252720 shutdown_connections 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 -- 172.21.15.102:0/541252720 wait complete. 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.711+0000 7feed137a640 1 Processor -- start 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 -- start start 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc102200 0x7feecc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc108490 0x7feecc19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feecc1122f0 con 0x7feecc107b40 2024-09-21T03:32:11.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feecc112170 con 0x7feecc102200 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feed137a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feecc112470 con 0x7feecc108490 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38634/0 (socket says 172.21.15.102:38634) 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 -- 172.21.15.102:0/753565279 learned_addr learned my addr 172.21.15.102:0/753565279 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feecaffd640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc102200 0x7feecc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feecb7fe640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc108490 0x7feecc19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 -- 172.21.15.102:0/753565279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc108490 msgr2=0x7feecc19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc108490 0x7feecc19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 -- 172.21.15.102:0/753565279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc102200 msgr2=0x7feecc19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc102200 0x7feecc19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.712+0000 7feeca7fc640 1 -- 172.21.15.102:0/753565279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc1a0550 con 0x7feecc107b40 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feeca7fc640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feec000c970 tx=0x7feec000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0007bb0 con 0x7feecc107b40 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1a0840 con 0x7feecc107b40 2024-09-21T03:32:11.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec0007d50 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec000f450 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.713+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc1a6fa0 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.714+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc102610 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.715+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7feec0004ef0 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.716+0000 7feeb3fff640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 0x7feeb40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.716+0000 7feecaffd640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 0x7feeb40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.716+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7feec00e76d0 con 0x7feecc107b40 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.716+0000 7feecaffd640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 0x7feeb40b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feebc009230 tx=0x7feebc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:11.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.719+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feec0014030 con 0x7feecc107b40 2024-09-21T03:32:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:11 smithi148 ceph-mon[34651]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:11 smithi148 ceph-mon[34651]: pgmap v280: 97 pgs: 1 activating+degraded, 96 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 5 op/s; 1/192 objects degraded (0.521%); 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:11 smithi121 ceph-mon[34316]: from='client.14988 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:11 smithi121 ceph-mon[34316]: pgmap v280: 97 pgs: 1 activating+degraded, 96 active+clean; 631 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 5 op/s; 1/192 objects degraded (0.521%); 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:11.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.963+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7feecc19b710 con 0x7feecc107b40 2024-09-21T03:32:11.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.963+0000 7feeb3fff640 1 -- 172.21.15.102:0/753565279 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+3116 (secure 0 0 0) 0x7feecc19b710 con 0x7feecc107b40 2024-09-21T03:32:11.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:11.965 INFO:teuthology.orchestra.run.smithi102.stdout:{"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded","count":1},"muted":false}},"mutes":[]},"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","c","b"],"quorum_age":438,"monmap":{"epoch":3,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1726889449,"num_in_osds":12,"osd_in_since":1726889427,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":96},{"state_name":"activating+degraded","count":1}],"num_pgs":97,"num_pools":3,"num_objects":64,"data_bytes":645934,"bytes_used":368390144,"bytes_avail":1151572037632,"bytes_total":1151940427776,"inactive_pgs_ratio":0.010309278033673763,"degraded_objects":1,"degraded_total":192,"degraded_ratio":0.0052083333333333322,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":16,"recovering_keys_per_sec":1,"num_objects_recovered":12,"num_bytes_recovered":134,"num_keys_recovered":10,"read_bytes_sec":5246,"write_bytes_sec":1023,"read_op_per_sec":4,"write_op_per_sec":0},"fsmap":{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","id":1,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":1,"rank":2,"name":"e","status":"up:standby-replay","gid":24611},{"filesystem_id":1,"rank":1,"name":"f","status":"up:standby-replay","gid":24628},{"filesystem_id":1,"rank":0,"name":"h","status":"up:standby-replay","gid":24632},{"filesystem_id":1,"rank":2,"name":"c","status":"up:active","gid":24637},{"filesystem_id":1,"rank":1,"name":"b","status":"up:active","gid":24659},{"filesystem_id":1,"rank":0,"name":"i","status":"up:active","gid":24661}],"up:standby":6},"mgrmap":{"available":true,"num_standbys":2,"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"services":{"dashboard":"https://172.21.15.102:8443/"}},"servicemap":{"epoch":20,"modified":"2024-09-21T03:32:10.225223+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"e":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"f":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"g":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"h":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"i":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 msgr2=0x7feeb40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 0x7feeb40b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7feebc009230 tx=0x7feebc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 msgr2=0x7feecc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7feec000c970 tx=0x7feec000ce30 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 shutdown_connections 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb40b65f0 0x7feeb40b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feecc107b40 0x7feecc19ab80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feecc108490 0x7feecc19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 --2- 172.21.15.102:0/753565279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feecc102200 0x7feecc19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 >> 172.21.15.102:0/753565279 conn(0x7feecc077ca0 msgr2=0x7feecc105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 shutdown_connections 2024-09-21T03:32:11.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:11.966+0000 7feed137a640 1 -- 172.21.15.102:0/753565279 wait complete. 2024-09-21T03:32:12.648 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:12 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/753565279' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T03:32:12.677 INFO:tasks.cephadm.ceph_manager.ceph:making progress, resetting timeout 2024-09-21T03:32:12.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:12.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:12 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/753565279' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T03:32:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:12 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/753565279' entity='client.admin' cmd={"prefix": "status", "format": "json"} : dispatch 2024-09-21T03:32:12.919 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 -- 172.21.15.102:0/3632995938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41741084b0 msgr2=0x7f417410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 --2- 172.21.15.102:0/3632995938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41741084b0 0x7f417410ece0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f416c00adb0 tx=0x7f416c02b7c0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 -- 172.21.15.102:0/3632995938 shutdown_connections 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 --2- 172.21.15.102:0/3632995938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f41741084b0 0x7f417410ece0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 --2- 172.21.15.102:0/3632995938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 0x7f4174107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 --2- 172.21.15.102:0/3632995938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4174102220 0x7f4174102630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 -- 172.21.15.102:0/3632995938 >> 172.21.15.102:0/3632995938 conn(0x7f4174079e30 msgr2=0x7f417407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:13.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 -- 172.21.15.102:0/3632995938 shutdown_connections 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.372+0000 7f4178f26640 1 -- 172.21.15.102:0/3632995938 wait complete. 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.373+0000 7f4178f26640 1 Processor -- start 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.373+0000 7f4178f26640 1 -- start start 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 0x7f4174198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 0x7f417419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4174111a60 con 0x7f4174102220 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f41741118e0 con 0x7f41741084b0 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4174111be0 con 0x7f4174107b60 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38658/0 (socket says 172.21.15.102:38658) 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 -- 172.21.15.102:0/2670000084 learned_addr learned my addr 172.21.15.102:0/2670000084 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4169d9b640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 0x7f4174198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4172d9d640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 0x7f417419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:13.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 -- 172.21.15.102:0/2670000084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 msgr2=0x7f4174198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 0x7f4174198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 -- 172.21.15.102:0/2670000084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 msgr2=0x7f417419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 0x7f417419dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 -- 172.21.15.102:0/2670000084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417419e2e0 con 0x7f4174102220 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4172d9d640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 0x7f417419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f417259c640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f416400d950 tx=0x7f416400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4164017070 con 0x7f4174102220 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f416400de80 con 0x7f4174102220 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417419e5d0 con 0x7f4174102220 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.374+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416400f620 con 0x7f4174102220 2024-09-21T03:32:13.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.375+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41741a4d30 con 0x7f4174102220 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.375+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4174102630 con 0x7f4174102220 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.377+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f4164009c30 con 0x7f4174102220 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.378+0000 7f416bfff640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 0x7f41600b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.378+0000 7f4169d9b640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 0x7f41600b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.378+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f41640e7220 con 0x7f4174102220 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.378+0000 7f4169d9b640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 0x7f41600b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41741055d0 tx=0x7f415c009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:13.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.381+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41640ad850 con 0x7f4174102220 2024-09-21T03:32:13.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.556+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4174063800 con 0x7f41600b65f0 2024-09-21T03:32:13.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.561+0000 7f416bfff640 1 -- 172.21.15.102:0/2670000084 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259026 (secure 0 0 0) 0x7f4174063800 con 0x7f41600b65f0 2024-09-21T03:32:13.565 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:13.566 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 msgr2=0x7f41600b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 0x7f41600b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f41741055d0 tx=0x7f415c009110 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 msgr2=0x7f4174198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f416400d950 tx=0x7f416400dd50 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 shutdown_connections 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f41600b65f0 0x7f41600b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f41741084b0 0x7f417419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4174107b60 0x7f4174198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 --2- 172.21.15.102:0/2670000084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4174102220 0x7f4174198370 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:13.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 >> 172.21.15.102:0/2670000084 conn(0x7f4174079e30 msgr2=0x7f4174103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:13.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 shutdown_connections 2024-09-21T03:32:13.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:13.564+0000 7f4178f26640 1 -- 172.21.15.102:0/2670000084 wait complete. 2024-09-21T03:32:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:13 smithi102 ceph-mon[31392]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:13 smithi102 ceph-mon[31392]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-21T03:32:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:13 smithi102 ceph-mon[31392]: Cluster is now healthy 2024-09-21T03:32:13.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:13 smithi148 ceph-mon[34651]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:13 smithi148 ceph-mon[34651]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-21T03:32:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:13 smithi148 ceph-mon[34651]: Cluster is now healthy 2024-09-21T03:32:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:13 smithi121 ceph-mon[34316]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 9 op/s; 16 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:13 smithi121 ceph-mon[34316]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/192 objects degraded (0.521%), 1 pg degraded) 2024-09-21T03:32:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:13 smithi121 ceph-mon[34316]: Cluster is now healthy 2024-09-21T03:32:14.463 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2024-09-21T03:32:12.225558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654086,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":221,"num_read_kb":206,"num_write":284,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359812,"kb_used_data":10500,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582012,"statfs":{"total":1151940427776,"available":1151571980288,"internally_reserved":0,"allocated":10752000,"data_stored":7043286,"data_compressed":182511,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13889,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":64,"num_write":14,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002116"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291302+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:05.291302+0000","last_peered":"2024-09-21T03:32:05.291302+0000","last_clean":"2024-09-21T03:32:05.291302+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:05.291302+0000","last_undegraded":"2024-09-21T03:32:05.291302+0000","last_fullsized":"2024-09-21T03:32:05.291302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293620+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:32:05.293620+0000","last_peered":"2024-09-21T03:32:05.293620+0000","last_clean":"2024-09-21T03:32:05.293620+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:32:05.293620+0000","last_undegraded":"2024-09-21T03:32:05.293620+0000","last_fullsized":"2024-09-21T03:32:05.293620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293929+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:32:05.293929+0000","last_peered":"2024-09-21T03:32:05.293929+0000","last_clean":"2024-09-21T03:32:05.293929+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:32:05.293929+0000","last_undegraded":"2024-09-21T03:32:05.293929+0000","last_fullsized":"2024-09-21T03:32:05.293929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287476+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:05.287476+0000","last_peered":"2024-09-21T03:32:05.287476+0000","last_clean":"2024-09-21T03:32:05.287476+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:05.287476+0000","last_undegraded":"2024-09-21T03:32:05.287476+0000","last_fullsized":"2024-09-21T03:32:05.287476+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339877+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:32:05.339877+0000","last_peered":"2024-09-21T03:32:05.339877+0000","last_clean":"2024-09-21T03:32:05.339877+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:32:05.339877+0000","last_undegraded":"2024-09-21T03:32:05.339877+0000","last_fullsized":"2024-09-21T03:32:05.339877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287421+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:05.287421+0000","last_peered":"2024-09-21T03:32:05.287421+0000","last_clean":"2024-09-21T03:32:05.287421+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:05.287421+0000","last_undegraded":"2024-09-21T03:32:05.287421+0000","last_fullsized":"2024-09-21T03:32:05.287421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292770+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:32:05.292770+0000","last_peered":"2024-09-21T03:32:05.292770+0000","last_clean":"2024-09-21T03:32:05.292770+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:32:05.292770+0000","last_undegraded":"2024-09-21T03:32:05.292770+0000","last_fullsized":"2024-09-21T03:32:05.292770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292473+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:32:05.292473+0000","last_peered":"2024-09-21T03:32:05.292473+0000","last_clean":"2024-09-21T03:32:05.292473+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:32:05.292473+0000","last_undegraded":"2024-09-21T03:32:05.292473+0000","last_fullsized":"2024-09-21T03:32:05.292473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291444+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:05.291444+0000","last_peered":"2024-09-21T03:32:05.291444+0000","last_clean":"2024-09-21T03:32:05.291444+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:05.291444+0000","last_undegraded":"2024-09-21T03:32:05.291444+0000","last_fullsized":"2024-09-21T03:32:05.291444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295215+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:32:05.295215+0000","last_peered":"2024-09-21T03:32:05.295215+0000","last_clean":"2024-09-21T03:32:05.295215+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:32:05.295215+0000","last_undegraded":"2024-09-21T03:32:05.295215+0000","last_fullsized":"2024-09-21T03:32:05.295215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339934+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:32:05.339934+0000","last_peered":"2024-09-21T03:32:05.339934+0000","last_clean":"2024-09-21T03:32:05.339934+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:32:05.339934+0000","last_undegraded":"2024-09-21T03:32:05.339934+0000","last_fullsized":"2024-09-21T03:32:05.339934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288740+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:05.288740+0000","last_peered":"2024-09-21T03:32:05.288740+0000","last_clean":"2024-09-21T03:32:05.288740+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:05.288740+0000","last_undegraded":"2024-09-21T03:32:05.288740+0000","last_fullsized":"2024-09-21T03:32:05.288740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340183+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:32:05.340183+0000","last_peered":"2024-09-21T03:32:05.340183+0000","last_clean":"2024-09-21T03:32:05.340183+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:32:05.340183+0000","last_undegraded":"2024-09-21T03:32:05.340183+0000","last_fullsized":"2024-09-21T03:32:05.340183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290760+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:05.290760+0000","last_peered":"2024-09-21T03:32:05.290760+0000","last_clean":"2024-09-21T03:32:05.290760+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:05.290760+0000","last_undegraded":"2024-09-21T03:32:05.290760+0000","last_fullsized":"2024-09-21T03:32:05.290760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293810+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:32:05.293810+0000","last_peered":"2024-09-21T03:32:05.293810+0000","last_clean":"2024-09-21T03:32:05.293810+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:32:05.293810+0000","last_undegraded":"2024-09-21T03:32:05.293810+0000","last_fullsized":"2024-09-21T03:32:05.293810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290013+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:05.290013+0000","last_peered":"2024-09-21T03:32:05.290013+0000","last_clean":"2024-09-21T03:32:05.290013+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:05.290013+0000","last_undegraded":"2024-09-21T03:32:05.290013+0000","last_fullsized":"2024-09-21T03:32:05.290013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:07.352398+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:07.352398+0000","last_peered":"2024-09-21T03:32:07.352398+0000","last_clean":"2024-09-21T03:32:07.352398+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:07.352398+0000","last_undegraded":"2024-09-21T03:32:07.352398+0000","last_fullsized":"2024-09-21T03:32:07.352398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289356+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:05.289356+0000","last_peered":"2024-09-21T03:32:05.289356+0000","last_clean":"2024-09-21T03:32:05.289356+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:05.289356+0000","last_undegraded":"2024-09-21T03:32:05.289356+0000","last_fullsized":"2024-09-21T03:32:05.289356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.304765+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:32:05.304765+0000","last_peered":"2024-09-21T03:32:05.304765+0000","last_clean":"2024-09-21T03:32:05.304765+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:32:05.304765+0000","last_undegraded":"2024-09-21T03:32:05.304765+0000","last_fullsized":"2024-09-21T03:32:05.304765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339935+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:32:05.339935+0000","last_peered":"2024-09-21T03:32:05.339935+0000","last_clean":"2024-09-21T03:32:05.339935+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:32:05.339935+0000","last_undegraded":"2024-09-21T03:32:05.339935+0000","last_fullsized":"2024-09-21T03:32:05.339935+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289031+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:05.289031+0000","last_peered":"2024-09-21T03:32:05.289031+0000","last_clean":"2024-09-21T03:32:05.289031+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:05.289031+0000","last_undegraded":"2024-09-21T03:32:05.289031+0000","last_fullsized":"2024-09-21T03:32:05.289031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":45,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:08.353152+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:08.353152+0000","last_peered":"2024-09-21T03:32:08.353152+0000","last_clean":"2024-09-21T03:32:08.353152+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:08.353152+0000","last_undegraded":"2024-09-21T03:32:08.353152+0000","last_fullsized":"2024-09-21T03:32:08.353152+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294332+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:32:05.294332+0000","last_peered":"2024-09-21T03:32:05.294332+0000","last_clean":"2024-09-21T03:32:05.294332+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:32:05.294332+0000","last_undegraded":"2024-09-21T03:32:05.294332+0000","last_fullsized":"2024-09-21T03:32:05.294332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289196+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:05.289196+0000","last_peered":"2024-09-21T03:32:05.289196+0000","last_clean":"2024-09-21T03:32:05.289196+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:05.289196+0000","last_undegraded":"2024-09-21T03:32:05.289196+0000","last_fullsized":"2024-09-21T03:32:05.289196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'25","reported_seq":93,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:09.354808+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:09.354808+0000","last_peered":"2024-09-21T03:32:09.354808+0000","last_clean":"2024-09-21T03:32:09.354808+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:09.354808+0000","last_undegraded":"2024-09-21T03:32:09.354808+0000","last_fullsized":"2024-09-21T03:32:09.354808+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":79,"num_write":26,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289088+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:05.289088+0000","last_peered":"2024-09-21T03:32:05.289088+0000","last_clean":"2024-09-21T03:32:05.289088+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:05.289088+0000","last_undegraded":"2024-09-21T03:32:05.289088+0000","last_fullsized":"2024-09-21T03:32:05.289088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":49,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:08.353314+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:08.353314+0000","last_peered":"2024-09-21T03:32:08.353314+0000","last_clean":"2024-09-21T03:32:08.353314+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:08.353314+0000","last_undegraded":"2024-09-21T03:32:08.353314+0000","last_fullsized":"2024-09-21T03:32:08.353314+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289284+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:05.289284+0000","last_peered":"2024-09-21T03:32:05.289284+0000","last_clean":"2024-09-21T03:32:05.289284+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:05.289284+0000","last_undegraded":"2024-09-21T03:32:05.289284+0000","last_fullsized":"2024-09-21T03:32:05.289284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290504+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:05.290504+0000","last_peered":"2024-09-21T03:32:05.290504+0000","last_clean":"2024-09-21T03:32:05.290504+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:05.290504+0000","last_undegraded":"2024-09-21T03:32:05.290504+0000","last_fullsized":"2024-09-21T03:32:05.290504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289263+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:05.289263+0000","last_peered":"2024-09-21T03:32:05.289263+0000","last_clean":"2024-09-21T03:32:05.289263+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:05.289263+0000","last_undegraded":"2024-09-21T03:32:05.289263+0000","last_fullsized":"2024-09-21T03:32:05.289263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287557+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:05.287557+0000","last_peered":"2024-09-21T03:32:05.287557+0000","last_clean":"2024-09-21T03:32:05.287557+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:05.287557+0000","last_undegraded":"2024-09-21T03:32:05.287557+0000","last_fullsized":"2024-09-21T03:32:05.287557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340133+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:32:05.340133+0000","last_peered":"2024-09-21T03:32:05.340133+0000","last_clean":"2024-09-21T03:32:05.340133+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:32:05.340133+0000","last_undegraded":"2024-09-21T03:32:05.340133+0000","last_fullsized":"2024-09-21T03:32:05.340133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":47,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:09.354173+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:09.354173+0000","last_peered":"2024-09-21T03:32:09.354173+0000","last_clean":"2024-09-21T03:32:09.354173+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:09.354173+0000","last_undegraded":"2024-09-21T03:32:09.354173+0000","last_fullsized":"2024-09-21T03:32:09.354173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288948+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:05.288948+0000","last_peered":"2024-09-21T03:32:05.288948+0000","last_clean":"2024-09-21T03:32:05.288948+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:05.288948+0000","last_undegraded":"2024-09-21T03:32:05.288948+0000","last_fullsized":"2024-09-21T03:32:05.288948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.300572+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:32:05.300572+0000","last_peered":"2024-09-21T03:32:05.300572+0000","last_clean":"2024-09-21T03:32:05.300572+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:32:05.300572+0000","last_undegraded":"2024-09-21T03:32:05.300572+0000","last_fullsized":"2024-09-21T03:32:05.300572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:06.509242+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:06.509242+0000","last_peered":"2024-09-21T03:32:06.509242+0000","last_clean":"2024-09-21T03:32:06.509242+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:06.509242+0000","last_undegraded":"2024-09-21T03:32:06.509242+0000","last_fullsized":"2024-09-21T03:32:06.509242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340238+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:32:05.340238+0000","last_peered":"2024-09-21T03:32:05.340238+0000","last_clean":"2024-09-21T03:32:05.340238+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:32:05.340238+0000","last_undegraded":"2024-09-21T03:32:05.340238+0000","last_fullsized":"2024-09-21T03:32:05.340238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287672+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:05.287672+0000","last_peered":"2024-09-21T03:32:05.287672+0000","last_clean":"2024-09-21T03:32:05.287672+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:05.287672+0000","last_undegraded":"2024-09-21T03:32:05.287672+0000","last_fullsized":"2024-09-21T03:32:05.287672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293740+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:32:05.293740+0000","last_peered":"2024-09-21T03:32:05.293740+0000","last_clean":"2024-09-21T03:32:05.293740+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:32:05.293740+0000","last_undegraded":"2024-09-21T03:32:05.293740+0000","last_fullsized":"2024-09-21T03:32:05.293740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340090+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:32:05.340090+0000","last_peered":"2024-09-21T03:32:05.340090+0000","last_clean":"2024-09-21T03:32:05.340090+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:32:05.340090+0000","last_undegraded":"2024-09-21T03:32:05.340090+0000","last_fullsized":"2024-09-21T03:32:05.340090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290664+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:05.290664+0000","last_peered":"2024-09-21T03:32:05.290664+0000","last_clean":"2024-09-21T03:32:05.290664+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:05.290664+0000","last_undegraded":"2024-09-21T03:32:05.290664+0000","last_fullsized":"2024-09-21T03:32:05.290664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340055+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:32:05.340055+0000","last_peered":"2024-09-21T03:32:05.340055+0000","last_clean":"2024-09-21T03:32:05.340055+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:32:05.340055+0000","last_undegraded":"2024-09-21T03:32:05.340055+0000","last_fullsized":"2024-09-21T03:32:05.340055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295022+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:32:05.295022+0000","last_peered":"2024-09-21T03:32:05.295022+0000","last_clean":"2024-09-21T03:32:05.295022+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:32:05.295022+0000","last_undegraded":"2024-09-21T03:32:05.295022+0000","last_fullsized":"2024-09-21T03:32:05.295022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294229+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:32:05.294229+0000","last_peered":"2024-09-21T03:32:05.294229+0000","last_clean":"2024-09-21T03:32:05.294229+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:32:05.294229+0000","last_undegraded":"2024-09-21T03:32:05.294229+0000","last_fullsized":"2024-09-21T03:32:05.294229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340409+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:32:05.340409+0000","last_peered":"2024-09-21T03:32:05.340409+0000","last_clean":"2024-09-21T03:32:05.340409+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:32:05.340409+0000","last_undegraded":"2024-09-21T03:32:05.340409+0000","last_fullsized":"2024-09-21T03:32:05.340409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340295+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:32:05.340295+0000","last_peered":"2024-09-21T03:32:05.340295+0000","last_clean":"2024-09-21T03:32:05.340295+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:32:05.340295+0000","last_undegraded":"2024-09-21T03:32:05.340295+0000","last_fullsized":"2024-09-21T03:32:05.340295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63484,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":140,"num_read_kb":137,"num_write":159,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":190452,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678035,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":424023,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874263,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":999424,"data_stored":1074965,"data_compressed":43548,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037789,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561068,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":1015771,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":424566,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":423937,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32100,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713052,"statfs":{"total":95995035648,"available":95962165248,"internally_reserved":0,"allocated":929792,"data_stored":484140,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509505,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":482511,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":424897,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":59092,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60721,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61061,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:15.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:15 smithi102 ceph-mon[31392]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:15.605 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:15 smithi102 ceph-mon[31392]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:15 smithi148 ceph-mon[34651]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:15 smithi148 ceph-mon[34651]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:15 smithi121 ceph-mon[34316]: from='client.15000 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:15.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:15 smithi121 ceph-mon[34316]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.8 KiB/s wr, 7 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T03:32:17.467 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:17.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:17 smithi102 ceph-mon[31392]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:17.720 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:17.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:17 smithi148 ceph-mon[34651]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:17 smithi121 ceph-mon[34316]: pgmap v283: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 -- 172.21.15.102:0/4046315169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 msgr2=0x7feaf80761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 --2- 172.21.15.102:0/4046315169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf80761e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009900 tx=0x7feaf402a410 comp rx=0 tx=0).stop 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 -- 172.21.15.102:0/4046315169 shutdown_connections 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 --2- 172.21.15.102:0/4046315169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf80761e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 --2- 172.21.15.102:0/4046315169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8114430 0x7feaf8116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 --2- 172.21.15.102:0/4046315169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8077380 0x7feaf80757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.260+0000 7feaffca9640 1 -- 172.21.15.102:0/4046315169 >> 172.21.15.102:0/4046315169 conn(0x7feaf807b850 msgr2=0x7feaf807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.261+0000 7feaffca9640 1 -- 172.21.15.102:0/4046315169 shutdown_connections 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.261+0000 7feaffca9640 1 -- 172.21.15.102:0/4046315169 wait complete. 2024-09-21T03:32:18.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.261+0000 7feaffca9640 1 Processor -- start 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.261+0000 7feaffca9640 1 -- start start 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 0x7feaf81a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8114430 0x7feaf81a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feaf811a1e0 con 0x7feaf8075dd0 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feaf811a060 con 0x7feaf8114430 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feaf811a360 con 0x7feaf8077380 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33646/0 (socket says 172.21.15.102:33646) 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 -- 172.21.15.102:0/1949123719 learned_addr learned my addr 172.21.15.102:0/1949123719 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafe246640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8114430 0x7feaf81a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafd244640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 0x7feaf81a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 -- 172.21.15.102:0/1949123719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 msgr2=0x7feaf81a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:18.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 0x7feaf81a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 -- 172.21.15.102:0/1949123719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8114430 msgr2=0x7feaf81a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8114430 0x7feaf81a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 -- 172.21.15.102:0/1949123719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf81a6a80 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafd244640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 0x7feaf81a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feafda45640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feaec00d950 tx=0x7feaec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec017030 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feaec004020 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf81a6d70 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec0047a0 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.262+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf81ad4d0 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.263+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf80761e0 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.265+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7feaec0041d0 con 0x7feaf8075dd0 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.266+0000 7feaeaffd640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 0x7feae40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:18.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.266+0000 7feafd244640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 0x7feae40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.267+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7feaec0e7790 con 0x7feaf8075dd0 2024-09-21T03:32:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.267+0000 7feafd244640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 0x7feae40b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feaf402a930 tx=0x7feaf4005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:18.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.269+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feaec0addc0 con 0x7feaf8075dd0 2024-09-21T03:32:18.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.448+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaf8113410 con 0x7feae40b65f0 2024-09-21T03:32:18.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.453+0000 7feaeaffd640 1 -- 172.21.15.102:0/1949123719 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259007 (secure 0 0 0) 0x7feaf8113410 con 0x7feae40b65f0 2024-09-21T03:32:18.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:18.457 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:18.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 msgr2=0x7feae40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:18.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 0x7feae40b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7feaf402a930 tx=0x7feaf4005fd0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 msgr2=0x7feaf81a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:18.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7feaec00d950 tx=0x7feaec00de10 comp rx=0 tx=0).stop 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 shutdown_connections 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feae40b65f0 0x7feae40b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feaf8114430 0x7feaf81a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feaf8077380 0x7feaf81a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 --2- 172.21.15.102:0/1949123719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaf8075dd0 0x7feaf81a0b10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.455+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 >> 172.21.15.102:0/1949123719 conn(0x7feaf807b850 msgr2=0x7feaf8112d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.456+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 shutdown_connections 2024-09-21T03:32:18.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:18.456+0000 7feaffca9640 1 -- 172.21.15.102:0/1949123719 wait complete. 2024-09-21T03:32:19.230 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-21T03:32:18.227501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657758,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":252,"num_read_kb":225,"num_write":285,"num_write_kb":2265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359808,"kb_used_data":10512,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582016,"statfs":{"total":1151940427776,"available":1151571984384,"internally_reserved":0,"allocated":10764288,"data_stored":7054302,"data_compressed":182511,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11824,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-1,"num_objects_degraded":-1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":47,"num_write":8,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003593"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291302+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:05.291302+0000","last_peered":"2024-09-21T03:32:05.291302+0000","last_clean":"2024-09-21T03:32:05.291302+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:05.291302+0000","last_undegraded":"2024-09-21T03:32:05.291302+0000","last_fullsized":"2024-09-21T03:32:05.291302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293620+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:32:05.293620+0000","last_peered":"2024-09-21T03:32:05.293620+0000","last_clean":"2024-09-21T03:32:05.293620+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:32:05.293620+0000","last_undegraded":"2024-09-21T03:32:05.293620+0000","last_fullsized":"2024-09-21T03:32:05.293620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293929+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:32:05.293929+0000","last_peered":"2024-09-21T03:32:05.293929+0000","last_clean":"2024-09-21T03:32:05.293929+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:32:05.293929+0000","last_undegraded":"2024-09-21T03:32:05.293929+0000","last_fullsized":"2024-09-21T03:32:05.293929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287476+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:05.287476+0000","last_peered":"2024-09-21T03:32:05.287476+0000","last_clean":"2024-09-21T03:32:05.287476+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:05.287476+0000","last_undegraded":"2024-09-21T03:32:05.287476+0000","last_fullsized":"2024-09-21T03:32:05.287476+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339877+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:32:05.339877+0000","last_peered":"2024-09-21T03:32:05.339877+0000","last_clean":"2024-09-21T03:32:05.339877+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:32:05.339877+0000","last_undegraded":"2024-09-21T03:32:05.339877+0000","last_fullsized":"2024-09-21T03:32:05.339877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287421+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:05.287421+0000","last_peered":"2024-09-21T03:32:05.287421+0000","last_clean":"2024-09-21T03:32:05.287421+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:05.287421+0000","last_undegraded":"2024-09-21T03:32:05.287421+0000","last_fullsized":"2024-09-21T03:32:05.287421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292770+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:32:05.292770+0000","last_peered":"2024-09-21T03:32:05.292770+0000","last_clean":"2024-09-21T03:32:05.292770+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:32:05.292770+0000","last_undegraded":"2024-09-21T03:32:05.292770+0000","last_fullsized":"2024-09-21T03:32:05.292770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292473+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:32:05.292473+0000","last_peered":"2024-09-21T03:32:05.292473+0000","last_clean":"2024-09-21T03:32:05.292473+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:32:05.292473+0000","last_undegraded":"2024-09-21T03:32:05.292473+0000","last_fullsized":"2024-09-21T03:32:05.292473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291444+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:05.291444+0000","last_peered":"2024-09-21T03:32:05.291444+0000","last_clean":"2024-09-21T03:32:05.291444+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:05.291444+0000","last_undegraded":"2024-09-21T03:32:05.291444+0000","last_fullsized":"2024-09-21T03:32:05.291444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295215+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:32:05.295215+0000","last_peered":"2024-09-21T03:32:05.295215+0000","last_clean":"2024-09-21T03:32:05.295215+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:32:05.295215+0000","last_undegraded":"2024-09-21T03:32:05.295215+0000","last_fullsized":"2024-09-21T03:32:05.295215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339934+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:32:05.339934+0000","last_peered":"2024-09-21T03:32:05.339934+0000","last_clean":"2024-09-21T03:32:05.339934+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:32:05.339934+0000","last_undegraded":"2024-09-21T03:32:05.339934+0000","last_fullsized":"2024-09-21T03:32:05.339934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288740+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:05.288740+0000","last_peered":"2024-09-21T03:32:05.288740+0000","last_clean":"2024-09-21T03:32:05.288740+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:05.288740+0000","last_undegraded":"2024-09-21T03:32:05.288740+0000","last_fullsized":"2024-09-21T03:32:05.288740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340183+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:32:05.340183+0000","last_peered":"2024-09-21T03:32:05.340183+0000","last_clean":"2024-09-21T03:32:05.340183+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:32:05.340183+0000","last_undegraded":"2024-09-21T03:32:05.340183+0000","last_fullsized":"2024-09-21T03:32:05.340183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290760+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:05.290760+0000","last_peered":"2024-09-21T03:32:05.290760+0000","last_clean":"2024-09-21T03:32:05.290760+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:05.290760+0000","last_undegraded":"2024-09-21T03:32:05.290760+0000","last_fullsized":"2024-09-21T03:32:05.290760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293810+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:32:05.293810+0000","last_peered":"2024-09-21T03:32:05.293810+0000","last_clean":"2024-09-21T03:32:05.293810+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:32:05.293810+0000","last_undegraded":"2024-09-21T03:32:05.293810+0000","last_fullsized":"2024-09-21T03:32:05.293810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290013+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:05.290013+0000","last_peered":"2024-09-21T03:32:05.290013+0000","last_clean":"2024-09-21T03:32:05.290013+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:05.290013+0000","last_undegraded":"2024-09-21T03:32:05.290013+0000","last_fullsized":"2024-09-21T03:32:05.290013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":55,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:12.359958+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:12.359958+0000","last_peered":"2024-09-21T03:32:12.359958+0000","last_clean":"2024-09-21T03:32:12.359958+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:12.359958+0000","last_undegraded":"2024-09-21T03:32:12.359958+0000","last_fullsized":"2024-09-21T03:32:12.359958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289356+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:05.289356+0000","last_peered":"2024-09-21T03:32:05.289356+0000","last_clean":"2024-09-21T03:32:05.289356+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:05.289356+0000","last_undegraded":"2024-09-21T03:32:05.289356+0000","last_fullsized":"2024-09-21T03:32:05.289356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.304765+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:32:05.304765+0000","last_peered":"2024-09-21T03:32:05.304765+0000","last_clean":"2024-09-21T03:32:05.304765+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:32:05.304765+0000","last_undegraded":"2024-09-21T03:32:05.304765+0000","last_fullsized":"2024-09-21T03:32:05.304765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339935+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:32:05.339935+0000","last_peered":"2024-09-21T03:32:05.339935+0000","last_clean":"2024-09-21T03:32:05.339935+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:32:05.339935+0000","last_undegraded":"2024-09-21T03:32:05.339935+0000","last_fullsized":"2024-09-21T03:32:05.339935+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289031+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:05.289031+0000","last_peered":"2024-09-21T03:32:05.289031+0000","last_clean":"2024-09-21T03:32:05.289031+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:05.289031+0000","last_undegraded":"2024-09-21T03:32:05.289031+0000","last_fullsized":"2024-09-21T03:32:05.289031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:13.361167+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:13.361167+0000","last_peered":"2024-09-21T03:32:13.361167+0000","last_clean":"2024-09-21T03:32:13.361167+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:13.361167+0000","last_undegraded":"2024-09-21T03:32:13.361167+0000","last_fullsized":"2024-09-21T03:32:13.361167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294332+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:32:05.294332+0000","last_peered":"2024-09-21T03:32:05.294332+0000","last_clean":"2024-09-21T03:32:05.294332+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:32:05.294332+0000","last_undegraded":"2024-09-21T03:32:05.294332+0000","last_fullsized":"2024-09-21T03:32:05.294332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289196+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:05.289196+0000","last_peered":"2024-09-21T03:32:05.289196+0000","last_clean":"2024-09-21T03:32:05.289196+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:05.289196+0000","last_undegraded":"2024-09-21T03:32:05.289196+0000","last_fullsized":"2024-09-21T03:32:05.289196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'26","reported_seq":105,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:14.362607+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:14.362607+0000","last_peered":"2024-09-21T03:32:14.362607+0000","last_clean":"2024-09-21T03:32:14.362607+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:14.362607+0000","last_undegraded":"2024-09-21T03:32:14.362607+0000","last_fullsized":"2024-09-21T03:32:14.362607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":88,"num_write":27,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289088+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:05.289088+0000","last_peered":"2024-09-21T03:32:05.289088+0000","last_clean":"2024-09-21T03:32:05.289088+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:05.289088+0000","last_undegraded":"2024-09-21T03:32:05.289088+0000","last_fullsized":"2024-09-21T03:32:05.289088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":54,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:13.361303+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:13.361303+0000","last_peered":"2024-09-21T03:32:13.361303+0000","last_clean":"2024-09-21T03:32:13.361303+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:13.361303+0000","last_undegraded":"2024-09-21T03:32:13.361303+0000","last_fullsized":"2024-09-21T03:32:13.361303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289284+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:05.289284+0000","last_peered":"2024-09-21T03:32:05.289284+0000","last_clean":"2024-09-21T03:32:05.289284+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:05.289284+0000","last_undegraded":"2024-09-21T03:32:05.289284+0000","last_fullsized":"2024-09-21T03:32:05.289284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290504+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:05.290504+0000","last_peered":"2024-09-21T03:32:05.290504+0000","last_clean":"2024-09-21T03:32:05.290504+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:05.290504+0000","last_undegraded":"2024-09-21T03:32:05.290504+0000","last_fullsized":"2024-09-21T03:32:05.290504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289263+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:05.289263+0000","last_peered":"2024-09-21T03:32:05.289263+0000","last_clean":"2024-09-21T03:32:05.289263+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:05.289263+0000","last_undegraded":"2024-09-21T03:32:05.289263+0000","last_fullsized":"2024-09-21T03:32:05.289263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287557+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:05.287557+0000","last_peered":"2024-09-21T03:32:05.287557+0000","last_clean":"2024-09-21T03:32:05.287557+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:05.287557+0000","last_undegraded":"2024-09-21T03:32:05.287557+0000","last_fullsized":"2024-09-21T03:32:05.287557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340133+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:32:05.340133+0000","last_peered":"2024-09-21T03:32:05.340133+0000","last_clean":"2024-09-21T03:32:05.340133+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:32:05.340133+0000","last_undegraded":"2024-09-21T03:32:05.340133+0000","last_fullsized":"2024-09-21T03:32:05.340133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":52,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:14.362402+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:14.362402+0000","last_peered":"2024-09-21T03:32:14.362402+0000","last_clean":"2024-09-21T03:32:14.362402+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:14.362402+0000","last_undegraded":"2024-09-21T03:32:14.362402+0000","last_fullsized":"2024-09-21T03:32:14.362402+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288948+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:05.288948+0000","last_peered":"2024-09-21T03:32:05.288948+0000","last_clean":"2024-09-21T03:32:05.288948+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:05.288948+0000","last_undegraded":"2024-09-21T03:32:05.288948+0000","last_fullsized":"2024-09-21T03:32:05.288948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.300572+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:32:05.300572+0000","last_peered":"2024-09-21T03:32:05.300572+0000","last_clean":"2024-09-21T03:32:05.300572+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:32:05.300572+0000","last_undegraded":"2024-09-21T03:32:05.300572+0000","last_fullsized":"2024-09-21T03:32:05.300572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:06.509242+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:06.509242+0000","last_peered":"2024-09-21T03:32:06.509242+0000","last_clean":"2024-09-21T03:32:06.509242+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:06.509242+0000","last_undegraded":"2024-09-21T03:32:06.509242+0000","last_fullsized":"2024-09-21T03:32:06.509242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340238+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:32:05.340238+0000","last_peered":"2024-09-21T03:32:05.340238+0000","last_clean":"2024-09-21T03:32:05.340238+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:32:05.340238+0000","last_undegraded":"2024-09-21T03:32:05.340238+0000","last_fullsized":"2024-09-21T03:32:05.340238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287672+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:05.287672+0000","last_peered":"2024-09-21T03:32:05.287672+0000","last_clean":"2024-09-21T03:32:05.287672+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:05.287672+0000","last_undegraded":"2024-09-21T03:32:05.287672+0000","last_fullsized":"2024-09-21T03:32:05.287672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293740+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:32:05.293740+0000","last_peered":"2024-09-21T03:32:05.293740+0000","last_clean":"2024-09-21T03:32:05.293740+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:32:05.293740+0000","last_undegraded":"2024-09-21T03:32:05.293740+0000","last_fullsized":"2024-09-21T03:32:05.293740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340090+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:32:05.340090+0000","last_peered":"2024-09-21T03:32:05.340090+0000","last_clean":"2024-09-21T03:32:05.340090+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:32:05.340090+0000","last_undegraded":"2024-09-21T03:32:05.340090+0000","last_fullsized":"2024-09-21T03:32:05.340090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290664+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:05.290664+0000","last_peered":"2024-09-21T03:32:05.290664+0000","last_clean":"2024-09-21T03:32:05.290664+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:05.290664+0000","last_undegraded":"2024-09-21T03:32:05.290664+0000","last_fullsized":"2024-09-21T03:32:05.290664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340055+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:32:05.340055+0000","last_peered":"2024-09-21T03:32:05.340055+0000","last_clean":"2024-09-21T03:32:05.340055+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:32:05.340055+0000","last_undegraded":"2024-09-21T03:32:05.340055+0000","last_fullsized":"2024-09-21T03:32:05.340055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295022+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:32:05.295022+0000","last_peered":"2024-09-21T03:32:05.295022+0000","last_clean":"2024-09-21T03:32:05.295022+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:32:05.295022+0000","last_undegraded":"2024-09-21T03:32:05.295022+0000","last_fullsized":"2024-09-21T03:32:05.295022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294229+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:32:05.294229+0000","last_peered":"2024-09-21T03:32:05.294229+0000","last_clean":"2024-09-21T03:32:05.294229+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:32:05.294229+0000","last_undegraded":"2024-09-21T03:32:05.294229+0000","last_fullsized":"2024-09-21T03:32:05.294229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340409+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:32:05.340409+0000","last_peered":"2024-09-21T03:32:05.340409+0000","last_clean":"2024-09-21T03:32:05.340409+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:32:05.340409+0000","last_undegraded":"2024-09-21T03:32:05.340409+0000","last_fullsized":"2024-09-21T03:32:05.340409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340295+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:32:05.340295+0000","last_peered":"2024-09-21T03:32:05.340295+0000","last_clean":"2024-09-21T03:32:05.340295+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:32:05.340295+0000","last_undegraded":"2024-09-21T03:32:05.340295+0000","last_fullsized":"2024-09-21T03:32:05.340295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67156,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":171,"num_read_kb":156,"num_write":160,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":201468,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678036,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":424023,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874264,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1078637,"data_compressed":43548,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037790,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201315,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397543,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561069,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":1015771,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920822,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":424566,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117052,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":423937,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378689,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":487812,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":486183,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705739,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":424897,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":62764,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64393,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":64733,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:19.234 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:32:19.234 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T03:32:19.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T03:32:19.481 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:19.602 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:19 smithi102 ceph-mon[31392]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:19 smithi148 ceph-mon[34651]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:19 smithi121 ceph-mon[34316]: pgmap v284: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2024-09-21T03:32:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 -- 172.21.15.102:0/1212364230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 msgr2=0x7feb3c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 --2- 172.21.15.102:0/1212364230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c110630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feb34009ca0 tx=0x7feb3402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 -- 172.21.15.102:0/1212364230 shutdown_connections 2024-09-21T03:32:19.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 --2- 172.21.15.102:0/1212364230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c110630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 --2- 172.21.15.102:0/1212364230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c1094b0 0x7feb3c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 --2- 172.21.15.102:0/1212364230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c103b70 0x7feb3c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 -- 172.21.15.102:0/1212364230 >> 172.21.15.102:0/1212364230 conn(0x7feb3c0ff5a0 msgr2=0x7feb3c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 -- 172.21.15.102:0/1212364230 shutdown_connections 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.980+0000 7feb43955640 1 -- 172.21.15.102:0/1212364230 wait complete. 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.981+0000 7feb43955640 1 Processor -- start 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.981+0000 7feb43955640 1 -- start start 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.981+0000 7feb43955640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c103b70 0x7feb3c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.981+0000 7feb43955640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c1094b0 0x7feb3c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c113c00 con 0x7feb3c109e00 2024-09-21T03:32:19.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c113a80 con 0x7feb3c1094b0 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c113d80 con 0x7feb3c103b70 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33654/0 (socket says 172.21.15.102:33654) 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 -- 172.21.15.102:0/103957231 learned_addr learned my addr 172.21.15.102:0/103957231 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb416f1640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c103b70 0x7feb3c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb40ef0640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c1094b0 0x7feb3c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 -- 172.21.15.102:0/103957231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c103b70 msgr2=0x7feb3c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c103b70 0x7feb3c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 -- 172.21.15.102:0/103957231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c1094b0 msgr2=0x7feb3c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c1094b0 0x7feb3c19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 -- 172.21.15.102:0/103957231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c1a04c0 con 0x7feb3c109e00 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb41ef2640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb34005e30 tx=0x7feb34003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34031650 con 0x7feb3c109e00 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feb340317f0 con 0x7feb3c109e00 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb3402fb70 con 0x7feb3c109e00 2024-09-21T03:32:19.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c1a0750 con 0x7feb3c109e00 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.982+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c1a6f10 con 0x7feb3c109e00 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.983+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c103f80 con 0x7feb3c109e00 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.985+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7feb3402fd10 con 0x7feb3c109e00 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.986+0000 7feb327fc640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 0x7feb280b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.986+0000 7feb416f1640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 0x7feb280b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.986+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7feb34108ad0 con 0x7feb3c109e00 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.986+0000 7feb416f1640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 0x7feb280b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb380058c0 tx=0x7feb3800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:19.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:19.989+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb340cf100 con 0x7feb3c109e00 2024-09-21T03:32:20.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.237+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7feb3c10bbf0 con 0x7feb3c109e00 2024-09-21T03:32:20.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.240+0000 7feb327fc640 1 -- 172.21.15.102:0/103957231 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7feb340d34e0 con 0x7feb3c109e00 2024-09-21T03:32:20.242 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-21T03:32:20.242 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBEPu5mfco7DhAA0DemxDNANGoSKxO7B0v3vg== 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 msgr2=0x7feb280b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 0x7feb280b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7feb380058c0 tx=0x7feb3800a4c0 comp rx=0 tx=0).stop 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 msgr2=0x7feb3c19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7feb34005e30 tx=0x7feb34003f90 comp rx=0 tx=0).stop 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 shutdown_connections 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feb280b6670 0x7feb280b8b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb3c109e00 0x7feb3c19fd90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:20.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feb3c1094b0 0x7feb3c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 --2- 172.21.15.102:0/103957231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feb3c103b70 0x7feb3c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 >> 172.21.15.102:0/103957231 conn(0x7feb3c0ff5a0 msgr2=0x7feb3c1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 shutdown_connections 2024-09-21T03:32:20.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:20.242+0000 7feb43955640 1 -- 172.21.15.102:0/103957231 wait complete. 2024-09-21T03:32:20.561 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:20 smithi102 ceph-mon[31392]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:20.561 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:20 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:32:20.561 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:20 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:32:20.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:20 smithi148 ceph-mon[34651]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:20 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:32:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:20 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:32:20.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:20 smithi121 ceph-mon[34316]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:20 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T03:32:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:20 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/103957231' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T03:32:21.007 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:32:21.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T03:32:21.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T03:32:21.043 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T03:32:21.330 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:21.610 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:21 smithi102 ceph-mon[31392]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T03:32:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:21 smithi148 ceph-mon[34651]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T03:32:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:21 smithi121 ceph-mon[34316]: pgmap v285: 97 pgs: 97 active+clean; 642 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s; 1 B/s, 0 objects/s recovering 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.832+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1888579837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac0103b60 msgr2=0x7f5ac0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.832+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1888579837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac0103b60 0x7f5ac0103f70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009900 tx=0x7f5ab002a410 comp rx=0 tx=0).stop 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1888579837 shutdown_connections 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1888579837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0109df0 0x7f5ac0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1888579837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac01094a0 0x7f5ac01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:21.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1888579837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac0103b60 0x7f5ac0103f70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1888579837 >> 172.21.15.102:0/1888579837 conn(0x7f5ac007b850 msgr2=0x7f5ac007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1888579837 shutdown_connections 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1888579837 wait complete. 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.833+0000 7f5ac4b3a640 1 Processor -- start 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 -- start start 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0103b60 0x7f5ac019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 0x7f5ac019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113bf0 con 0x7f5ac01094a0 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113a70 con 0x7f5ac0103b60 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5ac4b3a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac0113d70 con 0x7f5ac0109df0 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33682/0 (socket says 172.21.15.102:33682) 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 -- 172.21.15.102:0/1489916440 learned_addr learned my addr 172.21.15.102:0/1489916440 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:21.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abe59c640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0103b60 0x7f5ac019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abed9d640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 0x7f5ac019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 -- 172.21.15.102:0/1489916440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 msgr2=0x7f5ac019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 0x7f5ac019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 -- 172.21.15.102:0/1489916440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0103b60 msgr2=0x7f5ac019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0103b60 0x7f5ac019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 -- 172.21.15.102:0/1489916440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01a04f0 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abed9d640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 0x7f5ac019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5abdd9b640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d750 tx=0x7f5ab400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.834+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4017070 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.835+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac01a07e0 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.835+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ab40054f0 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.835+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab4004d90 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.835+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a6f40 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.836+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0103f70 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.837+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f5ab4005020 con 0x7f5ac01094a0 2024-09-21T03:32:21.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.838+0000 7f5aaf7fe640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 0x7f5aa80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:21.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.838+0000 7f5abe59c640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 0x7f5aa80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:21.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.838+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f5ab40e7020 con 0x7f5ac01094a0 2024-09-21T03:32:21.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.838+0000 7f5abe59c640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 0x7f5aa80b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009230 tx=0x7f5ab00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:21.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:21.842+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ab4005310 con 0x7f5ac01094a0 2024-09-21T03:32:22.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.020+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5ac010b630 con 0x7f5ac01094a0 2024-09-21T03:32:22.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.021+0000 7f5aaf7fe640 1 -- 172.21.15.102:0/1489916440 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v55) ==== 86+0+133 (secure 0 0 0) 0x7f5ab40ad650 con 0x7f5ac01094a0 2024-09-21T03:32:22.022 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 msgr2=0x7f5aa80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 0x7f5aa80b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009230 tx=0x7f5ab00058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 msgr2=0x7f5ac019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ab400d750 tx=0x7f5ab400dc10 comp rx=0 tx=0).stop 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 shutdown_connections 2024-09-21T03:32:22.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5aa80b65f0 0x7f5aa80b8b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ac01094a0 0x7f5ac019ab20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ac0109df0 0x7f5ac019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 --2- 172.21.15.102:0/1489916440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ac0103b60 0x7f5ac019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 >> 172.21.15.102:0/1489916440 conn(0x7f5ac007b850 msgr2=0x7f5ac01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 shutdown_connections 2024-09-21T03:32:22.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:22.023+0000 7f5ac4b3a640 1 -- 172.21.15.102:0/1489916440 wait complete. 2024-09-21T03:32:22.694 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1489916440' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:32:22.722 INFO:teuthology.orchestra.run.smithi102.stdout:[{"version":55,"timestamp":"2024-09-21T03:31:30.977086+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T03:32:22.722 INFO:tasks.ceph_manager:config epoch is 55 2024-09-21T03:32:22.723 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T03:32:22.723 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T03:32:22.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T03:32:22.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1489916440' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:32:22.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1489916440' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T03:32:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:23.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/1089677996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 msgr2=0x7fe2c8104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/1089677996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8104c70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009900 tx=0x7fe2b802a410 comp rx=0 tx=0).stop 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/1089677996 shutdown_connections 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/1089677996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c810de10 0x7fe2c8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/1089677996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c8105290 0x7fe2c810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/1089677996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8104c70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/1089677996 >> 172.21.15.102:0/1089677996 conn(0x7fe2c8079740 msgr2=0x7fe2c8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/1089677996 shutdown_connections 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.480+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/1089677996 wait complete. 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.481+0000 7fe2ce9a5640 1 Processor -- start 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.481+0000 7fe2ce9a5640 1 -- start start 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.481+0000 7fe2ce9a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c8105290 0x7fe2c8102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:23.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 0x7fe2c81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8113bf0 con 0x7fe2c8104860 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8113a70 con 0x7fe2c810de10 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8113d70 con 0x7fe2c8105290 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33686/0 (socket says 172.21.15.102:33686) 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 -- 172.21.15.102:0/2028855771 learned_addr learned my addr 172.21.15.102:0/2028855771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ccf42640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 0x7fe2c81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c77fe640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c8105290 0x7fe2c8102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 -- 172.21.15.102:0/2028855771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c8105290 msgr2=0x7fe2c8102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c8105290 0x7fe2c8102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 -- 172.21.15.102:0/2028855771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 msgr2=0x7fe2c81031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 0x7fe2c81031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 -- 172.21.15.102:0/2028855771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c81a8820 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ccf42640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 0x7fe2c81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c7fff640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8005940 tx=0x7fe2b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b803f030 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe2b8031910 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c81a8ab0 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.482+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8035070 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.483+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c81a8f90 con 0x7fe2c8104860 2024-09-21T03:32:23.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.483+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c806c1e0 con 0x7fe2c8104860 2024-09-21T03:32:23.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.486+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fe2b8042030 con 0x7fe2c8104860 2024-09-21T03:32:23.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.487+0000 7fe2c57fa640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 0x7fe2b00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:23.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.487+0000 7fe2c77fe640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 0x7fe2b00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:23.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.487+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fe2b8107ff0 con 0x7fe2c8104860 2024-09-21T03:32:23.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.487+0000 7fe2c77fe640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 0x7fe2b00b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005fd0 tx=0x7fe2bc005c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:23.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.490+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2b80ce5c0 con 0x7fe2c8104860 2024-09-21T03:32:23.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:23 smithi102 ceph-mon[31392]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:32:23.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.713+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe2c8103a70 con 0x7fe2c8104860 2024-09-21T03:32:23.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.718+0000 7fe2c57fa640 1 -- 172.21.15.102:0/2028855771 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296463 (secure 0 0 0) 0x7fe2b80d29a0 con 0x7fe2c8104860 2024-09-21T03:32:23.720 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 msgr2=0x7fe2b00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 0x7fe2b00b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc005fd0 tx=0x7fe2bc005c70 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 msgr2=0x7fe2c8102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8005940 tx=0x7fe2b80042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 shutdown_connections 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe2b00b65f0 0x7fe2b00b8b00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2c810de10 0x7fe2c81031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe2c8105290 0x7fe2c8102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 --2- 172.21.15.102:0/2028855771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe2c8104860 0x7fe2c8102770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 >> 172.21.15.102:0/2028855771 conn(0x7fe2c8079740 msgr2=0x7fe2c80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 shutdown_connections 2024-09-21T03:32:23.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:23.721+0000 7fe2ce9a5640 1 -- 172.21.15.102:0/2028855771 wait complete. 2024-09-21T03:32:23.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:23 smithi148 ceph-mon[34651]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:32:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:23 smithi121 ceph-mon[34316]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.4 KiB/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:32:24.559 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":21,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":1995339284},{"type":"v1","addr":"172.21.15.102:6801","nonce":1995339284}]},"active_addr":"172.21.15.102:6801/1995339284","active_change":"2024-09-21T03:25:04.133551+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24133,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.102:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3866174137}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1160500341}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":4044459360}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2360690256}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1907808287}]}]} 2024-09-21T03:32:24.565 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T03:32:24.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T03:32:24.565 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:32:24.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:24 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2028855771' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:32:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:24 smithi102 ceph-mon[31392]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:24 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2028855771' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:32:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:24 smithi148 ceph-mon[34651]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T03:32:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:24 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2028855771' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T03:32:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:24 smithi121 ceph-mon[34316]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T03:32:24.813 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:25.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 -- 172.21.15.102:0/2811204207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 msgr2=0x7f22681098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:25.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2811204207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f22681098b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f225c009900 tx=0x7f225c02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:25.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 -- 172.21.15.102:0/2811204207 shutdown_connections 2024-09-21T03:32:25.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2811204207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f22681098b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2811204207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 0x7f2268110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2811204207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 -- 172.21.15.102:0/2811204207 >> 172.21.15.102:0/2811204207 conn(0x7f226807b850 msgr2=0x7f226807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 -- 172.21.15.102:0/2811204207 shutdown_connections 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.262+0000 7f226e4b7640 1 -- 172.21.15.102:0/2811204207 wait complete. 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 Processor -- start 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 -- start start 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 0x7f2268076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2268113bd0 con 0x7f22681094a0 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2268113a50 con 0x7f2268103b60 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f226e4b7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2268113d50 con 0x7f2268109df0 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f22677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:25.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f22677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59138/0 (socket says 172.21.15.102:59138) 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.263+0000 7f22677fe640 1 -- 172.21.15.102:0/2260518494 learned_addr learned my addr 172.21.15.102:0/2260518494 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f226ca54640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 0x7f2268076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f2267fff640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 -- 172.21.15.102:0/2260518494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 msgr2=0x7f2268076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 0x7f2268076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 -- 172.21.15.102:0/2260518494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 msgr2=0x7f2268075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 -- 172.21.15.102:0/2260518494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22681a8810 con 0x7f22681094a0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f2267fff640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22677fe640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f225c005940 tx=0x7f225c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c03f030 con 0x7f22681094a0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22681a8aa0 con 0x7f22681094a0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f225c031910 con 0x7f22681094a0 2024-09-21T03:32:25.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22681a8f80 con 0x7f22681094a0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.264+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c049060 con 0x7f22681094a0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.265+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2268103f70 con 0x7f22681094a0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.267+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f225c042030 con 0x7f22681094a0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.267+0000 7f22657fa640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.267+0000 7f2267fff640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.267+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f225c107e80 con 0x7f22681094a0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.268+0000 7f2267fff640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 0x7f22500b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2258005d00 tx=0x7f2258005ef0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:25.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.272+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f225c0ce4b0 con 0x7f22681094a0 2024-09-21T03:32:25.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.453+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f226810b630 con 0x7f22681094a0 2024-09-21T03:32:25.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.454+0000 7f22657fa640 1 -- 172.21.15.102:0/2260518494 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+23198 (secure 0 0 0) 0x7f225c0d2890 con 0x7f22681094a0 2024-09-21T03:32:25.457 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:25.457 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:32:05.282333+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 msgr2=0x7f22500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 0x7f22500b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2258005d00 tx=0x7f2258005ef0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 msgr2=0x7f2268075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f225c005940 tx=0x7f225c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 shutdown_connections 2024-09-21T03:32:25.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22500b65f0 0x7f22500b8b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22681094a0 0x7f2268075c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2268109df0 0x7f2268076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 --2- 172.21.15.102:0/2260518494 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2268103b60 0x7f2268075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 >> 172.21.15.102:0/2260518494 conn(0x7f226807b850 msgr2=0x7f22681075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 shutdown_connections 2024-09-21T03:32:25.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:25.457+0000 7f226e4b7640 1 -- 172.21.15.102:0/2260518494 wait complete. 2024-09-21T03:32:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:25 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2260518494' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:25.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:25 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2260518494' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:25.993 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:25 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2260518494' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:26.289 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T03:32:26.289 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:32:26.538 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:26.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:26 smithi121 ceph-mon[34316]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:32:26.807 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:26 smithi102 ceph-mon[31392]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:32:26.993 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:26 smithi148 ceph-mon[34651]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 -- 172.21.15.102:0/3972605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 msgr2=0x7fbcb810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/3972605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb810d870 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbca0009900 tx=0x7fbca002a410 comp rx=0 tx=0).stop 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 -- 172.21.15.102:0/3972605644 shutdown_connections 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/3972605644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb810d870 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/3972605644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb810de30 0x7fbcb8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/3972605644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb81049d0 0x7fbcb8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 -- 172.21.15.102:0/3972605644 >> 172.21.15.102:0/3972605644 conn(0x7fbcb8079740 msgr2=0x7fbcb8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:27.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 -- 172.21.15.102:0/3972605644 shutdown_connections 2024-09-21T03:32:27.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.047+0000 7fbcbe55b640 1 -- 172.21.15.102:0/3972605644 wait complete. 2024-09-21T03:32:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 Processor -- start 2024-09-21T03:32:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 -- start start 2024-09-21T03:32:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb81049d0 0x7fbcb819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:27.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 0x7fbcb819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8113c10 con 0x7fbcb8105320 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8113a90 con 0x7fbcb810de30 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbe55b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb8113d90 con 0x7fbcb81049d0 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59156/0 (socket says 172.21.15.102:59156) 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 -- 172.21.15.102:0/546207387 learned_addr learned my addr 172.21.15.102:0/546207387 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcb7fff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb81049d0 0x7fbcb819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbcaf8640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 0x7fbcb819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 -- 172.21.15.102:0/546207387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb81049d0 msgr2=0x7fbcb819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb81049d0 0x7fbcb819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 -- 172.21.15.102:0/546207387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 msgr2=0x7fbcb819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 0x7fbcb819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcaffff640 1 -- 172.21.15.102:0/546207387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb81a0570 con 0x7fbcb8105320 2024-09-21T03:32:27.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.048+0000 7fbcbcaf8640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 0x7fbcb819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcaffff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbca0005940 tx=0x7fbca0004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca003f030 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbca0003cd0 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca0035070 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb81a0800 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.049+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb81a6fc0 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.050+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb8104de0 con 0x7fbcb8105320 2024-09-21T03:32:27.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.051+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fbca0042030 con 0x7fbcb8105320 2024-09-21T03:32:27.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.053+0000 7fbcb5ffb640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 0x7fbca40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:27.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.053+0000 7fbcb7fff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 0x7fbca40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:27.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.053+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fbca0107f20 con 0x7fbcb8105320 2024-09-21T03:32:27.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.053+0000 7fbcb7fff640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 0x7fbca40b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806c620 tx=0x7fbca800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:27.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.056+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbca00ce550 con 0x7fbcb8105320 2024-09-21T03:32:27.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.235+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcb81a7220 con 0x7fbcb8105320 2024-09-21T03:32:27.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.236+0000 7fbcb5ffb640 1 -- 172.21.15.102:0/546207387 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+23198 (secure 0 0 0) 0x7fbca00d2930 con 0x7fbcb8105320 2024-09-21T03:32:27.238 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:27.238 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":79,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:32:05.282333+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:32:27.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 msgr2=0x7fbca40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:27.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 0x7fbca40b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbcb806c620 tx=0x7fbca800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 msgr2=0x7fbcb819aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbca0005940 tx=0x7fbca0004360 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 shutdown_connections 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbca40b65f0 0x7fbca40b8b00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbcb8105320 0x7fbcb819aba0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcb810de30 0x7fbcb819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 --2- 172.21.15.102:0/546207387 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbcb81049d0 0x7fbcb819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 >> 172.21.15.102:0/546207387 conn(0x7fbcb8079740 msgr2=0x7fbcb80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 shutdown_connections 2024-09-21T03:32:27.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:27.238+0000 7fbcbe55b640 1 -- 172.21.15.102:0/546207387 wait complete. 2024-09-21T03:32:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:27 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/546207387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:27.940 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:27 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/546207387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:27.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T03:32:27.969 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T03:32:27.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T03:32:27.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T03:32:27.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T03:32:27.971 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T03:32:27.971 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T03:32:27.971 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T03:32:27.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T03:32:27.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T03:32:27.972 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T03:32:27.973 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T03:32:27.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:27 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/546207387' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:32:28.768 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.768 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.769 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.770 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.772 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.773 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.784 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.784 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.784 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.784 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:28 smithi121 ceph-mon[34316]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:28.787 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.793 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:28.913 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:28 smithi102 ceph-mon[31392]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:28.993 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:28 smithi148 ceph-mon[34651]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 -- 172.21.15.102:0/108067253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 msgr2=0x7fba30110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 --2- 172.21.15.102:0/108067253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba30110640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fba20009ca0 tx=0x7fba2002a8e0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 -- 172.21.15.102:0/108067253 shutdown_connections 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 --2- 172.21.15.102:0/108067253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba30110640 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 --2- 172.21.15.102:0/108067253 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301094c0 0x7fba301098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 --2- 172.21.15.102:0/108067253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba30103b80 0x7fba30103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 -- 172.21.15.102:0/108067253 >> 172.21.15.102:0/108067253 conn(0x7fba300ff5b0 msgr2=0x7fba30101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 -- 172.21.15.102:0/108067253 shutdown_connections 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.646+0000 7fba355dd640 1 -- 172.21.15.102:0/108067253 wait complete. 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 Processor -- start 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 -- start start 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba30103b80 0x7fba3019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301094c0 0x7fba3019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba3019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba30113c00 con 0x7fba30109e10 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba30113a80 con 0x7fba30103b80 2024-09-21T03:32:29.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba355dd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba30113d80 con 0x7fba301094c0 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba3019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba3019fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59172/0 (socket says 172.21.15.102:59172) 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba2f7fe640 1 -- 172.21.15.102:0/2956635372 learned_addr learned my addr 172.21.15.102:0/2956635372 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba2e7fc640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301094c0 0x7fba3019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.647+0000 7fba2effd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba30103b80 0x7fba3019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 -- 172.21.15.102:0/2956635372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301094c0 msgr2=0x7fba3019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba301094c0 0x7fba3019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 -- 172.21.15.102:0/2956635372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba30103b80 msgr2=0x7fba3019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba30103b80 0x7fba3019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba301a04c0 con 0x7fba30109e10 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba2f7fe640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba3019fd90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba20009dc0 tx=0x7fba20003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20004040 con 0x7fba30109e10 2024-09-21T03:32:29.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba200046b0 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20030d90 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba301a0750 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.648+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba301a6f10 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.649+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba30063b50 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.651+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fba200305e0 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba17fff640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba180b65f0 0x7fba180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba2effd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba180b65f0 0x7fba180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fba20108b20 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba17fff640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] conn(0x7fba180c0460 0x7fba180c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba180c3020 con 0x7fba180c0460 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fba20108f70 con 0x7fba30109e10 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba2e7fc640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] conn(0x7fba180c0460 0x7fba180c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba2effd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba180b65f0 0x7fba180b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba280058c0 tx=0x7fba2800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:29.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.652+0000 7fba2e7fc640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] conn(0x7fba180c0460 0x7fba180c2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:29.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.653+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== osd.9 v2:172.21.15.102:6826/171485892 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fba180c3020 con 0x7fba180c0460 2024-09-21T03:32:29.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.666+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 --> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fba30063fd0 con 0x7fba180c0460 2024-09-21T03:32:29.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba17fff640 1 -- 172.21.15.102:0/2956635372 <== osd.9 v2:172.21.15.102:6826/171485892 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fba30063fd0 con 0x7fba180c0460 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] conn(0x7fba180c0460 msgr2=0x7fba180c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] conn(0x7fba180c0460 0x7fba180c2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba180b65f0 msgr2=0x7fba180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba180b65f0 0x7fba180b8b00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba280058c0 tx=0x7fba2800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 msgr2=0x7fba3019fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 --2- 172.21.15.102:0/2956635372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba30109e10 0x7fba3019fd90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba20009dc0 tx=0x7fba20003ba0 comp rx=0 tx=0).stop 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba2f7fe640 1 -- 172.21.15.102:0/2956635372 reap_dead start 2024-09-21T03:32:29.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 shutdown_connections 2024-09-21T03:32:29.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 >> 172.21.15.102:0/2956635372 conn(0x7fba300ff5b0 msgr2=0x7fba301069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:29.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 shutdown_connections 2024-09-21T03:32:29.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:29.667+0000 7fba355dd640 1 -- 172.21.15.102:0/2956635372 wait complete. 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 -- 172.21.15.102:0/1078849797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c103b60 msgr2=0x7f537c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 --2- 172.21.15.102:0/1078849797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c103b60 0x7f537c103f70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f536c009900 tx=0x7f536c02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 -- 172.21.15.102:0/1078849797 shutdown_connections 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 --2- 172.21.15.102:0/1078849797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f537c109df0 0x7f537c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 --2- 172.21.15.102:0/1078849797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c1094a0 0x7f537c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 --2- 172.21.15.102:0/1078849797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c103b60 0x7f537c103f70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 -- 172.21.15.102:0/1078849797 >> 172.21.15.102:0/1078849797 conn(0x7f537c07b850 msgr2=0x7f537c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 -- 172.21.15.102:0/1078849797 shutdown_connections 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.536+0000 7f5381e33640 1 -- 172.21.15.102:0/1078849797 wait complete. 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 Processor -- start 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 -- start start 2024-09-21T03:32:30.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c103b60 0x7f537c19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 0x7f537c19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f537c109df0 0x7f537c19ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f537c113c50 con 0x7f537c1094a0 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f537c113ad0 con 0x7f537c103b60 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5381e33640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f537c113dd0 con 0x7f537c109df0 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 0x7f537c19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5372ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 0x7f537c19ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59186/0 (socket says 172.21.15.102:59186) 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.537+0000 7f5372ffd640 1 -- 172.21.15.102:0/4045336670 learned_addr learned my addr 172.21.15.102:0/4045336670 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f537bfff640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f537c109df0 0x7f537c19ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f537b7fe640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c103b60 0x7f537c19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 -- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f537c109df0 msgr2=0x7f537c19ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f537c109df0 0x7f537c19ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 -- 172.21.15.102:0/4045336670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c103b60 msgr2=0x7f537c19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f537c103b60 0x7f537c19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537c1a0630 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5372ffd640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 0x7f537c19ac60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f536400c970 tx=0x7f536400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364007bb0 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537c1a0920 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5364007d50 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536400f450 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.538+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537c1a7080 con 0x7f537c1094a0 2024-09-21T03:32:30.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.539+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f537c063b50 con 0x7f537c1094a0 2024-09-21T03:32:30.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.541+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f53640046c0 con 0x7f537c1094a0 2024-09-21T03:32:30.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.541+0000 7f53797fa640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f53680b65f0 0x7f53680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f537b7fe640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f53680b65f0 0x7f53680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f53640e7810 con 0x7f537c1094a0 2024-09-21T03:32:30.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f53797fa640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] conn(0x7f53680c0460 0x7f53680c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f53680c3020 con 0x7f53680c0460 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f53640e7c60 con 0x7f537c1094a0 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f537b7fe640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f53680b65f0 0x7f53680b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f536c000c00 tx=0x7f536c005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.542+0000 7f537bfff640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] conn(0x7f53680c0460 0x7f53680c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.543+0000 7f537bfff640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] conn(0x7f53680c0460 0x7f53680c2950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.543+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== osd.11 v2:172.21.15.148:6824/3639095642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f53680c3020 con 0x7f53680c0460 2024-09-21T03:32:30.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.557+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 --> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f537c063f50 con 0x7f53680c0460 2024-09-21T03:32:30.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f53797fa640 1 -- 172.21.15.102:0/4045336670 <== osd.11 v2:172.21.15.148:6824/3639095642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f537c063f50 con 0x7f53680c0460 2024-09-21T03:32:30.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] conn(0x7f53680c0460 msgr2=0x7f53680c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] conn(0x7f53680c0460 0x7f53680c2950 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f53680b65f0 msgr2=0x7f53680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f53680b65f0 0x7f53680b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f536c000c00 tx=0x7f536c005d50 comp rx=0 tx=0).stop 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 msgr2=0x7f537c19ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 --2- 172.21.15.102:0/4045336670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f537c1094a0 0x7f537c19ac60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f536400c970 tx=0x7f536400ce30 comp rx=0 tx=0).stop 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f537bfff640 1 -- 172.21.15.102:0/4045336670 reap_dead start 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 shutdown_connections 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 >> 172.21.15.102:0/4045336670 conn(0x7f537c07b850 msgr2=0x7f537c1075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 shutdown_connections 2024-09-21T03:32:30.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.558+0000 7f5381e33640 1 -- 172.21.15.102:0/4045336670 wait complete. 2024-09-21T03:32:30.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 -- 172.21.15.102:0/1785159073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108d70 msgr2=0x7f662c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 --2- 172.21.15.102:0/1785159073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108d70 0x7f662c10f5a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6624009ca0 tx=0x7f662402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 -- 172.21.15.102:0/1785159073 shutdown_connections 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 --2- 172.21.15.102:0/1785159073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108d70 0x7f662c10f5a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 --2- 172.21.15.102:0/1785159073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f662c108420 0x7f662c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 --2- 172.21.15.102:0/1785159073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f662c102ae0 0x7f662c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 -- 172.21.15.102:0/1785159073 >> 172.21.15.102:0/1785159073 conn(0x7f662c079770 msgr2=0x7f662c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 -- 172.21.15.102:0/1785159073 shutdown_connections 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.755+0000 7f66311e4640 1 -- 172.21.15.102:0/1785159073 wait complete. 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 Processor -- start 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 -- start start 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f662c102ae0 0x7f662c19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 0x7f662c19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f662c108d70 0x7f662c19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f662c112b70 con 0x7f662c108420 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f662c1129f0 con 0x7f662c102ae0 2024-09-21T03:32:30.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f66311e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f662c112cf0 con 0x7f662c108d70 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.756+0000 7f662259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 0x7f662c19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 0x7f662c19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59192/0 (socket says 172.21.15.102:59192) 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 -- 172.21.15.102:0/3700337539 learned_addr learned my addr 172.21.15.102:0/3700337539 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662b59e640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f662c108d70 0x7f662c19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662ad9d640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f662c102ae0 0x7f662c19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 -- 172.21.15.102:0/3700337539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f662c108d70 msgr2=0x7f662c19be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f662c108d70 0x7f662c19be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 -- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f662c102ae0 msgr2=0x7f662c19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f662c102ae0 0x7f662c19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c1a6680 con 0x7f662c108420 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f662259c640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 0x7f662c19b900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f661400d750 tx=0x7f661400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614017070 con 0x7f662c108420 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f66140054f0 con 0x7f662c108420 2024-09-21T03:32:30.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c1a6970 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6614004d90 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.757+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c1a6e60 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.758+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f662c063ad0 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.760+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f6614004f30 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f6628d99640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f66180b65f0 0x7f66180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f662ad9d640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f66180b65f0 0x7f66180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f66140e75d0 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f6628d99640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] conn(0x7f66180c0460 0x7f66180c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66180c3020 con 0x7f66180c0460 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f66140e7a20 con 0x7f662c108420 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f662ad9d640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f66180b65f0 0x7f66180b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f662c06c6e0 tx=0x7f661c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.761+0000 7f662b59e640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] conn(0x7f66180c0460 0x7f66180c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.762+0000 7f662b59e640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] conn(0x7f66180c0460 0x7f66180c2950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.763+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== osd.10 v2:172.21.15.121:6824/3942483179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66180c3020 con 0x7f66180c0460 2024-09-21T03:32:30.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.776+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 --> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f662c063f00 con 0x7f66180c0460 2024-09-21T03:32:30.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f6628d99640 1 -- 172.21.15.102:0/3700337539 <== osd.10 v2:172.21.15.121:6824/3942483179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f662c063f00 con 0x7f66180c0460 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] conn(0x7f66180c0460 msgr2=0x7f66180c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] conn(0x7f66180c0460 0x7f66180c2950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f66180b65f0 msgr2=0x7f66180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f66180b65f0 0x7f66180b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f662c06c6e0 tx=0x7f661c005f90 comp rx=0 tx=0).stop 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 msgr2=0x7f662c19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 --2- 172.21.15.102:0/3700337539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f662c108420 0x7f662c19b900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f661400d750 tx=0x7f661400dc10 comp rx=0 tx=0).stop 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f662b59e640 1 -- 172.21.15.102:0/3700337539 reap_dead start 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 shutdown_connections 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 >> 172.21.15.102:0/3700337539 conn(0x7f662c079770 msgr2=0x7f662c106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 shutdown_connections 2024-09-21T03:32:30.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.777+0000 7f66311e4640 1 -- 172.21.15.102:0/3700337539 wait complete. 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 -- 172.21.15.102:0/1910510988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 msgr2=0x7fd40c102460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 --2- 172.21.15.102:0/1910510988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c102460 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009ca0 tx=0x7fd3fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 -- 172.21.15.102:0/1910510988 shutdown_connections 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 --2- 172.21.15.102:0/1910510988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c106bf0 0x7fd40c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 --2- 172.21.15.102:0/1910510988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd40c1062a0 0x7fd40c1066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 --2- 172.21.15.102:0/1910510988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c102460 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 -- 172.21.15.102:0/1910510988 >> 172.21.15.102:0/1910510988 conn(0x7fd40c077c60 msgr2=0x7fd40c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.964+0000 7fd411596640 1 -- 172.21.15.102:0/1910510988 shutdown_connections 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.965+0000 7fd411596640 1 -- 172.21.15.102:0/1910510988 wait complete. 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.965+0000 7fd411596640 1 Processor -- start 2024-09-21T03:32:30.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.965+0000 7fd411596640 1 -- start start 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c1062a0 0x7fd40c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd40c106bf0 0x7fd40c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c113c00 con 0x7fd40c102050 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c113a80 con 0x7fd40c1062a0 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd40c113d80 con 0x7fd40c106bf0 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59220/0 (socket says 172.21.15.102:59220) 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 -- 172.21.15.102:0/135044210 learned_addr learned my addr 172.21.15.102:0/135044210 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40a7fc640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c1062a0 0x7fd40c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 -- 172.21.15.102:0/135044210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd40c106bf0 msgr2=0x7fd40c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd40c106bf0 0x7fd40c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 -- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c1062a0 msgr2=0x7fd40c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c1062a0 0x7fd40c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd40c1a0500 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40a7fc640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd40c1062a0 0x7fd40c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd40affd640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c19a590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006010 tx=0x7fd3fc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0316d0 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd3fc031870 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd40c1a0790 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc02fc60 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.966+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd40c1a6f50 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.967+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd40c063b50 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.969+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fd3fc004040 con 0x7fd40c102050 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd403fff640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd3f80b6670 0x7fd3f80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd40a7fc640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd3f80b6670 0x7fd3f80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fd3fc108c50 con 0x7fd40c102050 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd403fff640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] conn(0x7fd3f80c04e0 0x7fd3f80c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3fc036e70 con 0x7fd3f80c04e0 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fd3fc1090a0 con 0x7fd40c102050 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd40a7fc640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd3f80b6670 0x7fd3f80b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40058c0 tx=0x7fd3f4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.970+0000 7fd40b7fe640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] conn(0x7fd3f80c04e0 0x7fd3f80c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.971+0000 7fd40b7fe640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] conn(0x7fd3f80c04e0 0x7fd3f80c29d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:30.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.972+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== osd.7 v2:172.21.15.121:6816/2625959446 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3fc036e70 con 0x7fd3f80c04e0 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 --> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd40c063f50 con 0x7fd3f80c04e0 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd403fff640 1 -- 172.21.15.102:0/135044210 <== osd.7 v2:172.21.15.121:6816/2625959446 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd40c063f50 con 0x7fd3f80c04e0 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] conn(0x7fd3f80c04e0 msgr2=0x7fd3f80c29d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] conn(0x7fd3f80c04e0 0x7fd3f80c29d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd3f80b6670 msgr2=0x7fd3f80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd3f80b6670 0x7fd3f80b8b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40058c0 tx=0x7fd3f4005850 comp rx=0 tx=0).stop 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 msgr2=0x7fd40c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.989+0000 7fd411596640 1 --2- 172.21.15.102:0/135044210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd40c102050 0x7fd40c19a590 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc006010 tx=0x7fd3fc003f10 comp rx=0 tx=0).stop 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.990+0000 7fd40b7fe640 1 -- 172.21.15.102:0/135044210 reap_dead start 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.990+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 shutdown_connections 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.990+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 >> 172.21.15.102:0/135044210 conn(0x7fd40c077c60 msgr2=0x7fd40c1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:30.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.990+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 shutdown_connections 2024-09-21T03:32:30.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:30.990+0000 7fd411596640 1 -- 172.21.15.102:0/135044210 wait complete. 2024-09-21T03:32:31.619 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:31 smithi102 ceph-mon[31392]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:31 smithi148 ceph-mon[34651]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:31 smithi121 ceph-mon[34316]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T03:32:32.975 INFO:teuthology.orchestra.run.smithi102.stdout:279172874268 2024-09-21T03:32:32.976 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T03:32:33.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 -- 172.21.15.102:0/2080349328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 msgr2=0x7f9268103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 --2- 172.21.15.102:0/2080349328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f9268103f70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9258009900 tx=0x7f925802a410 comp rx=0 tx=0).stop 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 -- 172.21.15.102:0/2080349328 shutdown_connections 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 --2- 172.21.15.102:0/2080349328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9268109df0 0x7f9268110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 --2- 172.21.15.102:0/2080349328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f92681094a0 0x7f92681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 --2- 172.21.15.102:0/2080349328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f9268103f70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 -- 172.21.15.102:0/2080349328 >> 172.21.15.102:0/2080349328 conn(0x7f926807b850 msgr2=0x7f926807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 -- 172.21.15.102:0/2080349328 shutdown_connections 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.021+0000 7f926e5de640 1 -- 172.21.15.102:0/2080349328 wait complete. 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 Processor -- start 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 -- start start 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f926819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92681094a0 0x7f926819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268109df0 0x7f926819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113bf0 con 0x7f9268103b60 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113a70 con 0x7f92681094a0 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926e5de640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113d70 con 0x7f9268109df0 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f9267fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f926819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f9267fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f926819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59242/0 (socket says 172.21.15.102:59242) 2024-09-21T03:32:33.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f9267fff640 1 -- 172.21.15.102:0/1991965100 learned_addr learned my addr 172.21.15.102:0/1991965100 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f92677fe640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92681094a0 0x7f926819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.022+0000 7f926cb7b640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268109df0 0x7f926819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 -- 172.21.15.102:0/1991965100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268109df0 msgr2=0x7f926819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9268109df0 0x7f926819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 -- 172.21.15.102:0/1991965100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92681094a0 msgr2=0x7f926819ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f92681094a0 0x7f926819ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92681a0510 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f9267fff640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f926819a5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9258005ab0 tx=0x7f92580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925803f030 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92681a07a0 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9258003cd0 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258035070 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.023+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a6f60 con 0x7f9268103b60 2024-09-21T03:32:33.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.024+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9268063b50 con 0x7f9268103b60 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.026+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f9258042030 con 0x7f9268103b60 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.026+0000 7f92657fa640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f92540b65f0 0x7f92540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.026+0000 7f92677fe640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f92540b65f0 0x7f92540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.026+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f9258107eb0 con 0x7f9268103b60 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f92657fa640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] conn(0x7f92540c0460 0x7f92540c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92540c3020 con 0x7f92540c0460 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f9258108300 con 0x7f9268103b60 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f926cb7b640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] conn(0x7f92540c0460 0x7f92540c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f92677fe640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f92540b65f0 0x7f92540b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9268109040 tx=0x7f925000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.027+0000 7f926cb7b640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] conn(0x7f92540c0460 0x7f92540c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.028+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== osd.6 v2:172.21.15.102:6818/3311755502 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92540c3020 con 0x7f92540c0460 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.041+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 --> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9268063f50 con 0x7f92540c0460 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.041+0000 7f92657fa640 1 -- 172.21.15.102:0/1991965100 <== osd.6 v2:172.21.15.102:6818/3311755502 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9268063f50 con 0x7f92540c0460 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] conn(0x7f92540c0460 msgr2=0x7f92540c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] conn(0x7f92540c0460 0x7f92540c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f92540b65f0 msgr2=0x7f92540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f92540b65f0 0x7f92540b8b00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9268109040 tx=0x7f925000b390 comp rx=0 tx=0).stop 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 msgr2=0x7f926819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 --2- 172.21.15.102:0/1991965100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9268103b60 0x7f926819a5a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9258005ab0 tx=0x7f92580042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926cb7b640 1 -- 172.21.15.102:0/1991965100 reap_dead start 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 shutdown_connections 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 >> 172.21.15.102:0/1991965100 conn(0x7f926807b850 msgr2=0x7f9268107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 shutdown_connections 2024-09-21T03:32:33.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:32.042+0000 7f926e5de640 1 -- 172.21.15.102:0/1991965100 wait complete. 2024-09-21T03:32:33.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:33 smithi102 ceph-mon[31392]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T03:32:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:33 smithi148 ceph-mon[34651]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T03:32:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:33 smithi121 ceph-mon[34316]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-21T03:32:33.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 -- 172.21.15.102:0/3919440992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 msgr2=0x7f95ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 --2- 172.21.15.102:0/3919440992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac10f520 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009ca0 tx=0x7f95a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 -- 172.21.15.102:0/3919440992 shutdown_connections 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 --2- 172.21.15.102:0/3919440992 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac10f520 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 --2- 172.21.15.102:0/3919440992 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 0x7f95ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 --2- 172.21.15.102:0/3919440992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 0x7f95ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 -- 172.21.15.102:0/3919440992 >> 172.21.15.102:0/3919440992 conn(0x7f95ac079730 msgr2=0x7f95ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 -- 172.21.15.102:0/3919440992 shutdown_connections 2024-09-21T03:32:33.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.881+0000 7f95b3e67640 1 -- 172.21.15.102:0/3919440992 wait complete. 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.882+0000 7f95b3e67640 1 Processor -- start 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.882+0000 7f95b3e67640 1 -- start start 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.882+0000 7f95b3e67640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 0x7f95ac19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.882+0000 7f95b3e67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 0x7f95ac19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.882+0000 7f95b3e67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b3e67640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac112ad0 con 0x7f95ac108cf0 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b3e67640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac112950 con 0x7f95ac102a60 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b3e67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac112c50 con 0x7f95ac1083a0 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59254/0 (socket says 172.21.15.102:59254) 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 -- 172.21.15.102:0/1062779996 learned_addr learned my addr 172.21.15.102:0/1062779996 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:33.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b1402640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 0x7f95ac19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b1c03640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 0x7f95ac19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 -- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 msgr2=0x7f95ac19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 0x7f95ac19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 -- 172.21.15.102:0/1062779996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 msgr2=0x7f95ac19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 0x7f95ac19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac1a04c0 con 0x7f95ac108cf0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b1402640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f95ac1083a0 0x7f95ac19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b1c03640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f95ac102a60 0x7f95ac19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b2404640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac19fd90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95a4033040 tx=0x7f95a4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031650 con 0x7f95ac108cf0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac1a0750 con 0x7f95ac108cf0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f95a40317f0 con 0x7f95ac108cf0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.883+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a402fa40 con 0x7f95ac108cf0 2024-09-21T03:32:33.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.884+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ac1a6f10 con 0x7f95ac108cf0 2024-09-21T03:32:33.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.884+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95ac063b50 con 0x7f95ac108cf0 2024-09-21T03:32:33.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.886+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f95a402fbe0 con 0x7f95ac108cf0 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95a2ffd640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f95980b65f0 0x7f95980b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95b1c03640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f95980b65f0 0x7f95980b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f95a4108bd0 con 0x7f95ac108cf0 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95a2ffd640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] conn(0x7f95980c0460 0x7f95980c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95980c3020 con 0x7f95980c0460 2024-09-21T03:32:33.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f95a4109020 con 0x7f95ac108cf0 2024-09-21T03:32:33.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95b1c03640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f95980b65f0 0x7f95980b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c20 tx=0x7f95a8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.887+0000 7f95b1402640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] conn(0x7f95980c0460 0x7f95980c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:33.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.888+0000 7f95b1402640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] conn(0x7f95980c0460 0x7f95980c2950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:33.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.889+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== osd.8 v2:172.21.15.148:6816/1644910051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95980c3020 con 0x7f95980c0460 2024-09-21T03:32:33.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.902+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 --> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95ac063fd0 con 0x7f95980c0460 2024-09-21T03:32:33.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95a2ffd640 1 -- 172.21.15.102:0/1062779996 <== osd.8 v2:172.21.15.148:6816/1644910051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f95ac063fd0 con 0x7f95980c0460 2024-09-21T03:32:33.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] conn(0x7f95980c0460 msgr2=0x7f95980c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] conn(0x7f95980c0460 0x7f95980c2950 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f95980b65f0 msgr2=0x7f95980b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f95980b65f0 0x7f95980b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c20 tx=0x7f95a8005f90 comp rx=0 tx=0).stop 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 msgr2=0x7f95ac19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 --2- 172.21.15.102:0/1062779996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f95ac108cf0 0x7f95ac19fd90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f95a4033040 tx=0x7f95a4003ce0 comp rx=0 tx=0).stop 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b2404640 1 -- 172.21.15.102:0/1062779996 reap_dead start 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 shutdown_connections 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 >> 172.21.15.102:0/1062779996 conn(0x7f95ac079730 msgr2=0x7f95ac06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 shutdown_connections 2024-09-21T03:32:33.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:33.903+0000 7f95b3e67640 1 -- 172.21.15.102:0/1062779996 wait complete. 2024-09-21T03:32:34.435 INFO:teuthology.orchestra.run.smithi102.stdout:304942678040 2024-09-21T03:32:34.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 -- 172.21.15.102:0/1702770088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 msgr2=0x7f3940102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 --2- 172.21.15.102:0/1702770088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f3940102e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3930009ca0 tx=0x7f393002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 -- 172.21.15.102:0/1702770088 shutdown_connections 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 --2- 172.21.15.102:0/1702770088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3940108cf0 0x7f394010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 --2- 172.21.15.102:0/1702770088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39401083a0 0x7f39401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 --2- 172.21.15.102:0/1702770088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f3940102e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 -- 172.21.15.102:0/1702770088 >> 172.21.15.102:0/1702770088 conn(0x7f3940079730 msgr2=0x7f3940079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 -- 172.21.15.102:0/1702770088 shutdown_connections 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 -- 172.21.15.102:0/1702770088 wait complete. 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.893+0000 7f3947951640 1 Processor -- start 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 -- start start 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f394019c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39401083a0 0x7f394019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940108cf0 0x7f39401a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3940112b20 con 0x7f3940102a60 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39401129a0 con 0x7f39401083a0 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3947951640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3940112ca0 con 0x7f3940108cf0 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f394019c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:34.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f394019c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59232/0 (socket says 172.21.15.102:59232) 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 -- 172.21.15.102:0/3126938996 learned_addr learned my addr 172.21.15.102:0/3126938996 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3944eec640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39401083a0 0x7f394019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3945eee640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940108cf0 0x7f39401a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 -- 172.21.15.102:0/3126938996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940108cf0 msgr2=0x7f39401a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3940108cf0 0x7f39401a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 -- 172.21.15.102:0/3126938996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39401083a0 msgr2=0x7f394019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39401083a0 0x7f394019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39401a2720 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f3944eec640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39401083a0 0x7f394019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.894+0000 7f39456ed640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f394019c7b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3930006010 tx=0x7f3930003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39300316d0 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39401a29b0 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3930031870 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393002fc90 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39401a9170 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.895+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f394010f210 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.897+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f3930004040 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f393e7fc640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39280b65f0 0x7f39280b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f3944eec640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39280b65f0 0x7f39280b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f3930108d00 con 0x7f3940102a60 2024-09-21T03:32:34.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f393e7fc640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] conn(0x7f39280c0460 0x7f39280c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39280c3020 con 0x7f39280c0460 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f3930109150 con 0x7f3940102a60 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f3944eec640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39280b65f0 0x7f39280b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39340058c0 tx=0x7f3934005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.898+0000 7f3945eee640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] conn(0x7f39280c0460 0x7f39280c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.899+0000 7f3945eee640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] conn(0x7f39280c0460 0x7f39280c2950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.899+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== osd.0 v2:172.21.15.102:6802/3173439186 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39280c3020 con 0x7f39280c0460 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 --> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3940103ce0 con 0x7f39280c0460 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f393e7fc640 1 -- 172.21.15.102:0/3126938996 <== osd.0 v2:172.21.15.102:6802/3173439186 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3940103ce0 con 0x7f39280c0460 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] conn(0x7f39280c0460 msgr2=0x7f39280c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] conn(0x7f39280c0460 0x7f39280c2950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39280b65f0 msgr2=0x7f39280b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39280b65f0 0x7f39280b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f39340058c0 tx=0x7f3934005850 comp rx=0 tx=0).stop 2024-09-21T03:32:34.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 msgr2=0x7f394019c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 --2- 172.21.15.102:0/3126938996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3940102a60 0x7f394019c7b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3930006010 tx=0x7f3930003f10 comp rx=0 tx=0).stop 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3945eee640 1 -- 172.21.15.102:0/3126938996 reap_dead start 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 shutdown_connections 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.913+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 >> 172.21.15.102:0/3126938996 conn(0x7f3940079730 msgr2=0x7f394010e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.914+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 shutdown_connections 2024-09-21T03:32:34.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:31.914+0000 7f3947951640 1 -- 172.21.15.102:0/3126938996 wait complete. 2024-09-21T03:32:35.341 INFO:teuthology.orchestra.run.smithi102.stdout:38654705743 2024-09-21T03:32:35.342 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 -- 172.21.15.102:0/1684224225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20108d30 msgr2=0x7f8d2010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1684224225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20108d30 0x7f8d2010f560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009ca0 tx=0x7f8d1802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 -- 172.21.15.102:0/1684224225 shutdown_connections 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1684224225 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20108d30 0x7f8d2010f560 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1684224225 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 0x7f8d201087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1684224225 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d20102aa0 0x7f8d20102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 -- 172.21.15.102:0/1684224225 >> 172.21.15.102:0/1684224225 conn(0x7f8d200797e0 msgr2=0x7f8d20079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 -- 172.21.15.102:0/1684224225 shutdown_connections 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.075+0000 7f8d25d96640 1 -- 172.21.15.102:0/1684224225 wait complete. 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 Processor -- start 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 -- start start 2024-09-21T03:32:35.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 0x7f8d2019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 0x7f8d2019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d20108d30 0x7f8d2019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8d20113c40 con 0x7f8d20102aa0 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8d20113ac0 con 0x7f8d201083e0 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d25d96640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8d20113dc0 con 0x7f8d20108d30 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 0x7f8d2019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 0x7f8d2019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38546/0 (socket says 172.21.15.102:38546) 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 -- 172.21.15.102:0/1339497036 learned_addr learned my addr 172.21.15.102:0/1339497036 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1effd640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 0x7f8d2019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:35.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1ffff640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d20108d30 0x7f8d2019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 -- 172.21.15.102:0/1339497036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d20108d30 msgr2=0x7f8d2019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8d20108d30 0x7f8d2019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.076+0000 7f8d1f7fe640 1 -- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 msgr2=0x7f8d2019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1f7fe640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 0x7f8d2019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1f7fe640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d201a0460 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1effd640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8d201083e0 0x7f8d2019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1f7fe640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 0x7f8d2019a4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000b4a0 tx=0x7f8d1000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10014070 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d201a0750 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8d10010ae0 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10017ce0 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.077+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d201a6eb0 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.078+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8d20063ad0 con 0x7f8d20102aa0 2024-09-21T03:32:35.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.079+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f8d10017070 con 0x7f8d20102aa0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1cff9640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8d080b65f0 0x7f8d080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1effd640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8d080b65f0 0x7f8d080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f8d100e6d40 con 0x7f8d20102aa0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1cff9640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] conn(0x7f8d080c0460 0x7f8d080c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d080c3020 con 0x7f8d080c0460 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.080+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f8d100e7190 con 0x7f8d20102aa0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.081+0000 7f8d1effd640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8d080b65f0 0x7f8d080b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d140058c0 tx=0x7f8d14005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.081+0000 7f8d1ffff640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] conn(0x7f8d080c0460 0x7f8d080c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.081+0000 7f8d1ffff640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] conn(0x7f8d080c0460 0x7f8d080c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.082+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== osd.1 v2:172.21.15.121:6800/864903414 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8d080c3020 con 0x7f8d080c0460 2024-09-21T03:32:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.096+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 --> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8d20063f50 con 0x7f8d080c0460 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d1cff9640 1 -- 172.21.15.102:0/1339497036 <== osd.1 v2:172.21.15.121:6800/864903414 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8d20063f50 con 0x7f8d080c0460 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] conn(0x7f8d080c0460 msgr2=0x7f8d080c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] conn(0x7f8d080c0460 0x7f8d080c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8d080b65f0 msgr2=0x7f8d080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8d080b65f0 0x7f8d080b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8d140058c0 tx=0x7f8d14005850 comp rx=0 tx=0).stop 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 msgr2=0x7f8d2019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 --2- 172.21.15.102:0/1339497036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d20102aa0 0x7f8d2019a4f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d1000b4a0 tx=0x7f8d1000b960 comp rx=0 tx=0).stop 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d1ffff640 1 -- 172.21.15.102:0/1339497036 reap_dead start 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 shutdown_connections 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 >> 172.21.15.102:0/1339497036 conn(0x7f8d200797e0 msgr2=0x7f8d201051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 shutdown_connections 2024-09-21T03:32:35.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:34.097+0000 7f8d25d96640 1 -- 172.21.15.102:0/1339497036 wait complete. 2024-09-21T03:32:35.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:35 smithi102 ceph-mon[31392]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:32:35.822 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:35 smithi121 ceph-mon[34316]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:32:35.823 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:35 smithi148 ceph-mon[34651]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:32:36.069 INFO:teuthology.orchestra.run.smithi102.stdout:257698037793 2024-09-21T03:32:36.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T03:32:36.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:36 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:36.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:36 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:36.665 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:36 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:32:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 -- 172.21.15.102:0/2224146862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c109e40 msgr2=0x7f4d2c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 --2- 172.21.15.102:0/2224146862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c109e40 0x7f4d2c110670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009ca0 tx=0x7f4d2402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 -- 172.21.15.102:0/2224146862 shutdown_connections 2024-09-21T03:32:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 --2- 172.21.15.102:0/2224146862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c109e40 0x7f4d2c110670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 --2- 172.21.15.102:0/2224146862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 --2- 172.21.15.102:0/2224146862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d2c103bb0 0x7f4d2c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 -- 172.21.15.102:0/2224146862 >> 172.21.15.102:0/2224146862 conn(0x7f4d2c0ff600 msgr2=0x7f4d2c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.948+0000 7f4d33546640 1 -- 172.21.15.102:0/2224146862 shutdown_connections 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.949+0000 7f4d33546640 1 -- 172.21.15.102:0/2224146862 wait complete. 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 Processor -- start 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 -- start start 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d2c103bb0 0x7f4d2c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d2c109e40 0x7f4d2c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c113c20 con 0x7f4d2c1094f0 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c113aa0 con 0x7f4d2c103bb0 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d33546640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c113da0 con 0x7f4d2c109e40 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:36.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38552/0 (socket says 172.21.15.102:38552) 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 -- 172.21.15.102:0/3301357783 learned_addr learned my addr 172.21.15.102:0/3301357783 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d312e2640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d2c103bb0 0x7f4d2c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d31ae3640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d2c109e40 0x7f4d2c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 -- 172.21.15.102:0/3301357783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d2c109e40 msgr2=0x7f4d2c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4d2c109e40 0x7f4d2c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 -- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d2c103bb0 msgr2=0x7f4d2c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4d2c103bb0 0x7f4d2c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.950+0000 7f4d30ae1640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c1a04a0 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d30ae1640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c19aad0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00d740 tx=0x7f4d1c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c017070 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4d1c00de50 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c1a0790 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00f620 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.951+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c1a6ef0 con 0x7f4d2c1094f0 2024-09-21T03:32:36.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.952+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d2c063b50 con 0x7f4d2c1094f0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.953+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f4d1c01a070 con 0x7f4d2c1094f0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d227fc640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4d180b65f0 0x7f4d180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d312e2640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4d180b65f0 0x7f4d180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f4d1c0e72c0 con 0x7f4d2c1094f0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d227fc640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] conn(0x7f4d180c0460 0x7f4d180c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d1c021e50 con 0x7f4d180c0460 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.954+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f4d1c0e7710 con 0x7f4d2c1094f0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.955+0000 7f4d312e2640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4d180b65f0 0x7f4d180b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d28005d00 tx=0x7f4d2800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.955+0000 7f4d31ae3640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] conn(0x7f4d180c0460 0x7f4d180c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.955+0000 7f4d31ae3640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] conn(0x7f4d180c0460 0x7f4d180c2950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:36.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.956+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== osd.4 v2:172.21.15.121:6808/3405274815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4d1c021e50 con 0x7f4d180c0460 2024-09-21T03:32:36.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 --> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d2c063fd0 con 0x7f4d180c0460 2024-09-21T03:32:36.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d227fc640 1 -- 172.21.15.102:0/3301357783 <== osd.4 v2:172.21.15.121:6808/3405274815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4d2c063fd0 con 0x7f4d180c0460 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] conn(0x7f4d180c0460 msgr2=0x7f4d180c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] conn(0x7f4d180c0460 0x7f4d180c2950 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4d180b65f0 msgr2=0x7f4d180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4d180b65f0 0x7f4d180b8b00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d28005d00 tx=0x7f4d2800b410 comp rx=0 tx=0).stop 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 msgr2=0x7f4d2c19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d33546640 1 --2- 172.21.15.102:0/3301357783 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d2c1094f0 0x7f4d2c19aad0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00d740 tx=0x7f4d1c00dc00 comp rx=0 tx=0).stop 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.971+0000 7f4d31ae3640 1 -- 172.21.15.102:0/3301357783 reap_dead start 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.972+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 shutdown_connections 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.972+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 >> 172.21.15.102:0/3301357783 conn(0x7f4d2c0ff600 msgr2=0x7f4d2c107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.972+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 shutdown_connections 2024-09-21T03:32:36.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:36.972+0000 7f4d33546640 1 -- 172.21.15.102:0/3301357783 wait complete. 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 -- 172.21.15.102:0/2079872053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c107b60 msgr2=0x7fe67c107f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 --2- 172.21.15.102:0/2079872053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c107b60 0x7fe67c107f70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 -- 172.21.15.102:0/2079872053 shutdown_connections 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 --2- 172.21.15.102:0/2079872053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c107b60 0x7fe67c107f70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 --2- 172.21.15.102:0/2079872053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 0x7fe67c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 --2- 172.21.15.102:0/2079872053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe67c102270 0x7fe67c102680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 -- 172.21.15.102:0/2079872053 >> 172.21.15.102:0/2079872053 conn(0x7fe67c077cc0 msgr2=0x7fe67c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 -- 172.21.15.102:0/2079872053 shutdown_connections 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.191+0000 7fe6819f5640 1 -- 172.21.15.102:0/2079872053 wait complete. 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.192+0000 7fe6819f5640 1 Processor -- start 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.192+0000 7fe6819f5640 1 -- start start 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 0x7fe67c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe67c107b60 0x7fe67c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 0x7fe67c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c111a00 con 0x7fe67c102270 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c111880 con 0x7fe67c107b60 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6819f5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c111b80 con 0x7fe67c1084b0 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 0x7fe67c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 0x7fe67c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38568/0 (socket says 172.21.15.102:38568) 2024-09-21T03:32:37.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 -- 172.21.15.102:0/424940408 learned_addr learned my addr 172.21.15.102:0/424940408 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67b7fe640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 0x7fe67c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67a7fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe67c107b60 0x7fe67c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 -- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 msgr2=0x7fe67c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 0x7fe67c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 -- 172.21.15.102:0/424940408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe67c107b60 msgr2=0x7fe67c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe67c107b60 0x7fe67c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c19e2c0 con 0x7fe67c102270 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67b7fe640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe67c1084b0 0x7fe67c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe67affd640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 0x7fe67c198350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9f0 tx=0x7fe67000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.193+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67000ccc0 con 0x7fe67c102270 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.194+0000 7fe6819f5640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c19e5b0 con 0x7fe67c102270 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.194+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe670010900 con 0x7fe67c102270 2024-09-21T03:32:37.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.194+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670018860 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.194+0000 7fe6819f5640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1a4d10 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.195+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe65c001030 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.196+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fe670010ab0 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe6809f3640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6640b65f0 0x7fe6640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe67a7fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6640b65f0 0x7fe6640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fe6700e8570 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe6809f3640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] conn(0x7fe6640c0460 0x7fe6640c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe670019ec0 con 0x7fe6640c0460 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.197+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fe6700e89c0 con 0x7fe67c102270 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.198+0000 7fe67b7fe640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] conn(0x7fe6640c0460 0x7fe6640c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.198+0000 7fe67a7fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6640b65f0 0x7fe6640b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe66c005940 tx=0x7fe66c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.198+0000 7fe67b7fe640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] conn(0x7fe6640c0460 0x7fe6640c2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:37.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.199+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== osd.5 v2:172.21.15.148:6808/1887027995 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe670019ec0 con 0x7fe6640c0460 2024-09-21T03:32:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.213+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 --> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe65c002dd0 con 0x7fe6640c0460 2024-09-21T03:32:37.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6809f3640 1 -- 172.21.15.102:0/424940408 <== osd.5 v2:172.21.15.148:6808/1887027995 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe65c002dd0 con 0x7fe6640c0460 2024-09-21T03:32:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] conn(0x7fe6640c0460 msgr2=0x7fe6640c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] conn(0x7fe6640c0460 0x7fe6640c2950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6640b65f0 msgr2=0x7fe6640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6640b65f0 0x7fe6640b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe66c005940 tx=0x7fe66c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 msgr2=0x7fe67c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 --2- 172.21.15.102:0/424940408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe67c102270 0x7fe67c198350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9f0 tx=0x7fe67000edf0 comp rx=0 tx=0).stop 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe67b7fe640 1 -- 172.21.15.102:0/424940408 reap_dead start 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 shutdown_connections 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.214+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 >> 172.21.15.102:0/424940408 conn(0x7fe67c077cc0 msgr2=0x7fe67c105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.215+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 shutdown_connections 2024-09-21T03:32:37.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:37.215+0000 7fe6627fc640 1 -- 172.21.15.102:0/424940408 wait complete. 2024-09-21T03:32:37.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:37 smithi102 ceph-mon[31392]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-21T03:32:37.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:37 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.724 INFO:teuthology.orchestra.run.smithi102.stdout:64424509510 2024-09-21T03:32:37.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T03:32:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:37 smithi148 ceph-mon[34651]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-21T03:32:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:37 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:37 smithi121 ceph-mon[34316]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2024-09-21T03:32:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:37 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:38.373 INFO:teuthology.orchestra.run.smithi102.stdout:141733920827 2024-09-21T03:32:38.374 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T03:32:38.781 INFO:teuthology.orchestra.run.smithi102.stdout:188978561073 2024-09-21T03:32:38.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T03:32:39.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:39 smithi102 ceph-mon[31392]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:32:39.633 INFO:teuthology.orchestra.run.smithi102.stdout:163208757302 2024-09-21T03:32:39.633 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T03:32:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:39 smithi148 ceph-mon[34651]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:32:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:39 smithi121 ceph-mon[34316]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:32:39.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 -- 172.21.15.102:0/1385881381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 msgr2=0x7fcf38102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1385881381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf38102600 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009900 tx=0x7fcf3402a410 comp rx=0 tx=0).stop 2024-09-21T03:32:39.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 -- 172.21.15.102:0/1385881381 shutdown_connections 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1385881381 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38108480 0x7fcf3810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1385881381 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf38107b30 0x7fcf38107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1385881381 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf38102600 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 -- 172.21.15.102:0/1385881381 >> 172.21.15.102:0/1385881381 conn(0x7fcf38077c60 msgr2=0x7fcf380780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 -- 172.21.15.102:0/1385881381 shutdown_connections 2024-09-21T03:32:39.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.830+0000 7fcf3f722640 1 -- 172.21.15.102:0/1385881381 wait complete. 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 Processor -- start 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 -- start start 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf3819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38107b30 0x7fcf3819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf38108480 0x7fcf3819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112b00 con 0x7fcf381021f0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112980 con 0x7fcf38108480 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3f722640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcf38112c80 con 0x7fcf38107b30 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3d4be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf3819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3d4be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf3819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38580/0 (socket says 172.21.15.102:38580) 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3d4be640 1 -- 172.21.15.102:0/1940019467 learned_addr learned my addr 172.21.15.102:0/1940019467 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3dcbf640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf38108480 0x7fcf3819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.831+0000 7fcf3ccbd640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38107b30 0x7fcf3819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 -- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38107b30 msgr2=0x7fcf3819aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcf38107b30 0x7fcf3819aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 -- 172.21.15.102:0/1940019467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf38108480 msgr2=0x7fcf3819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf38108480 0x7fcf3819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf381a04b0 con 0x7fcf381021f0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3d4be640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf3819a540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006010 tx=0x7fcf34004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3403f070 con 0x7fcf381021f0 2024-09-21T03:32:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcf34031e10 con 0x7fcf381021f0 2024-09-21T03:32:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34035030 con 0x7fcf381021f0 2024-09-21T03:32:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf381a0740 con 0x7fcf381021f0 2024-09-21T03:32:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.832+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf381a6f00 con 0x7fcf381021f0 2024-09-21T03:32:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.833+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf38063b50 con 0x7fcf381021f0 2024-09-21T03:32:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.836+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fcf34042070 con 0x7fcf381021f0 2024-09-21T03:32:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.836+0000 7fcf2e7fc640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcf240b6670 0x7fcf240b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf3ccbd640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcf240b6670 0x7fcf240b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fcf34108930 con 0x7fcf381021f0 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf2e7fc640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] conn(0x7fcf240c04e0 0x7fcf240c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf240c30a0 con 0x7fcf240c04e0 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fcf34108d80 con 0x7fcf381021f0 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf3ccbd640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcf240b6670 0x7fcf240b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf38104ae0 tx=0x7fcf2800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:39.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.837+0000 7fcf3dcbf640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] conn(0x7fcf240c04e0 0x7fcf240c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:39.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.838+0000 7fcf3dcbf640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] conn(0x7fcf240c04e0 0x7fcf240c29d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.839+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== osd.2 v2:172.21.15.148:6800/807337613 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf240c30a0 con 0x7fcf240c04e0 2024-09-21T03:32:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.861+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 --> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf38063f50 con 0x7fcf240c04e0 2024-09-21T03:32:39.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.862+0000 7fcf2e7fc640 1 -- 172.21.15.102:0/1940019467 <== osd.2 v2:172.21.15.148:6800/807337613 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf38063f50 con 0x7fcf240c04e0 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.862+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] conn(0x7fcf240c04e0 msgr2=0x7fcf240c29d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.862+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] conn(0x7fcf240c04e0 0x7fcf240c29d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcf240b6670 msgr2=0x7fcf240b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcf240b6670 0x7fcf240b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcf38104ae0 tx=0x7fcf2800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 msgr2=0x7fcf3819a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 --2- 172.21.15.102:0/1940019467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf381021f0 0x7fcf3819a540 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcf34006010 tx=0x7fcf34004430 comp rx=0 tx=0).stop 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3dcbf640 1 -- 172.21.15.102:0/1940019467 reap_dead start 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 shutdown_connections 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 >> 172.21.15.102:0/1940019467 conn(0x7fcf38077c60 msgr2=0x7fcf3810f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 shutdown_connections 2024-09-21T03:32:39.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:39.863+0000 7fcf3f722640 1 -- 172.21.15.102:0/1940019467 wait complete. 2024-09-21T03:32:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2516345343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 msgr2=0x7fe09c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2516345343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c102ef0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009900 tx=0x7fe08c02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2516345343 shutdown_connections 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2516345343 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe09c108d70 0x7fe09c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2516345343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe09c108420 0x7fe09c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2516345343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c102ef0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2516345343 >> 172.21.15.102:0/2516345343 conn(0x7fe09c079770 msgr2=0x7fe09c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2516345343 shutdown_connections 2024-09-21T03:32:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.143+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2516345343 wait complete. 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.144+0000 7fe0a16cb640 1 Processor -- start 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.144+0000 7fe0a16cb640 1 -- start start 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe09c108420 0x7fe09c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe09c108d70 0x7fe09c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c113c70 con 0x7fe09c102ae0 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c113af0 con 0x7fe09c108d70 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe0a16cb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c113df0 con 0x7fe09c108420 2024-09-21T03:32:40.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c19a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38610/0 (socket says 172.21.15.102:38610) 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 -- 172.21.15.102:0/2352424849 learned_addr learned my addr 172.21.15.102:0/2352424849 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09b7fe640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe09c108d70 0x7fe09c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09a7fc640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe09c108420 0x7fe09c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 -- 172.21.15.102:0/2352424849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe09c108420 msgr2=0x7fe09c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe09c108420 0x7fe09c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 -- 172.21.15.102:0/2352424849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe09c108d70 msgr2=0x7fe09c19fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe09c108d70 0x7fe09c19fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c1a0440 con 0x7fe09c102ae0 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.145+0000 7fe09affd640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c19a590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005ab0 tx=0x7fe08c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:40.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.146+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c03f030 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.146+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c1a06d0 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.146+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe08c003cd0 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.146+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c049060 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.146+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c1a0c00 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.147+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe09c063ad0 con 0x7fe09c102ae0 2024-09-21T03:32:40.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.149+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fe08c042030 con 0x7fe09c102ae0 2024-09-21T03:32:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.149+0000 7fe083fff640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0840b6620 0x7fe0840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.149+0000 7fe09a7fc640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0840b6620 0x7fe0840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.149+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fe08c107f10 con 0x7fe09c102ae0 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe083fff640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] conn(0x7fe0840c0490 0x7fe0840c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0840c3050 con 0x7fe0840c0490 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7fe08c108360 con 0x7fe09c102ae0 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe09b7fe640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] conn(0x7fe0840c0490 0x7fe0840c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe09a7fc640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0840b6620 0x7fe0840b8b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe090005e10 tx=0x7fe090005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.150+0000 7fe09b7fe640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] conn(0x7fe0840c0490 0x7fe0840c2980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.151+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== osd.3 v2:172.21.15.102:6810/4062411354 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0840c3050 con 0x7fe0840c0490 2024-09-21T03:32:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 --> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe09c063f00 con 0x7fe0840c0490 2024-09-21T03:32:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe083fff640 1 -- 172.21.15.102:0/2352424849 <== osd.3 v2:172.21.15.102:6810/4062411354 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe09c063f00 con 0x7fe0840c0490 2024-09-21T03:32:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] conn(0x7fe0840c0490 msgr2=0x7fe0840c2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] conn(0x7fe0840c0490 0x7fe0840c2980 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0840b6620 msgr2=0x7fe0840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.169+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0840b6620 0x7fe0840b8b30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe090005e10 tx=0x7fe090005da0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 msgr2=0x7fe09c19a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 --2- 172.21.15.102:0/2352424849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe09c102ae0 0x7fe09c19a590 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe08c005ab0 tx=0x7fe08c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe09b7fe640 1 -- 172.21.15.102:0/2352424849 reap_dead start 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 shutdown_connections 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 >> 172.21.15.102:0/2352424849 conn(0x7fe09c079770 msgr2=0x7fe09c1063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 shutdown_connections 2024-09-21T03:32:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:40.170+0000 7fe0a16cb640 1 -- 172.21.15.102:0/2352424849 wait complete. 2024-09-21T03:32:40.630 INFO:teuthology.orchestra.run.smithi102.stdout:236223201319 2024-09-21T03:32:40.630 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T03:32:41.451 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:41 smithi102 ceph-mon[31392]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:32:41.478 INFO:teuthology.orchestra.run.smithi102.stdout:81604378694 2024-09-21T03:32:41.479 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T03:32:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:41 smithi148 ceph-mon[34651]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:32:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:41 smithi121 ceph-mon[34316]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:32:41.890 INFO:teuthology.orchestra.run.smithi102.stdout:115964117058 2024-09-21T03:32:41.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T03:32:42.287 INFO:teuthology.orchestra.run.smithi102.stdout:210453397546 2024-09-21T03:32:42.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T03:32:42.432 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.433 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.434 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.435 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.447 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.449 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.499 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:42.505 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 -- 172.21.15.102:0/1292012994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c109df0 msgr2=0x7f441c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 --2- 172.21.15.102:0/1292012994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c109df0 0x7f441c110620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4414009ca0 tx=0x7f441402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 -- 172.21.15.102:0/1292012994 shutdown_connections 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 --2- 172.21.15.102:0/1292012994 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c109df0 0x7f441c110620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 --2- 172.21.15.102:0/1292012994 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 0x7f441c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 --2- 172.21.15.102:0/1292012994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c103b60 0x7f441c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 -- 172.21.15.102:0/1292012994 >> 172.21.15.102:0/1292012994 conn(0x7f441c07b850 msgr2=0x7f441c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.464+0000 7f4421544640 1 -- 172.21.15.102:0/1292012994 shutdown_connections 2024-09-21T03:32:43.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 -- 172.21.15.102:0/1292012994 wait complete. 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 Processor -- start 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 -- start start 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 0x7f441c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.465+0000 7f4421544640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 0x7f441c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f4421544640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f441c113bd0 con 0x7f441c103b60 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f4421544640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f441c113a50 con 0x7f441c109df0 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f4421544640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f441c113d50 con 0x7f441c1094a0 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:43.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38636/0 (socket says 172.21.15.102:38636) 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 -- 172.21.15.102:0/167305296 learned_addr learned my addr 172.21.15.102:0/167305296 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f4413fff640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 0x7f441c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441b7fe640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 0x7f441c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 -- 172.21.15.102:0/167305296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 msgr2=0x7f441c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 0x7f441c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 -- 172.21.15.102:0/167305296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 msgr2=0x7f441c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 0x7f441c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 -- 172.21.15.102:0/167305296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441c0763e0 con 0x7f441c103b60 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441b7fe640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 0x7f441c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f441affd640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d950 tx=0x7f440c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:43.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.466+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c017070 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.467+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441c1ace60 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.467+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f440c00de80 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.467+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c00f620 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.467+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441c1ad310 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.468+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441c103f70 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.469+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f440c009c30 con 0x7f441c103b60 2024-09-21T03:32:43.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.470+0000 7f4418ff9640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 0x7f44080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.470+0000 7f4413fff640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 0x7f44080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.470+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f440c0e7220 con 0x7f441c103b60 2024-09-21T03:32:43.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.470+0000 7f4413fff640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 0x7f44080b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f441c107020 tx=0x7f440400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:43.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.473+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f440c0ad850 con 0x7f441c103b60 2024-09-21T03:32:43.559 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:43 smithi102 ceph-mon[31392]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:32:43.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.659+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f441c02e640 con 0x7f441c103b60 2024-09-21T03:32:43.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.659+0000 7f4418ff9640 1 -- 172.21.15.102:0/167305296 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f440c0b1c30 con 0x7f441c103b60 2024-09-21T03:32:43.661 INFO:teuthology.orchestra.run.smithi102.stdout:38654705745 2024-09-21T03:32:43.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 msgr2=0x7f44080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:43.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 0x7f44080b8b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f441c107020 tx=0x7f440400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 msgr2=0x7f441c077120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f440c00d950 tx=0x7f440c00dd50 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 shutdown_connections 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44080b65f0 0x7f44080b8b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f441c109df0 0x7f441c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f441c1094a0 0x7f441c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 --2- 172.21.15.102:0/167305296 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f441c103b60 0x7f441c077120 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 >> 172.21.15.102:0/167305296 conn(0x7f441c07b850 msgr2=0x7f441c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 shutdown_connections 2024-09-21T03:32:43.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:43.662+0000 7f4421544640 1 -- 172.21.15.102:0/167305296 wait complete. 2024-09-21T03:32:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:43 smithi148 ceph-mon[34651]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:32:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:43 smithi121 ceph-mon[34316]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:32:44.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 -- 172.21.15.102:0/3892648220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30102ae0 msgr2=0x7faa30102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 --2- 172.21.15.102:0/3892648220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30102ae0 0x7faa30102ef0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faa20009ca0 tx=0x7faa2002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 -- 172.21.15.102:0/3892648220 shutdown_connections 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 --2- 172.21.15.102:0/3892648220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30108d70 0x7faa3010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 --2- 172.21.15.102:0/3892648220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 0x7faa30108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 --2- 172.21.15.102:0/3892648220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30102ae0 0x7faa30102ef0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 -- 172.21.15.102:0/3892648220 >> 172.21.15.102:0/3892648220 conn(0x7faa30079770 msgr2=0x7faa30079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 -- 172.21.15.102:0/3892648220 shutdown_connections 2024-09-21T03:32:44.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.077+0000 7faa377d3640 1 -- 172.21.15.102:0/3892648220 wait complete. 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 Processor -- start 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 -- start start 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30102ae0 0x7faa3019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 0x7faa3019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113cd0 con 0x7faa30108d70 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113b50 con 0x7faa30108420 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa377d3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7faa30113e50 con 0x7faa30102ae0 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa35d70640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa35d70640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35080/0 (socket says 172.21.15.102:35080) 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa35d70640 1 -- 172.21.15.102:0/3049813356 learned_addr learned my addr 172.21.15.102:0/3049813356 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:44.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa3556f640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30102ae0 0x7faa3019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.078+0000 7faa34d6e640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 0x7faa3019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 -- 172.21.15.102:0/3049813356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30102ae0 msgr2=0x7faa3019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30102ae0 0x7faa3019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 -- 172.21.15.102:0/3049813356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 msgr2=0x7faa3019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 0x7faa3019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 -- 172.21.15.102:0/3049813356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301a05b0 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa35d70640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faa28009fd0 tx=0x7faa2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28011830 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301a08a0 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7faa28016070 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa2800f2e0 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.079+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa301a7000 con 0x7faa30108d70 2024-09-21T03:32:44.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.080+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa30103d60 con 0x7faa30108d70 2024-09-21T03:32:44.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.082+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7faa280119d0 con 0x7faa30108d70 2024-09-21T03:32:44.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.083+0000 7faa2e7fc640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 0x7faa180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.083+0000 7faa3556f640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 0x7faa180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.083+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7faa280e7120 con 0x7faa30108d70 2024-09-21T03:32:44.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.083+0000 7faa3556f640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 0x7faa180b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa20009a60 tx=0x7faa200093e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.086+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa280ad750 con 0x7faa30108d70 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 -- 172.21.15.102:0/4114696052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b41049b0 msgr2=0x7f91b4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 --2- 172.21.15.102:0/4114696052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b41049b0 0x7f91b4104dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009900 tx=0x7f91a802a410 comp rx=0 tx=0).stop 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 -- 172.21.15.102:0/4114696052 shutdown_connections 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 --2- 172.21.15.102:0/4114696052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b410de10 0x7f91b4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 --2- 172.21.15.102:0/4114696052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 --2- 172.21.15.102:0/4114696052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b41049b0 0x7f91b4104dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 -- 172.21.15.102:0/4114696052 >> 172.21.15.102:0/4114696052 conn(0x7f91b4079730 msgr2=0x7f91b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 -- 172.21.15.102:0/4114696052 shutdown_connections 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.230+0000 7f91badc3640 1 -- 172.21.15.102:0/4114696052 wait complete. 2024-09-21T03:32:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 Processor -- start 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 -- start start 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b41049b0 0x7f91b419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4113bd0 con 0x7f91b410de10 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4113a50 con 0x7f91b41049b0 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91badc3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f91b4113d50 con 0x7f91b4105300 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35102/0 (socket says 172.21.15.102:35102) 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 -- 172.21.15.102:0/609306488 learned_addr learned my addr 172.21.15.102:0/609306488 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b8b5f640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b41049b0 0x7f91b419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b3fff640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 -- 172.21.15.102:0/609306488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 msgr2=0x7f91b419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 -- 172.21.15.102:0/609306488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b41049b0 msgr2=0x7f91b419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b41049b0 0x7f91b419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b9360640 1 -- 172.21.15.102:0/609306488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b41a0550 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.231+0000 7f91b3fff640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91b9360640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009fd0 tx=0x7f91ac00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac017070 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f91ac003e40 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b41a0840 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac004820 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.232+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b41a6fa0 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.233+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b4104dc0 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.236+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f91ac003970 con 0x7f91b410de10 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.236+0000 7f91b1ffb640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 0x7f91a40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.237+0000 7f91b8b5f640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 0x7f91a40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.237+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f91ac0e7410 con 0x7f91b410de10 2024-09-21T03:32:44.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.237+0000 7f91b8b5f640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 0x7f91a40b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91a80314b0 tx=0x7f91a80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.239+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91ac003c60 con 0x7f91b410de10 2024-09-21T03:32:44.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.274+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7faa30102ef0 con 0x7faa30108d70 2024-09-21T03:32:44.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.275+0000 7faa2e7fc640 1 -- 172.21.15.102:0/3049813356 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7faa30102ef0 con 0x7faa30108d70 2024-09-21T03:32:44.277 INFO:teuthology.orchestra.run.smithi102.stdout:279172874270 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 msgr2=0x7faa180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 0x7faa180b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa20009a60 tx=0x7faa200093e0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 msgr2=0x7faa3019fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faa28009fd0 tx=0x7faa2800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 shutdown_connections 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7faa180b65f0 0x7faa180b8b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7faa30108d70 0x7faa3019fe80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7faa30108420 0x7faa3019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 --2- 172.21.15.102:0/3049813356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7faa30102ae0 0x7faa3019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 >> 172.21.15.102:0/3049813356 conn(0x7faa30079770 msgr2=0x7faa30106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 shutdown_connections 2024-09-21T03:32:44.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.277+0000 7faa377d3640 1 -- 172.21.15.102:0/3049813356 wait complete. 2024-09-21T03:32:44.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.431+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f91b41a71d0 con 0x7f91b410de10 2024-09-21T03:32:44.433 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/167305296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:32:44.433 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3049813356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:32:44.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.431+0000 7f91b1ffb640 1 -- 172.21.15.102:0/609306488 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f91ac0ada40 con 0x7f91b410de10 2024-09-21T03:32:44.434 INFO:teuthology.orchestra.run.smithi102.stdout:304942678042 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.433+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 msgr2=0x7f91a40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 0x7f91a40b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f91a80314b0 tx=0x7f91a80058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 msgr2=0x7f91b419fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009fd0 tx=0x7f91ac00b260 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 shutdown_connections 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f91a40b65f0 0x7f91a40b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b410de10 0x7f91b419fe20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91b4105300 0x7f91b419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 --2- 172.21.15.102:0/609306488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91b41049b0 0x7f91b419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 >> 172.21.15.102:0/609306488 conn(0x7f91b4079730 msgr2=0x7f91b40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 shutdown_connections 2024-09-21T03:32:44.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.434+0000 7f91badc3640 1 -- 172.21.15.102:0/609306488 wait complete. 2024-09-21T03:32:44.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 -- 172.21.15.102:0/1930672407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc108d10 msgr2=0x7f02bc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 --2- 172.21.15.102:0/1930672407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc108d10 0x7f02bc10f540 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009ca0 tx=0x7f02b402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 -- 172.21.15.102:0/1930672407 shutdown_connections 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 --2- 172.21.15.102:0/1930672407 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc108d10 0x7f02bc10f540 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 --2- 172.21.15.102:0/1930672407 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 0x7f02bc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 --2- 172.21.15.102:0/1930672407 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc102a80 0x7f02bc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.450+0000 7f02c3908640 1 -- 172.21.15.102:0/1930672407 >> 172.21.15.102:0/1930672407 conn(0x7f02bc079740 msgr2=0x7f02bc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.451+0000 7f02c3908640 1 -- 172.21.15.102:0/1930672407 shutdown_connections 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.451+0000 7f02c3908640 1 -- 172.21.15.102:0/1930672407 wait complete. 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.451+0000 7f02c3908640 1 Processor -- start 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 -- start start 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 0x7f02bc19b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc108d10 0x7f02bc19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc112ac0 con 0x7f02bc102a80 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc112940 con 0x7f02bc108d10 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c3908640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc112c40 con 0x7f02bc1083c0 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35126/0 (socket says 172.21.15.102:35126) 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 -- 172.21.15.102:0/1836223230 learned_addr learned my addr 172.21.15.102:0/1836223230 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c1ea5640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc108d10 0x7f02bc19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c0ea3640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 0x7f02bc19b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 -- 172.21.15.102:0/1836223230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 msgr2=0x7f02bc19b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 0x7f02bc19b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 -- 172.21.15.102:0/1836223230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc108d10 msgr2=0x7f02bc19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc108d10 0x7f02bc19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.452+0000 7f02c16a4640 1 -- 172.21.15.102:0/1836223230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc1a65f0 con 0x7f02bc102a80 2024-09-21T03:32:44.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02c16a4640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f02b800e9f0 tx=0x7f02b800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b800cd80 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f02b8010900 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02bc1a68e0 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8018920 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.453+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02bc1a6e20 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.454+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02bc103d00 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.456+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f02b8010ab0 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.457+0000 7f02b27fc640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 0x7f02a80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.457+0000 7f02c0ea3640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 0x7f02a80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.457+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f02b80e7f20 con 0x7f02bc102a80 2024-09-21T03:32:44.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.458+0000 7f02c0ea3640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 0x7f02a80b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f02ac005fd0 tx=0x7f02ac00b510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:44.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.461+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02b80ae550 con 0x7f02bc102a80 2024-09-21T03:32:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.648+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f02bc102e90 con 0x7f02bc102a80 2024-09-21T03:32:44.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.649+0000 7f02b27fc640 1 -- 172.21.15.102:0/1836223230 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f02bc102e90 con 0x7f02bc102a80 2024-09-21T03:32:44.651 INFO:teuthology.orchestra.run.smithi102.stdout:115964117058 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 msgr2=0x7f02a80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 0x7f02a80b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f02ac005fd0 tx=0x7f02ac00b510 comp rx=0 tx=0).stop 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 msgr2=0x7f02bc19b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f02b800e9f0 tx=0x7f02b800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 shutdown_connections 2024-09-21T03:32:44.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02a80b65f0 0x7f02a80b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f02bc108d10 0x7f02bc19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f02bc1083c0 0x7f02bc19b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 --2- 172.21.15.102:0/1836223230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02bc102a80 0x7f02bc19b330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 >> 172.21.15.102:0/1836223230 conn(0x7f02bc079740 msgr2=0x7f02bc104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 shutdown_connections 2024-09-21T03:32:44.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:44.651+0000 7f02c3908640 1 -- 172.21.15.102:0/1836223230 wait complete. 2024-09-21T03:32:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/167305296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:32:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3049813356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:32:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/167305296' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T03:32:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3049813356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T03:32:45.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:45 smithi102 ceph-mon[31392]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T03:32:45.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/609306488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:32:45.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1836223230' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:32:45.467 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:45.472 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:45.493 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874268 got 279172874270 for osd.10 2024-09-21T03:32:45.493 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:45.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:45 smithi148 ceph-mon[34651]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T03:32:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/609306488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:32:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1836223230' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:32:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:45 smithi121 ceph-mon[34316]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T03:32:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:45 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/609306488' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T03:32:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:45 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1836223230' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T03:32:46.085 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705743 got 38654705745 for osd.0 2024-09-21T03:32:46.086 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 -- 172.21.15.102:0/295523749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd174108d00 msgr2=0x7fd17410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 --2- 172.21.15.102:0/295523749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd174108d00 0x7fd17410f530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009ca0 tx=0x7fd16c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 -- 172.21.15.102:0/295523749 shutdown_connections 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 --2- 172.21.15.102:0/295523749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd174108d00 0x7fd17410f530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 --2- 172.21.15.102:0/295523749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1741083b0 0x7fd1741087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 --2- 172.21.15.102:0/295523749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 0x7fd174102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 -- 172.21.15.102:0/295523749 >> 172.21.15.102:0/295523749 conn(0x7fd174079790 msgr2=0x7fd174079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 -- 172.21.15.102:0/295523749 shutdown_connections 2024-09-21T03:32:46.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.427+0000 7fd179efe640 1 -- 172.21.15.102:0/295523749 wait complete. 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.428+0000 7fd179efe640 1 Processor -- start 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.428+0000 7fd179efe640 1 -- start start 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 0x7fd17419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd174108d00 0x7fd17419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd174112b00 con 0x7fd1741083b0 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd174112980 con 0x7fd174108d00 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd174112c80 con 0x7fd174102ac0 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35152/0 (socket says 172.21.15.102:35152) 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 -- 172.21.15.102:0/3890488909 learned_addr learned my addr 172.21.15.102:0/3890488909 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:46.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd1737fe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 0x7fd17419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd173fff640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd174108d00 0x7fd17419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 -- 172.21.15.102:0/3890488909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 msgr2=0x7fd17419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 0x7fd17419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 -- 172.21.15.102:0/3890488909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd174108d00 msgr2=0x7fd17419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd174108d00 0x7fd17419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 -- 172.21.15.102:0/3890488909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1741a66a0 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd172ffd640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd16800d740 tx=0x7fd16800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168017070 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd16800de50 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1741a6990 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.429+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16800f620 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.430+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1741a6ed0 con 0x7fd1741083b0 2024-09-21T03:32:46.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.430+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd174102ed0 con 0x7fd1741083b0 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.432+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fd16801a070 con 0x7fd1741083b0 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.433+0000 7fd170ff9640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 0x7fd15c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.433+0000 7fd1737fe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 0x7fd15c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.433+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fd1680e6f60 con 0x7fd1741083b0 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.434+0000 7fd1737fe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 0x7fd15c0b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1640058c0 tx=0x7fd16400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:46.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.436+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1680ad570 con 0x7fd1741083b0 2024-09-21T03:32:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.627+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd17402e640 con 0x7fd1741083b0 2024-09-21T03:32:46.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.627+0000 7fd170ff9640 1 -- 172.21.15.102:0/3890488909 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd1680b1950 con 0x7fd1741083b0 2024-09-21T03:32:46.629 INFO:teuthology.orchestra.run.smithi102.stdout:257698037797 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 msgr2=0x7fd15c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 0x7fd15c0b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd1640058c0 tx=0x7fd16400a250 comp rx=0 tx=0).stop 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 msgr2=0x7fd17419b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd16800d740 tx=0x7fd16800dc00 comp rx=0 tx=0).stop 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 shutdown_connections 2024-09-21T03:32:46.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd15c0b65f0 0x7fd15c0b8b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1741083b0 0x7fd17419b8d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd174108d00 0x7fd17419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 --2- 172.21.15.102:0/3890488909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd174102ac0 0x7fd17419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 >> 172.21.15.102:0/3890488909 conn(0x7fd174079790 msgr2=0x7fd174106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 shutdown_connections 2024-09-21T03:32:46.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:46.629+0000 7fd179efe640 1 -- 172.21.15.102:0/3890488909 wait complete. 2024-09-21T03:32:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 -- 172.21.15.102:0/2015153750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 msgr2=0x7f6c481087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/2015153750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c481087e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c009900 tx=0x7f6c3c02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:47.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 -- 172.21.15.102:0/2015153750 shutdown_connections 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/2015153750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c481087e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/2015153750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48108d20 0x7f6c4810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/2015153750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48102ae0 0x7f6c48102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 -- 172.21.15.102:0/2015153750 >> 172.21.15.102:0/2015153750 conn(0x7f6c48079790 msgr2=0x7f6c48079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 -- 172.21.15.102:0/2015153750 shutdown_connections 2024-09-21T03:32:47.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.251+0000 7f6c4f06f640 1 -- 172.21.15.102:0/2015153750 wait complete. 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 Processor -- start 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 -- start start 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 0x7f6c4819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48108d20 0x7f6c4819fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48112b40 con 0x7f6c481083d0 2024-09-21T03:32:47.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6c481129c0 con 0x7f6c48102ae0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4f06f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6c48112cc0 con 0x7f6c48108d20 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35184/0 (socket says 172.21.15.102:35184) 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c47fff640 1 -- 172.21.15.102:0/541256482 learned_addr learned my addr 172.21.15.102:0/541256482 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4d60c640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48108d20 0x7f6c4819fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.252+0000 7f6c4ce0b640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 0x7f6c4819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 -- 172.21.15.102:0/541256482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48108d20 msgr2=0x7f6c4819fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48108d20 0x7f6c4819fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 -- 172.21.15.102:0/541256482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 msgr2=0x7f6c4819a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 0x7f6c4819a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 -- 172.21.15.102:0/541256482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c481a0610 con 0x7f6c481083d0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c4ce0b640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 0x7f6c4819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c47fff640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005940 tx=0x7f6c3c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:47.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c03f030 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6c3c031910 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c035070 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c481a08a0 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.253+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c480ff550 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.254+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c48103d10 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.256+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f6c3c042030 con 0x7f6c481083d0 2024-09-21T03:32:47.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.257+0000 7f6c45ffb640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 0x7f6c300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.257+0000 7f6c4ce0b640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 0x7f6c300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.257+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f6c3c107d70 con 0x7f6c481083d0 2024-09-21T03:32:47.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.257+0000 7f6c4ce0b640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 0x7f6c300b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c38006fd0 tx=0x7f6c38006f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:47.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.260+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c3c0ce3a0 con 0x7f6c481083d0 2024-09-21T03:32:47.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.449+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6c48102ef0 con 0x7f6c481083d0 2024-09-21T03:32:47.451 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:47 smithi102 ceph-mon[31392]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:32:47.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:47 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3890488909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:32:47.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.450+0000 7f6c45ffb640 1 -- 172.21.15.102:0/541256482 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c3c0d2780 con 0x7f6c481083d0 2024-09-21T03:32:47.452 INFO:teuthology.orchestra.run.smithi102.stdout:64424509512 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 msgr2=0x7f6c300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 0x7f6c300b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6c38006fd0 tx=0x7f6c38006f40 comp rx=0 tx=0).stop 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 msgr2=0x7f6c4819ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005940 tx=0x7f6c3c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 shutdown_connections 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6c300b65f0 0x7f6c300b8b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6c481083d0 0x7f6c4819ac40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6c48108d20 0x7f6c4819fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 --2- 172.21.15.102:0/541256482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6c48102ae0 0x7f6c4819a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 >> 172.21.15.102:0/541256482 conn(0x7f6c48079790 msgr2=0x7f6c48101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 shutdown_connections 2024-09-21T03:32:47.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.452+0000 7f6c4f06f640 1 -- 172.21.15.102:0/541256482 wait complete. 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 -- 172.21.15.102:0/3240774210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 msgr2=0x7f91a4110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 --2- 172.21.15.102:0/3240774210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a4110320 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f919c009ca0 tx=0x7f919c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 -- 172.21.15.102:0/3240774210 shutdown_connections 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 --2- 172.21.15.102:0/3240774210 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a4110320 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 --2- 172.21.15.102:0/3240774210 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a4105320 0x7f91a410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 --2- 172.21.15.102:0/3240774210 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a41049d0 0x7f91a4104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 -- 172.21.15.102:0/3240774210 >> 172.21.15.102:0/3240774210 conn(0x7f91a4079740 msgr2=0x7f91a4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:47.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 -- 172.21.15.102:0/3240774210 shutdown_connections 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.470+0000 7f91a9417640 1 -- 172.21.15.102:0/3240774210 wait complete. 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 Processor -- start 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 -- start start 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a41049d0 0x7f91a419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a4105320 0x7f91a419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4113bf0 con 0x7f91a410de30 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4113a70 con 0x7f91a4105320 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a9417640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4113d70 con 0x7f91a41049d0 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35206/0 (socket says 172.21.15.102:35206) 2024-09-21T03:32:47.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a37fe640 1 -- 172.21.15.102:0/3810332723 learned_addr learned my addr 172.21.15.102:0/3810332723 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.471+0000 7f91a2ffd640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a41049d0 0x7f91a419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a27fc640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a4105320 0x7f91a419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 -- 172.21.15.102:0/3810332723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a41049d0 msgr2=0x7f91a419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a41049d0 0x7f91a419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 -- 172.21.15.102:0/3810332723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a4105320 msgr2=0x7f91a419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a4105320 0x7f91a419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 -- 172.21.15.102:0/3810332723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a41a0550 con 0x7f91a410de30 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a37fe640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f919c005e30 tx=0x7f919c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c031650 con 0x7f91a410de30 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f919c0317f0 con 0x7f91a410de30 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a41a07e0 con 0x7f91a410de30 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c02fb70 con 0x7f91a410de30 2024-09-21T03:32:47.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.472+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a41a6fa0 con 0x7f91a410de30 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.473+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a4104de0 con 0x7f91a410de30 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.476+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f919c02fd50 con 0x7f91a410de30 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.477+0000 7f918bfff640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 0x7f918c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.477+0000 7f91a2ffd640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 0x7f918c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.477+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f919c108a90 con 0x7f91a410de30 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.477+0000 7f91a2ffd640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 0x7f918c0b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91a406c620 tx=0x7f919400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:47.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.480+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f919c0cf0c0 con 0x7f91a410de30 2024-09-21T03:32:47.588 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:47 smithi121 ceph-mon[34316]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:32:47.588 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:47 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3890488909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:32:47.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.663+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f91a41a71d0 con 0x7f91a410de30 2024-09-21T03:32:47.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.663+0000 7f918bfff640 1 -- 172.21.15.102:0/3810332723 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f919c0d34a0 con 0x7f91a410de30 2024-09-21T03:32:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:141733920829 2024-09-21T03:32:47.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.665+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 msgr2=0x7f918c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.665+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 0x7f918c0b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91a406c620 tx=0x7f919400b390 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.665+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 msgr2=0x7f91a419fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.665+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f919c005e30 tx=0x7f919c003f90 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 shutdown_connections 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f918c0b65f0 0x7f918c0b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91a410de30 0x7f91a419fe20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f91a4105320 0x7f91a419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 --2- 172.21.15.102:0/3810332723 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f91a41049d0 0x7f91a419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 >> 172.21.15.102:0/3810332723 conn(0x7f91a4079740 msgr2=0x7f91a40ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 shutdown_connections 2024-09-21T03:32:47.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:47.666+0000 7f91a9417640 1 -- 172.21.15.102:0/3810332723 wait complete. 2024-09-21T03:32:47.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:47 smithi148 ceph-mon[34651]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:32:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:47 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3890488909' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T03:32:48.340 INFO:tasks.cephadm.ceph_manager.ceph:need seq 64424509510 got 64424509512 for osd.1 2024-09-21T03:32:48.340 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:48.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/541256482' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:32:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3810332723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:32:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/541256482' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:32:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3810332723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:32:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/541256482' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T03:32:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3810332723' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T03:32:49.483 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920827 got 141733920829 for osd.4 2024-09-21T03:32:49.483 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:49.577 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:49 smithi102 ceph-mon[31392]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:32:49.577 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:49 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/671127465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:32:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:49 smithi148 ceph-mon[34651]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:32:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:49 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/671127465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:32:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.661+0000 7fe88422b640 1 -- 172.21.15.102:0/2909414952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c103bb0 msgr2=0x7fe87c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.661+0000 7fe88422b640 1 --2- 172.21.15.102:0/2909414952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c103bb0 0x7fe87c103fc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009900 tx=0x7fe86c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.661+0000 7fe88422b640 1 -- 172.21.15.102:0/2909414952 shutdown_connections 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 --2- 172.21.15.102:0/2909414952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 0x7fe87c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 --2- 172.21.15.102:0/2909414952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c1094f0 0x7fe87c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 --2- 172.21.15.102:0/2909414952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c103bb0 0x7fe87c103fc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 -- 172.21.15.102:0/2909414952 >> 172.21.15.102:0/2909414952 conn(0x7fe87c0ff600 msgr2=0x7fe87c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 -- 172.21.15.102:0/2909414952 shutdown_connections 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 -- 172.21.15.102:0/2909414952 wait complete. 2024-09-21T03:32:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 Processor -- start 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.662+0000 7fe88422b640 1 -- start start 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c103bb0 0x7fe87c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 0x7fe87c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c113c20 con 0x7fe87c1094f0 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c113aa0 con 0x7fe87c103bb0 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c113da0 con 0x7fe87c109e40 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35246/0 (socket says 172.21.15.102:35246) 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 -- 172.21.15.102:0/3722294098 learned_addr learned my addr 172.21.15.102:0/3722294098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe881fc7640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c103bb0 0x7fe87c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8827c8640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 0x7fe87c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 -- 172.21.15.102:0/3722294098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 msgr2=0x7fe87c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 0x7fe87c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 -- 172.21.15.102:0/3722294098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c103bb0 msgr2=0x7fe87c19a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c103bb0 0x7fe87c19a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 -- 172.21.15.102:0/3722294098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c1a0400 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe8817c6640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c8c0 tx=0x7fe87800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe878007bb0 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe878007d50 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8780188c0 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.663+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c1a06f0 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.664+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c1a6f10 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.665+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c103fc0 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.667+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fe87800fb60 con 0x7fe87c1094f0 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.667+0000 7fe872ffd640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 0x7fe8680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.668+0000 7fe881fc7640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 0x7fe8680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.668+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fe8780e7920 con 0x7fe87c1094f0 2024-09-21T03:32:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.668+0000 7fe881fc7640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 0x7fe8680b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009230 tx=0x7fe86c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.671+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe878014030 con 0x7fe87c1094f0 2024-09-21T03:32:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:49 smithi121 ceph-mon[34316]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T03:32:49.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:49 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/671127465' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T03:32:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.854+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe87c19b680 con 0x7fe87c1094f0 2024-09-21T03:32:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.855+0000 7fe872ffd640 1 -- 172.21.15.102:0/3722294098 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe87c19b680 con 0x7fe87c1094f0 2024-09-21T03:32:49.857 INFO:teuthology.orchestra.run.smithi102.stdout:81604378696 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 msgr2=0x7fe8680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 0x7fe8680b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009230 tx=0x7fe86c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 msgr2=0x7fe87c19aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c8c0 tx=0x7fe87800cd80 comp rx=0 tx=0).stop 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 shutdown_connections 2024-09-21T03:32:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe8680b6620 0x7fe8680b8b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe87c1094f0 0x7fe87c19aaf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe87c109e40 0x7fe87c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 --2- 172.21.15.102:0/3722294098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe87c103bb0 0x7fe87c19a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 >> 172.21.15.102:0/3722294098 conn(0x7fe87c0ff600 msgr2=0x7fe87c108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 shutdown_connections 2024-09-21T03:32:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.857+0000 7fe88422b640 1 -- 172.21.15.102:0/3722294098 wait complete. 2024-09-21T03:32:50.606 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:50 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3722294098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:32:50.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117058 got 115964117058 for osd.3 2024-09-21T03:32:50.634 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:50 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3722294098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:32:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:50 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3722294098' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T03:32:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 -- 172.21.15.102:0/3981770909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 msgr2=0x7f3c08110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 --2- 172.21.15.102:0/3981770909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c08110640 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009ca0 tx=0x7f3c0002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 -- 172.21.15.102:0/3981770909 shutdown_connections 2024-09-21T03:32:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 --2- 172.21.15.102:0/3981770909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c08110640 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 --2- 172.21.15.102:0/3981770909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c081098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 --2- 172.21.15.102:0/3981770909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 0x7f3c08103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.878+0000 7f3c104c2640 1 -- 172.21.15.102:0/3981770909 >> 172.21.15.102:0/3981770909 conn(0x7f3c080ff610 msgr2=0x7f3c08101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.879+0000 7f3c104c2640 1 -- 172.21.15.102:0/3981770909 shutdown_connections 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.879+0000 7f3c104c2640 1 -- 172.21.15.102:0/3981770909 wait complete. 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.879+0000 7f3c104c2640 1 Processor -- start 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.879+0000 7f3c104c2640 1 -- start start 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 0x7f3c0819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c0819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113c10 con 0x7f3c08109e10 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113a90 con 0x7f3c081094c0 2024-09-21T03:32:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3c08113d90 con 0x7f3c08103b80 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35218/0 (socket says 172.21.15.102:35218) 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 -- 172.21.15.102:0/671127465 learned_addr learned my addr 172.21.15.102:0/671127465 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0da5d640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c0819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0e25e640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 0x7f3c0819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 -- 172.21.15.102:0/671127465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 msgr2=0x7f3c0819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 0x7f3c0819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 -- 172.21.15.102:0/671127465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 msgr2=0x7f3c0819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c0819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 -- 172.21.15.102:0/671127465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c081a0470 con 0x7f3c08109e10 2024-09-21T03:32:51.019 INFO:teuthology.orchestra.run.smithi102.stdout:163208757304 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0da5d640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c0819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c0ea5f640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c00005e30 tx=0x7f3c00003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c00031650 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3c000317f0 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c081a0700 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0002fac0 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.880+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c081a0c40 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.881+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c08104e00 con 0x7f3c08109e10 2024-09-21T03:32:51.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.883+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f3c0002fc60 con 0x7f3c08109e10 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.883+0000 7f3bff7fe640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.884+0000 7f3c0e25e640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.884+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f3c00108ac0 con 0x7f3c08109e10 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.884+0000 7f3c0e25e640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 0x7f3bf40b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009b60 tx=0x7f3c04005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:48.887+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c0003b410 con 0x7f3c08109e10 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.074+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3c08103f90 con 0x7f3c08109e10 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.075+0000 7f3bff7fe640 1 -- 172.21.15.102:0/671127465 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3c000cf0f0 con 0x7f3c08109e10 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 msgr2=0x7f3bf40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 0x7f3bf40b8b30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009b60 tx=0x7f3c04005f90 comp rx=0 tx=0).stop 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 msgr2=0x7f3c0819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3c00005e30 tx=0x7f3c00003d80 comp rx=0 tx=0).stop 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 shutdown_connections 2024-09-21T03:32:51.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3bf40b6620 0x7f3bf40b8b30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3c08109e10 0x7f3c0819fe00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3c081094c0 0x7f3c0819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 --2- 172.21.15.102:0/671127465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3c08103b80 0x7f3c0819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 >> 172.21.15.102:0/671127465 conn(0x7f3c080ff610 msgr2=0x7f3c08106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 shutdown_connections 2024-09-21T03:32:51.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:49.077+0000 7f3c104c2640 1 -- 172.21.15.102:0/671127465 wait complete. 2024-09-21T03:32:51.622 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:51 smithi102 ceph-mon[31392]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:51.651 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678040 got 304942678042 for osd.11 2024-09-21T03:32:51.652 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:51.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:51 smithi148 ceph-mon[34651]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:51 smithi121 ceph-mon[34316]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:52.073 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757302 got 163208757304 for osd.5 2024-09-21T03:32:52.073 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 -- 172.21.15.102:0/1609494466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5101083c0 msgr2=0x7fd5101087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 --2- 172.21.15.102:0/1609494466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5101083c0 0x7fd5101087d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009900 tx=0x7fd4fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 -- 172.21.15.102:0/1609494466 shutdown_connections 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 --2- 172.21.15.102:0/1609494466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd5101083c0 0x7fd5101087d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 --2- 172.21.15.102:0/1609494466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd510108d10 0x7fd51010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 --2- 172.21.15.102:0/1609494466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510102a80 0x7fd510102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 -- 172.21.15.102:0/1609494466 >> 172.21.15.102:0/1609494466 conn(0x7fd510079740 msgr2=0x7fd510079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 -- 172.21.15.102:0/1609494466 shutdown_connections 2024-09-21T03:32:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 -- 172.21.15.102:0/1609494466 wait complete. 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.340+0000 7fd516c17640 1 Processor -- start 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 -- start start 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 0x7fd5101047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510108d10 0x7fd510104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd510112af0 con 0x7fd510102a80 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd510112970 con 0x7fd510108d10 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd516c17640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd510112c70 con 0x7fd5101083c0 2024-09-21T03:32:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35254/0 (socket says 172.21.15.102:35254) 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 -- 172.21.15.102:0/2189189973 learned_addr learned my addr 172.21.15.102:0/2189189973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5151b4640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510108d10 0x7fd510104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd50ffff640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 0x7fd5101047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 -- 172.21.15.102:0/2189189973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 msgr2=0x7fd5101047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 0x7fd5101047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 -- 172.21.15.102:0/2189189973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510108d10 msgr2=0x7fd510104cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510108d10 0x7fd510104cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd5149b3640 1 -- 172.21.15.102:0/2189189973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5101a8890 con 0x7fd510102a80 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.341+0000 7fd50ffff640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 0x7fd5101047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd5149b3640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e9f0 tx=0x7fd50400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50400cd80 con 0x7fd510102a80 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd504010900 con 0x7fd510102a80 2024-09-21T03:32:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504018920 con 0x7fd510102a80 2024-09-21T03:32:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5101a8b80 con 0x7fd510102a80 2024-09-21T03:32:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.342+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5101a9070 con 0x7fd510102a80 2024-09-21T03:32:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.343+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd510103d00 con 0x7fd510102a80 2024-09-21T03:32:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.345+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fd504010ab0 con 0x7fd510102a80 2024-09-21T03:32:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.345+0000 7fd50dffb640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 0x7fd5000b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.346+0000 7fd50ffff640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 0x7fd5000b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.346+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fd5040e7fd0 con 0x7fd510102a80 2024-09-21T03:32:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.346+0000 7fd50ffff640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 0x7fd5000b8b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc02a930 tx=0x7fd4fc005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.352+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5040ae5a0 con 0x7fd510102a80 2024-09-21T03:32:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.545+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd510105570 con 0x7fd510102a80 2024-09-21T03:32:52.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.545+0000 7fd50dffb640 1 -- 172.21.15.102:0/2189189973 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd5040b2980 con 0x7fd510102a80 2024-09-21T03:32:52.547 INFO:teuthology.orchestra.run.smithi102.stdout:188978561077 2024-09-21T03:32:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 msgr2=0x7fd5000b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:52.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 0x7fd5000b8b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc02a930 tx=0x7fd4fc005fd0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 msgr2=0x7fd510104270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd50400e9f0 tx=0x7fd50400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 shutdown_connections 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd5000b6670 0x7fd5000b8b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd510108d10 0x7fd510104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd5101083c0 0x7fd5101047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.547+0000 7fd516c17640 1 --2- 172.21.15.102:0/2189189973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd510102a80 0x7fd510104270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.548+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 >> 172.21.15.102:0/2189189973 conn(0x7fd510079740 msgr2=0x7fd510101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.548+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 shutdown_connections 2024-09-21T03:32:52.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:52.548+0000 7fd516c17640 1 -- 172.21.15.102:0/2189189973 wait complete. 2024-09-21T03:32:53.058 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378694 got 81604378696 for osd.2 2024-09-21T03:32:53.058 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:53.445 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037793 got 257698037797 for osd.9 2024-09-21T03:32:53.446 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:53 smithi102 ceph-mon[31392]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:32:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:53 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2189189973' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:32:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:53 smithi148 ceph-mon[34651]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:32:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:53 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2189189973' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:32:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:53 smithi121 ceph-mon[34316]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:32:53.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:53 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2189189973' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T03:32:54.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561073 got 188978561077 for osd.6 2024-09-21T03:32:54.067 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:54.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 -- 172.21.15.102:0/3821679028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f4103b60 msgr2=0x7fc3f4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/3821679028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f4103b60 0x7fc3f4103f70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009900 tx=0x7fc3e402a410 comp rx=0 tx=0).stop 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 -- 172.21.15.102:0/3821679028 shutdown_connections 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/3821679028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 0x7fc3f4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/3821679028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f41094a0 0x7fc3f41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/3821679028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f4103b60 0x7fc3f4103f70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 -- 172.21.15.102:0/3821679028 >> 172.21.15.102:0/3821679028 conn(0x7fc3f407b850 msgr2=0x7fc3f407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 -- 172.21.15.102:0/3821679028 shutdown_connections 2024-09-21T03:32:54.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.313+0000 7fc3f8da3640 1 -- 172.21.15.102:0/3821679028 wait complete. 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.314+0000 7fc3f8da3640 1 Processor -- start 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.314+0000 7fc3f8da3640 1 -- start start 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.314+0000 7fc3f8da3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.314+0000 7fc3f8da3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 0x7fc3f419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.314+0000 7fc3f8da3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 0x7fc3f419ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f8da3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4113c50 con 0x7fc3f41094a0 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f8da3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4113ad0 con 0x7fc3f4103b60 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f8da3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f4113dd0 con 0x7fc3f4109df0 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:54.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:37654/0 (socket says 172.21.15.102:37654) 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f259c640 1 -- 172.21.15.102:0/4222560315 learned_addr learned my addr 172.21.15.102:0/4222560315 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 0x7fc3f419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f2d9d640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 0x7fc3f419ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 -- 172.21.15.102:0/4222560315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 msgr2=0x7fc3f419ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 0x7fc3f419ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 -- 172.21.15.102:0/4222560315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 msgr2=0x7fc3f419a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f1d9b640 1 -- 172.21.15.102:0/4222560315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f41a0630 con 0x7fc3f41094a0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.315+0000 7fc3f259c640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3f1d9b640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 0x7fc3f419ac60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3f406c9f0 tx=0x7fc3e800db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8017070 con 0x7fc3f41094a0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3e8009820 con 0x7fc3f41094a0 2024-09-21T03:32:54.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8004c60 con 0x7fc3f41094a0 2024-09-21T03:32:54.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f41a0920 con 0x7fc3f41094a0 2024-09-21T03:32:54.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.316+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f41a7080 con 0x7fc3f41094a0 2024-09-21T03:32:54.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.317+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f4103f70 con 0x7fc3f41094a0 2024-09-21T03:32:54.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.319+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fc3e80099d0 con 0x7fc3f41094a0 2024-09-21T03:32:54.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.319+0000 7fc3e37fe640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 0x7fc3dc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:54.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.319+0000 7fc3f259c640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 0x7fc3dc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:54.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.319+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fc3e80e7360 con 0x7fc3f41094a0 2024-09-21T03:32:54.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.320+0000 7fc3f259c640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 0x7fc3dc0b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40096c0 tx=0x7fc3e4005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.322+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3e80ad930 con 0x7fc3f41094a0 2024-09-21T03:32:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:54.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.511+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fc3f419b7f0 con 0x7fc3f41094a0 2024-09-21T03:32:54.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.512+0000 7fc3e37fe640 1 -- 172.21.15.102:0/4222560315 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc3f419b7f0 con 0x7fc3f41094a0 2024-09-21T03:32:54.514 INFO:teuthology.orchestra.run.smithi102.stdout:236223201323 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 msgr2=0x7fc3dc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 0x7fc3dc0b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40096c0 tx=0x7fc3e4005a20 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 msgr2=0x7fc3f419ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 0x7fc3f419ac60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc3f406c9f0 tx=0x7fc3e800db30 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 shutdown_connections 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3dc0b65f0 0x7fc3dc0b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3f41094a0 0x7fc3f419ac60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3f4109df0 0x7fc3f419ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 --2- 172.21.15.102:0/4222560315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3f4103b60 0x7fc3f419a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 >> 172.21.15.102:0/4222560315 conn(0x7fc3f407b850 msgr2=0x7fc3f41075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 shutdown_connections 2024-09-21T03:32:54.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:54.514+0000 7fc3f8da3640 1 -- 172.21.15.102:0/4222560315 wait complete. 2024-09-21T03:32:55.363 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201319 got 236223201323 for osd.8 2024-09-21T03:32:55.363 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.597+0000 7f19357e3640 1 -- 172.21.15.102:0/2098686697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930103230 msgr2=0x7f1930103640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.597+0000 7f19357e3640 1 --2- 172.21.15.102:0/2098686697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930103230 0x7f1930103640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1920009900 tx=0x7f192002a410 comp rx=0 tx=0).stop 2024-09-21T03:32:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 -- 172.21.15.102:0/2098686697 shutdown_connections 2024-09-21T03:32:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 --2- 172.21.15.102:0/2098686697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108fc0 0x7f193010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 --2- 172.21.15.102:0/2098686697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930108670 0x7f1930108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 --2- 172.21.15.102:0/2098686697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930103230 0x7f1930103640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 -- 172.21.15.102:0/2098686697 >> 172.21.15.102:0/2098686697 conn(0x7f1930079ea0 msgr2=0x7f193007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 -- 172.21.15.102:0/2098686697 shutdown_connections 2024-09-21T03:32:55.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:55 smithi102 ceph-mon[31392]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:55.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:55 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4222560315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.598+0000 7f19357e3640 1 -- 172.21.15.102:0/2098686697 wait complete. 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 Processor -- start 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 -- start start 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930103230 0x7f193019a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108670 0x7f193019ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112e20 con 0x7f1930108fc0 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112ca0 con 0x7f1930103230 2024-09-21T03:32:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.599+0000 7f19357e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1930112fa0 con 0x7f1930108670 2024-09-21T03:32:55.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56962/0 (socket says 172.21.15.102:56962) 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 -- 172.21.15.102:0/1253868076 learned_addr learned my addr 172.21.15.102:0/1253868076 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192effd640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930103230 0x7f193019a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192e7fc640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108670 0x7f193019ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 -- 172.21.15.102:0/1253868076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108670 msgr2=0x7f193019ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108670 0x7f193019ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 -- 172.21.15.102:0/1253868076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930103230 msgr2=0x7f193019a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930103230 0x7f193019a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 -- 172.21.15.102:0/1253868076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19301a0830 con 0x7f1930108fc0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f192f7fe640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f192800b970 tx=0x7f192800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928019070 con 0x7f1930108fc0 2024-09-21T03:32:55.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19301a0b20 con 0x7f1930108fc0 2024-09-21T03:32:55.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f192800cb40 con 0x7f1930108fc0 2024-09-21T03:32:55.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928007610 con 0x7f1930108fc0 2024-09-21T03:32:55.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.600+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19300fedb0 con 0x7f1930108fc0 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.602+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1930103640 con 0x7f1930108fc0 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.603+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f192801c070 con 0x7f1930108fc0 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.604+0000 7f1917fff640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 0x7f19180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.604+0000 7f192effd640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 0x7f19180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.604+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f19280e6b20 con 0x7f1930108fc0 2024-09-21T03:32:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.605+0000 7f192effd640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 0x7f19180b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:55.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.609+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19280ad150 con 0x7f1930108fc0 2024-09-21T03:32:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:55 smithi148 ceph-mon[34651]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:55 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4222560315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:32:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:55 smithi121 ceph-mon[34316]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:32:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:55 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4222560315' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T03:32:55.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.798+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f19300ff010 con 0x7f1930108fc0 2024-09-21T03:32:55.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.799+0000 7f1917fff640 1 -- 172.21.15.102:0/1253868076 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f19280b1530 con 0x7f1930108fc0 2024-09-21T03:32:55.801 INFO:teuthology.orchestra.run.smithi102.stdout:210453397551 2024-09-21T03:32:55.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 msgr2=0x7f19180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:55.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 0x7f19180b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920005d50 comp rx=0 tx=0).stop 2024-09-21T03:32:55.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 msgr2=0x7f19301a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:55.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f192800b970 tx=0x7f192800be30 comp rx=0 tx=0).stop 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 shutdown_connections 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f19180b65f0 0x7f19180b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1930108fc0 0x7f19301a0100 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1930108670 0x7f193019ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 --2- 172.21.15.102:0/1253868076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1930103230 0x7f193019a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 >> 172.21.15.102:0/1253868076 conn(0x7f1930079ea0 msgr2=0x7f19301010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 shutdown_connections 2024-09-21T03:32:55.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:55.801+0000 7f19357e3640 1 -- 172.21.15.102:0/1253868076 wait complete. 2024-09-21T03:32:56.550 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397546 got 210453397551 for osd.7 2024-09-21T03:32:56.550 DEBUG:teuthology.parallel:result is None 2024-09-21T03:32:56.550 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T03:32:56.550 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:56.796 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1253868076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.916 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:56 smithi102 ceph-mon[31392]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1253868076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:56 smithi148 ceph-mon[34651]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:32:57.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1253868076' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:32:57.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:56 smithi121 ceph-mon[34316]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:32:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 -- 172.21.15.102:0/1854644630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c103170 msgr2=0x7fd27c1076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 --2- 172.21.15.102:0/1854644630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c103170 0x7fd27c1076a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009900 tx=0x7fd26c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 -- 172.21.15.102:0/1854644630 shutdown_connections 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 --2- 172.21.15.102:0/1854644630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c103170 0x7fd27c1076a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 --2- 172.21.15.102:0/1854644630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c107c30 0x7fd27c1080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 --2- 172.21.15.102:0/1854644630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 0x7fd27c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 -- 172.21.15.102:0/1854644630 >> 172.21.15.102:0/1854644630 conn(0x7fd27c079790 msgr2=0x7fd27c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 -- 172.21.15.102:0/1854644630 shutdown_connections 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.272+0000 7fd2841a4640 1 -- 172.21.15.102:0/1854644630 wait complete. 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 Processor -- start 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 -- start start 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 0x7fd27c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c103170 0x7fd27c1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c11a1a0 con 0x7fd27c107c30 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c11a020 con 0x7fd27c103170 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd2841a4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c11a320 con 0x7fd27c102820 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd282741640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd282741640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56966/0 (socket says 172.21.15.102:56966) 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.273+0000 7fd282741640 1 -- 172.21.15.102:0/3548469702 learned_addr learned my addr 172.21.15.102:0/3548469702 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd28173f640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c103170 0x7fd27c1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd281f40640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 0x7fd27c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 -- 172.21.15.102:0/3548469702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 msgr2=0x7fd27c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 0x7fd27c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 -- 172.21.15.102:0/3548469702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c103170 msgr2=0x7fd27c1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c103170 0x7fd27c1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 -- 172.21.15.102:0/3548469702 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c1a69a0 con 0x7fd27c107c30 2024-09-21T03:32:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd282741640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd27400cce0 tx=0x7fd27400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:57.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27400f450 con 0x7fd27c107c30 2024-09-21T03:32:57.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd27400fac0 con 0x7fd27c107c30 2024-09-21T03:32:57.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c1a6c90 con 0x7fd27c107c30 2024-09-21T03:32:57.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274018b20 con 0x7fd27c107c30 2024-09-21T03:32:57.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.274+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c1a7150 con 0x7fd27c107c30 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.275+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd27c06c1d0 con 0x7fd27c107c30 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.277+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fd27400fc70 con 0x7fd27c107c30 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.278+0000 7fd272ffd640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 0x7fd2680b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.278+0000 7fd281f40640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 0x7fd2680b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.278+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fd2740e7e20 con 0x7fd27c107c30 2024-09-21T03:32:57.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.278+0000 7fd281f40640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 0x7fd2680b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd27800abe0 tx=0x7fd27800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.281+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd274014030 con 0x7fd27c107c30 2024-09-21T03:32:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.457+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd27c106d40 con 0x7fd2680b6620 2024-09-21T03:32:57.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.462+0000 7fd272ffd640 1 -- 172.21.15.102:0/3548469702 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258998 (secure 0 0 0) 0x7fd27c106d40 con 0x7fd2680b6620 2024-09-21T03:32:57.466 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:57.468 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 msgr2=0x7fd2680b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:57.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 0x7fd2680b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd27800abe0 tx=0x7fd27800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 msgr2=0x7fd27c1a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd27400cce0 tx=0x7fd27400a620 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 shutdown_connections 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd2680b6620 0x7fd2680b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd27c107c30 0x7fd27c1a6330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd27c103170 0x7fd27c1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 --2- 172.21.15.102:0/3548469702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd27c102820 0x7fd27c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 >> 172.21.15.102:0/3548469702 conn(0x7fd27c079790 msgr2=0x7fd27c105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 shutdown_connections 2024-09-21T03:32:57.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:57.464+0000 7fd2841a4640 1 -- 172.21.15.102:0/3548469702 wait complete. 2024-09-21T03:32:58.178 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-21T03:32:56.238369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":488,"num_read_kb":342,"num_write":287,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359808,"kb_used_data":10512,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582016,"statfs":{"total":1151940427776,"available":1151571984384,"internally_reserved":0,"allocated":10764288,"data_stored":7057716,"data_compressed":182511,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003290"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291302+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:05.291302+0000","last_peered":"2024-09-21T03:32:05.291302+0000","last_clean":"2024-09-21T03:32:05.291302+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:05.291302+0000","last_undegraded":"2024-09-21T03:32:05.291302+0000","last_fullsized":"2024-09-21T03:32:05.291302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293620+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:32:05.293620+0000","last_peered":"2024-09-21T03:32:05.293620+0000","last_clean":"2024-09-21T03:32:05.293620+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:32:05.293620+0000","last_undegraded":"2024-09-21T03:32:05.293620+0000","last_fullsized":"2024-09-21T03:32:05.293620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293929+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:32:05.293929+0000","last_peered":"2024-09-21T03:32:05.293929+0000","last_clean":"2024-09-21T03:32:05.293929+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:32:05.293929+0000","last_undegraded":"2024-09-21T03:32:05.293929+0000","last_fullsized":"2024-09-21T03:32:05.293929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287476+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:05.287476+0000","last_peered":"2024-09-21T03:32:05.287476+0000","last_clean":"2024-09-21T03:32:05.287476+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:05.287476+0000","last_undegraded":"2024-09-21T03:32:05.287476+0000","last_fullsized":"2024-09-21T03:32:05.287476+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339877+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:32:05.339877+0000","last_peered":"2024-09-21T03:32:05.339877+0000","last_clean":"2024-09-21T03:32:05.339877+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:32:05.339877+0000","last_undegraded":"2024-09-21T03:32:05.339877+0000","last_fullsized":"2024-09-21T03:32:05.339877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287421+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:05.287421+0000","last_peered":"2024-09-21T03:32:05.287421+0000","last_clean":"2024-09-21T03:32:05.287421+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:05.287421+0000","last_undegraded":"2024-09-21T03:32:05.287421+0000","last_fullsized":"2024-09-21T03:32:05.287421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292770+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:32:05.292770+0000","last_peered":"2024-09-21T03:32:05.292770+0000","last_clean":"2024-09-21T03:32:05.292770+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:32:05.292770+0000","last_undegraded":"2024-09-21T03:32:05.292770+0000","last_fullsized":"2024-09-21T03:32:05.292770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292473+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:32:05.292473+0000","last_peered":"2024-09-21T03:32:05.292473+0000","last_clean":"2024-09-21T03:32:05.292473+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:32:05.292473+0000","last_undegraded":"2024-09-21T03:32:05.292473+0000","last_fullsized":"2024-09-21T03:32:05.292473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291444+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:05.291444+0000","last_peered":"2024-09-21T03:32:05.291444+0000","last_clean":"2024-09-21T03:32:05.291444+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:05.291444+0000","last_undegraded":"2024-09-21T03:32:05.291444+0000","last_fullsized":"2024-09-21T03:32:05.291444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295215+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:32:05.295215+0000","last_peered":"2024-09-21T03:32:05.295215+0000","last_clean":"2024-09-21T03:32:05.295215+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:32:05.295215+0000","last_undegraded":"2024-09-21T03:32:05.295215+0000","last_fullsized":"2024-09-21T03:32:05.295215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339934+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:32:05.339934+0000","last_peered":"2024-09-21T03:32:05.339934+0000","last_clean":"2024-09-21T03:32:05.339934+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:32:05.339934+0000","last_undegraded":"2024-09-21T03:32:05.339934+0000","last_fullsized":"2024-09-21T03:32:05.339934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288740+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:05.288740+0000","last_peered":"2024-09-21T03:32:05.288740+0000","last_clean":"2024-09-21T03:32:05.288740+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:05.288740+0000","last_undegraded":"2024-09-21T03:32:05.288740+0000","last_fullsized":"2024-09-21T03:32:05.288740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340183+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:32:05.340183+0000","last_peered":"2024-09-21T03:32:05.340183+0000","last_clean":"2024-09-21T03:32:05.340183+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:32:05.340183+0000","last_undegraded":"2024-09-21T03:32:05.340183+0000","last_fullsized":"2024-09-21T03:32:05.340183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290760+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:05.290760+0000","last_peered":"2024-09-21T03:32:05.290760+0000","last_clean":"2024-09-21T03:32:05.290760+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:05.290760+0000","last_undegraded":"2024-09-21T03:32:05.290760+0000","last_fullsized":"2024-09-21T03:32:05.290760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293810+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:32:05.293810+0000","last_peered":"2024-09-21T03:32:05.293810+0000","last_clean":"2024-09-21T03:32:05.293810+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:32:05.293810+0000","last_undegraded":"2024-09-21T03:32:05.293810+0000","last_fullsized":"2024-09-21T03:32:05.293810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290013+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:05.290013+0000","last_peered":"2024-09-21T03:32:05.290013+0000","last_clean":"2024-09-21T03:32:05.290013+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:05.290013+0000","last_undegraded":"2024-09-21T03:32:05.290013+0000","last_fullsized":"2024-09-21T03:32:05.290013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:52.419161+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:52.419161+0000","last_peered":"2024-09-21T03:32:52.419161+0000","last_clean":"2024-09-21T03:32:52.419161+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:52.419161+0000","last_undegraded":"2024-09-21T03:32:52.419161+0000","last_fullsized":"2024-09-21T03:32:52.419161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289356+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:05.289356+0000","last_peered":"2024-09-21T03:32:05.289356+0000","last_clean":"2024-09-21T03:32:05.289356+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:05.289356+0000","last_undegraded":"2024-09-21T03:32:05.289356+0000","last_fullsized":"2024-09-21T03:32:05.289356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.304765+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:32:05.304765+0000","last_peered":"2024-09-21T03:32:05.304765+0000","last_clean":"2024-09-21T03:32:05.304765+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:32:05.304765+0000","last_undegraded":"2024-09-21T03:32:05.304765+0000","last_fullsized":"2024-09-21T03:32:05.304765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339935+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:32:05.339935+0000","last_peered":"2024-09-21T03:32:05.339935+0000","last_clean":"2024-09-21T03:32:05.339935+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:32:05.339935+0000","last_undegraded":"2024-09-21T03:32:05.339935+0000","last_fullsized":"2024-09-21T03:32:05.339935+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289031+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:05.289031+0000","last_peered":"2024-09-21T03:32:05.289031+0000","last_clean":"2024-09-21T03:32:05.289031+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:05.289031+0000","last_undegraded":"2024-09-21T03:32:05.289031+0000","last_fullsized":"2024-09-21T03:32:05.289031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:53.420040+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:53.420040+0000","last_peered":"2024-09-21T03:32:53.420040+0000","last_clean":"2024-09-21T03:32:53.420040+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:53.420040+0000","last_undegraded":"2024-09-21T03:32:53.420040+0000","last_fullsized":"2024-09-21T03:32:53.420040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294332+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:32:05.294332+0000","last_peered":"2024-09-21T03:32:05.294332+0000","last_clean":"2024-09-21T03:32:05.294332+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:32:05.294332+0000","last_undegraded":"2024-09-21T03:32:05.294332+0000","last_fullsized":"2024-09-21T03:32:05.294332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289196+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:05.289196+0000","last_peered":"2024-09-21T03:32:05.289196+0000","last_clean":"2024-09-21T03:32:05.289196+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:05.289196+0000","last_undegraded":"2024-09-21T03:32:05.289196+0000","last_fullsized":"2024-09-21T03:32:05.289196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":188,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:54.421584+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:54.421584+0000","last_peered":"2024-09-21T03:32:54.421584+0000","last_clean":"2024-09-21T03:32:54.421584+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:54.421584+0000","last_undegraded":"2024-09-21T03:32:54.421584+0000","last_fullsized":"2024-09-21T03:32:54.421584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289088+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:05.289088+0000","last_peered":"2024-09-21T03:32:05.289088+0000","last_clean":"2024-09-21T03:32:05.289088+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:05.289088+0000","last_undegraded":"2024-09-21T03:32:05.289088+0000","last_fullsized":"2024-09-21T03:32:05.289088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":94,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:53.420072+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:53.420072+0000","last_peered":"2024-09-21T03:32:53.420072+0000","last_clean":"2024-09-21T03:32:53.420072+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:53.420072+0000","last_undegraded":"2024-09-21T03:32:53.420072+0000","last_fullsized":"2024-09-21T03:32:53.420072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289284+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:05.289284+0000","last_peered":"2024-09-21T03:32:05.289284+0000","last_clean":"2024-09-21T03:32:05.289284+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:05.289284+0000","last_undegraded":"2024-09-21T03:32:05.289284+0000","last_fullsized":"2024-09-21T03:32:05.289284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290504+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:05.290504+0000","last_peered":"2024-09-21T03:32:05.290504+0000","last_clean":"2024-09-21T03:32:05.290504+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:05.290504+0000","last_undegraded":"2024-09-21T03:32:05.290504+0000","last_fullsized":"2024-09-21T03:32:05.290504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289263+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:05.289263+0000","last_peered":"2024-09-21T03:32:05.289263+0000","last_clean":"2024-09-21T03:32:05.289263+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:05.289263+0000","last_undegraded":"2024-09-21T03:32:05.289263+0000","last_fullsized":"2024-09-21T03:32:05.289263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287557+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:05.287557+0000","last_peered":"2024-09-21T03:32:05.287557+0000","last_clean":"2024-09-21T03:32:05.287557+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:05.287557+0000","last_undegraded":"2024-09-21T03:32:05.287557+0000","last_fullsized":"2024-09-21T03:32:05.287557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340133+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:32:05.340133+0000","last_peered":"2024-09-21T03:32:05.340133+0000","last_clean":"2024-09-21T03:32:05.340133+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:32:05.340133+0000","last_undegraded":"2024-09-21T03:32:05.340133+0000","last_fullsized":"2024-09-21T03:32:05.340133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":87,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:49.413836+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:49.413836+0000","last_peered":"2024-09-21T03:32:49.413836+0000","last_clean":"2024-09-21T03:32:49.413836+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:49.413836+0000","last_undegraded":"2024-09-21T03:32:49.413836+0000","last_fullsized":"2024-09-21T03:32:49.413836+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":60,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288948+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:05.288948+0000","last_peered":"2024-09-21T03:32:05.288948+0000","last_clean":"2024-09-21T03:32:05.288948+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:05.288948+0000","last_undegraded":"2024-09-21T03:32:05.288948+0000","last_fullsized":"2024-09-21T03:32:05.288948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.300572+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:32:05.300572+0000","last_peered":"2024-09-21T03:32:05.300572+0000","last_clean":"2024-09-21T03:32:05.300572+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:32:05.300572+0000","last_undegraded":"2024-09-21T03:32:05.300572+0000","last_fullsized":"2024-09-21T03:32:05.300572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:06.509242+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:06.509242+0000","last_peered":"2024-09-21T03:32:06.509242+0000","last_clean":"2024-09-21T03:32:06.509242+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:06.509242+0000","last_undegraded":"2024-09-21T03:32:06.509242+0000","last_fullsized":"2024-09-21T03:32:06.509242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340238+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:32:05.340238+0000","last_peered":"2024-09-21T03:32:05.340238+0000","last_clean":"2024-09-21T03:32:05.340238+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:32:05.340238+0000","last_undegraded":"2024-09-21T03:32:05.340238+0000","last_fullsized":"2024-09-21T03:32:05.340238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287672+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:05.287672+0000","last_peered":"2024-09-21T03:32:05.287672+0000","last_clean":"2024-09-21T03:32:05.287672+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:05.287672+0000","last_undegraded":"2024-09-21T03:32:05.287672+0000","last_fullsized":"2024-09-21T03:32:05.287672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293740+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:32:05.293740+0000","last_peered":"2024-09-21T03:32:05.293740+0000","last_clean":"2024-09-21T03:32:05.293740+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:32:05.293740+0000","last_undegraded":"2024-09-21T03:32:05.293740+0000","last_fullsized":"2024-09-21T03:32:05.293740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340090+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:32:05.340090+0000","last_peered":"2024-09-21T03:32:05.340090+0000","last_clean":"2024-09-21T03:32:05.340090+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:32:05.340090+0000","last_undegraded":"2024-09-21T03:32:05.340090+0000","last_fullsized":"2024-09-21T03:32:05.340090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290664+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:05.290664+0000","last_peered":"2024-09-21T03:32:05.290664+0000","last_clean":"2024-09-21T03:32:05.290664+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:05.290664+0000","last_undegraded":"2024-09-21T03:32:05.290664+0000","last_fullsized":"2024-09-21T03:32:05.290664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340055+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:32:05.340055+0000","last_peered":"2024-09-21T03:32:05.340055+0000","last_clean":"2024-09-21T03:32:05.340055+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:32:05.340055+0000","last_undegraded":"2024-09-21T03:32:05.340055+0000","last_fullsized":"2024-09-21T03:32:05.340055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295022+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:32:05.295022+0000","last_peered":"2024-09-21T03:32:05.295022+0000","last_clean":"2024-09-21T03:32:05.295022+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:32:05.295022+0000","last_undegraded":"2024-09-21T03:32:05.295022+0000","last_fullsized":"2024-09-21T03:32:05.295022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294229+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:32:05.294229+0000","last_peered":"2024-09-21T03:32:05.294229+0000","last_clean":"2024-09-21T03:32:05.294229+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:32:05.294229+0000","last_undegraded":"2024-09-21T03:32:05.294229+0000","last_fullsized":"2024-09-21T03:32:05.294229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340409+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:32:05.340409+0000","last_peered":"2024-09-21T03:32:05.340409+0000","last_clean":"2024-09-21T03:32:05.340409+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:32:05.340409+0000","last_undegraded":"2024-09-21T03:32:05.340409+0000","last_fullsized":"2024-09-21T03:32:05.340409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340295+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:32:05.340295+0000","last_peered":"2024-09-21T03:32:05.340295+0000","last_clean":"2024-09-21T03:32:05.340295+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:32:05.340295+0000","last_undegraded":"2024-09-21T03:32:05.340295+0000","last_fullsized":"2024-09-21T03:32:05.340295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":407,"num_read_kb":273,"num_write":162,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":204882,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678045,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":424023,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874273,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1079775,"data_compressed":43548,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037799,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201323,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397551,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561077,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":1015771,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":424566,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117061,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":423937,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":488950,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":487321,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":424897,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63902,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65531,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65871,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:58.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T03:32:58.428 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 -- 172.21.15.102:0/2039013398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c105380 msgr2=0x7fbb6c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 --2- 172.21.15.102:0/2039013398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c105380 0x7fbb6c10d8d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009900 tx=0x7fbb6002a410 comp rx=0 tx=0).stop 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 -- 172.21.15.102:0/2039013398 shutdown_connections 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 --2- 172.21.15.102:0/2039013398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c105380 0x7fbb6c10d8d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 --2- 172.21.15.102:0/2039013398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c10de60 0x7fbb6c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 --2- 172.21.15.102:0/2039013398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c104a30 0x7fbb6c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.903+0000 7fbb7110a640 1 -- 172.21.15.102:0/2039013398 >> 172.21.15.102:0/2039013398 conn(0x7fbb6c0797b0 msgr2=0x7fbb6c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.904+0000 7fbb7110a640 1 -- 172.21.15.102:0/2039013398 shutdown_connections 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.904+0000 7fbb7110a640 1 -- 172.21.15.102:0/2039013398 wait complete. 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.904+0000 7fbb7110a640 1 Processor -- start 2024-09-21T03:32:58.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 -- start start 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c105380 0x7fbb6c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 0x7fbb6c19ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113ca0 con 0x7fbb6c104a30 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113b20 con 0x7fbb6c105380 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb7110a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c113e20 con 0x7fbb6c10de60 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56994/0 (socket says 172.21.15.102:56994) 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 -- 172.21.15.102:0/620544518 learned_addr learned my addr 172.21.15.102:0/620544518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6b59e640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 0x7fbb6c19ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6a59c640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c105380 0x7fbb6c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 -- 172.21.15.102:0/620544518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 msgr2=0x7fbb6c19ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:58.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 0x7fbb6c19ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 -- 172.21.15.102:0/620544518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c105380 msgr2=0x7fbb6c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c105380 0x7fbb6c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 -- 172.21.15.102:0/620544518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c1a0660 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6b59e640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 0x7fbb6c19ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.905+0000 7fbb6ad9d640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00ba50 tx=0x7fbb5c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.906+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c019070 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.906+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c1a0950 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.906+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbb5c00cbe0 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.906+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c0076e0 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.906+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1a70b0 con 0x7fbb6c104a30 2024-09-21T03:32:58.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.907+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c104ec0 con 0x7fbb6c104a30 2024-09-21T03:32:58.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.909+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fbb5c01c070 con 0x7fbb6c104a30 2024-09-21T03:32:58.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.910+0000 7fbb53fff640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 0x7fbb540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:32:58.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.910+0000 7fbb6a59c640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 0x7fbb540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:32:58.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.910+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fbb5c0e7080 con 0x7fbb6c104a30 2024-09-21T03:32:58.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.910+0000 7fbb6a59c640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 0x7fbb540b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009230 tx=0x7fbb60005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:32:58.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:58.913+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb5c0ad6b0 con 0x7fbb6c104a30 2024-09-21T03:32:59.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.085+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb6c108fa0 con 0x7fbb540b65f0 2024-09-21T03:32:59.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.090+0000 7fbb53fff640 1 -- 172.21.15.102:0/620544518 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258998 (secure 0 0 0) 0x7fbb6c108fa0 con 0x7fbb540b65f0 2024-09-21T03:32:59.094 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:32:59.096 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 msgr2=0x7fbb540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 0x7fbb540b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009230 tx=0x7fbb60005d50 comp rx=0 tx=0).stop 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 msgr2=0x7fbb6c19a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c00ba50 tx=0x7fbb5c00bf10 comp rx=0 tx=0).stop 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 shutdown_connections 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbb540b65f0 0x7fbb540b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:59.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbb6c10de60 0x7fbb6c19ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbb6c105380 0x7fbb6c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 --2- 172.21.15.102:0/620544518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbb6c104a30 0x7fbb6c19a6f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:32:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 >> 172.21.15.102:0/620544518 conn(0x7fbb6c0797b0 msgr2=0x7fbb6c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:32:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 shutdown_connections 2024-09-21T03:32:59.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:32:59.093+0000 7fbb7110a640 1 -- 172.21.15.102:0/620544518 wait complete. 2024-09-21T03:32:59.413 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:59 smithi102 ceph-mon[31392]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:59.414 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:32:59 smithi102 ceph-mon[31392]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:32:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:59 smithi148 ceph-mon[34651]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:32:59 smithi148 ceph-mon[34651]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:32:59.760 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-21T03:32:58.238934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":493,"num_read_kb":347,"num_write":287,"num_write_kb":2268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359808,"kb_used_data":10512,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124582016,"statfs":{"total":1151940427776,"available":1151571984384,"internally_reserved":0,"allocated":10764288,"data_stored":7057716,"data_compressed":182511,"data_compressed_allocated":245760,"data_compressed_original":1990656,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003439"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291302+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:32:05.291302+0000","last_peered":"2024-09-21T03:32:05.291302+0000","last_clean":"2024-09-21T03:32:05.291302+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:32:05.291302+0000","last_undegraded":"2024-09-21T03:32:05.291302+0000","last_fullsized":"2024-09-21T03:32:05.291302+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293620+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:32:05.293620+0000","last_peered":"2024-09-21T03:32:05.293620+0000","last_clean":"2024-09-21T03:32:05.293620+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:32:05.293620+0000","last_undegraded":"2024-09-21T03:32:05.293620+0000","last_fullsized":"2024-09-21T03:32:05.293620+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293929+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:32:05.293929+0000","last_peered":"2024-09-21T03:32:05.293929+0000","last_clean":"2024-09-21T03:32:05.293929+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:32:05.293929+0000","last_undegraded":"2024-09-21T03:32:05.293929+0000","last_fullsized":"2024-09-21T03:32:05.293929+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287476+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:32:05.287476+0000","last_peered":"2024-09-21T03:32:05.287476+0000","last_clean":"2024-09-21T03:32:05.287476+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:32:05.287476+0000","last_undegraded":"2024-09-21T03:32:05.287476+0000","last_fullsized":"2024-09-21T03:32:05.287476+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291453+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:32:05.291453+0000","last_peered":"2024-09-21T03:32:05.291453+0000","last_clean":"2024-09-21T03:32:05.291453+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:32:05.291453+0000","last_undegraded":"2024-09-21T03:32:05.291453+0000","last_fullsized":"2024-09-21T03:32:05.291453+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288810+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:32:05.288810+0000","last_peered":"2024-09-21T03:32:05.288810+0000","last_clean":"2024-09-21T03:32:05.288810+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:32:05.288810+0000","last_undegraded":"2024-09-21T03:32:05.288810+0000","last_fullsized":"2024-09-21T03:32:05.288810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288544+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:32:05.288544+0000","last_peered":"2024-09-21T03:32:05.288544+0000","last_clean":"2024-09-21T03:32:05.288544+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:32:05.288544+0000","last_undegraded":"2024-09-21T03:32:05.288544+0000","last_fullsized":"2024-09-21T03:32:05.288544+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339877+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:32:05.339877+0000","last_peered":"2024-09-21T03:32:05.339877+0000","last_clean":"2024-09-21T03:32:05.339877+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:32:05.339877+0000","last_undegraded":"2024-09-21T03:32:05.339877+0000","last_fullsized":"2024-09-21T03:32:05.339877+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.297083+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:32:05.297083+0000","last_peered":"2024-09-21T03:32:05.297083+0000","last_clean":"2024-09-21T03:32:05.297083+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:32:05.297083+0000","last_undegraded":"2024-09-21T03:32:05.297083+0000","last_fullsized":"2024-09-21T03:32:05.297083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288719+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:32:05.288719+0000","last_peered":"2024-09-21T03:32:05.288719+0000","last_clean":"2024-09-21T03:32:05.288719+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:32:05.288719+0000","last_undegraded":"2024-09-21T03:32:05.288719+0000","last_fullsized":"2024-09-21T03:32:05.288719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288829+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:32:05.288829+0000","last_peered":"2024-09-21T03:32:05.288829+0000","last_clean":"2024-09-21T03:32:05.288829+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:32:05.288829+0000","last_undegraded":"2024-09-21T03:32:05.288829+0000","last_fullsized":"2024-09-21T03:32:05.288829+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287421+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:32:05.287421+0000","last_peered":"2024-09-21T03:32:05.287421+0000","last_clean":"2024-09-21T03:32:05.287421+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:32:05.287421+0000","last_undegraded":"2024-09-21T03:32:05.287421+0000","last_fullsized":"2024-09-21T03:32:05.287421+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285657+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:32:05.285657+0000","last_peered":"2024-09-21T03:32:05.285657+0000","last_clean":"2024-09-21T03:32:05.285657+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:32:05.285657+0000","last_undegraded":"2024-09-21T03:32:05.285657+0000","last_fullsized":"2024-09-21T03:32:05.285657+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292770+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:32:05.292770+0000","last_peered":"2024-09-21T03:32:05.292770+0000","last_clean":"2024-09-21T03:32:05.292770+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:32:05.292770+0000","last_undegraded":"2024-09-21T03:32:05.292770+0000","last_fullsized":"2024-09-21T03:32:05.292770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292473+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:32:05.292473+0000","last_peered":"2024-09-21T03:32:05.292473+0000","last_clean":"2024-09-21T03:32:05.292473+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:32:05.292473+0000","last_undegraded":"2024-09-21T03:32:05.292473+0000","last_fullsized":"2024-09-21T03:32:05.292473+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292725+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:32:05.292725+0000","last_peered":"2024-09-21T03:32:05.292725+0000","last_clean":"2024-09-21T03:32:05.292725+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:32:05.292725+0000","last_undegraded":"2024-09-21T03:32:05.292725+0000","last_fullsized":"2024-09-21T03:32:05.292725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291444+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:32:05.291444+0000","last_peered":"2024-09-21T03:32:05.291444+0000","last_clean":"2024-09-21T03:32:05.291444+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:32:05.291444+0000","last_undegraded":"2024-09-21T03:32:05.291444+0000","last_fullsized":"2024-09-21T03:32:05.291444+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295272+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:32:05.295272+0000","last_peered":"2024-09-21T03:32:05.295272+0000","last_clean":"2024-09-21T03:32:05.295272+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:32:05.295272+0000","last_undegraded":"2024-09-21T03:32:05.295272+0000","last_fullsized":"2024-09-21T03:32:05.295272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296095+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:32:05.296095+0000","last_peered":"2024-09-21T03:32:05.296095+0000","last_clean":"2024-09-21T03:32:05.296095+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:32:05.296095+0000","last_undegraded":"2024-09-21T03:32:05.296095+0000","last_fullsized":"2024-09-21T03:32:05.296095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295215+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:32:05.295215+0000","last_peered":"2024-09-21T03:32:05.295215+0000","last_clean":"2024-09-21T03:32:05.295215+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:32:05.295215+0000","last_undegraded":"2024-09-21T03:32:05.295215+0000","last_fullsized":"2024-09-21T03:32:05.295215+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285746+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:32:05.285746+0000","last_peered":"2024-09-21T03:32:05.285746+0000","last_clean":"2024-09-21T03:32:05.285746+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:32:05.285746+0000","last_undegraded":"2024-09-21T03:32:05.285746+0000","last_fullsized":"2024-09-21T03:32:05.285746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293373+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:32:05.293373+0000","last_peered":"2024-09-21T03:32:05.293373+0000","last_clean":"2024-09-21T03:32:05.293373+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:32:05.293373+0000","last_undegraded":"2024-09-21T03:32:05.293373+0000","last_fullsized":"2024-09-21T03:32:05.293373+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339934+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:32:05.339934+0000","last_peered":"2024-09-21T03:32:05.339934+0000","last_clean":"2024-09-21T03:32:05.339934+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:32:05.339934+0000","last_undegraded":"2024-09-21T03:32:05.339934+0000","last_fullsized":"2024-09-21T03:32:05.339934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288740+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:32:05.288740+0000","last_peered":"2024-09-21T03:32:05.288740+0000","last_clean":"2024-09-21T03:32:05.288740+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:32:05.288740+0000","last_undegraded":"2024-09-21T03:32:05.288740+0000","last_fullsized":"2024-09-21T03:32:05.288740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340183+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:32:05.340183+0000","last_peered":"2024-09-21T03:32:05.340183+0000","last_clean":"2024-09-21T03:32:05.340183+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:32:05.340183+0000","last_undegraded":"2024-09-21T03:32:05.340183+0000","last_fullsized":"2024-09-21T03:32:05.340183+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.296590+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:32:05.296590+0000","last_peered":"2024-09-21T03:32:05.296590+0000","last_clean":"2024-09-21T03:32:05.296590+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:32:05.296590+0000","last_undegraded":"2024-09-21T03:32:05.296590+0000","last_fullsized":"2024-09-21T03:32:05.296590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290760+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:32:05.290760+0000","last_peered":"2024-09-21T03:32:05.290760+0000","last_clean":"2024-09-21T03:32:05.290760+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:32:05.290760+0000","last_undegraded":"2024-09-21T03:32:05.290760+0000","last_fullsized":"2024-09-21T03:32:05.290760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285606+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:32:05.285606+0000","last_peered":"2024-09-21T03:32:05.285606+0000","last_clean":"2024-09-21T03:32:05.285606+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:32:05.285606+0000","last_undegraded":"2024-09-21T03:32:05.285606+0000","last_fullsized":"2024-09-21T03:32:05.285606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293810+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:32:05.293810+0000","last_peered":"2024-09-21T03:32:05.293810+0000","last_clean":"2024-09-21T03:32:05.293810+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:32:05.293810+0000","last_undegraded":"2024-09-21T03:32:05.293810+0000","last_fullsized":"2024-09-21T03:32:05.293810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294852+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:32:05.294852+0000","last_peered":"2024-09-21T03:32:05.294852+0000","last_clean":"2024-09-21T03:32:05.294852+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:32:05.294852+0000","last_undegraded":"2024-09-21T03:32:05.294852+0000","last_fullsized":"2024-09-21T03:32:05.294852+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294715+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:32:05.294715+0000","last_peered":"2024-09-21T03:32:05.294715+0000","last_clean":"2024-09-21T03:32:05.294715+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:32:05.294715+0000","last_undegraded":"2024-09-21T03:32:05.294715+0000","last_fullsized":"2024-09-21T03:32:05.294715+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290013+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:32:05.290013+0000","last_peered":"2024-09-21T03:32:05.290013+0000","last_clean":"2024-09-21T03:32:05.290013+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:32:05.290013+0000","last_undegraded":"2024-09-21T03:32:05.290013+0000","last_fullsized":"2024-09-21T03:32:05.290013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293290+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:32:05.293290+0000","last_peered":"2024-09-21T03:32:05.293290+0000","last_clean":"2024-09-21T03:32:05.293290+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:32:05.293290+0000","last_undegraded":"2024-09-21T03:32:05.293290+0000","last_fullsized":"2024-09-21T03:32:05.293290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"77'6","reported_seq":95,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:52.419161+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:32:52.419161+0000","last_peered":"2024-09-21T03:32:52.419161+0000","last_clean":"2024-09-21T03:32:52.419161+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:32:52.419161+0000","last_undegraded":"2024-09-21T03:32:52.419161+0000","last_fullsized":"2024-09-21T03:32:52.419161+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289356+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:32:05.289356+0000","last_peered":"2024-09-21T03:32:05.289356+0000","last_clean":"2024-09-21T03:32:05.289356+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:32:05.289356+0000","last_undegraded":"2024-09-21T03:32:05.289356+0000","last_fullsized":"2024-09-21T03:32:05.289356+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":37,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.304765+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:32:05.304765+0000","last_peered":"2024-09-21T03:32:05.304765+0000","last_clean":"2024-09-21T03:32:05.304765+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:32:05.304765+0000","last_undegraded":"2024-09-21T03:32:05.304765+0000","last_fullsized":"2024-09-21T03:32:05.304765+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285331+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:32:05.285331+0000","last_peered":"2024-09-21T03:32:05.285331+0000","last_clean":"2024-09-21T03:32:05.285331+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:32:05.285331+0000","last_undegraded":"2024-09-21T03:32:05.285331+0000","last_fullsized":"2024-09-21T03:32:05.285331+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.339935+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:32:05.339935+0000","last_peered":"2024-09-21T03:32:05.339935+0000","last_clean":"2024-09-21T03:32:05.339935+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:32:05.339935+0000","last_undegraded":"2024-09-21T03:32:05.339935+0000","last_fullsized":"2024-09-21T03:32:05.339935+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289031+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:32:05.289031+0000","last_peered":"2024-09-21T03:32:05.289031+0000","last_clean":"2024-09-21T03:32:05.289031+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:32:05.289031+0000","last_undegraded":"2024-09-21T03:32:05.289031+0000","last_fullsized":"2024-09-21T03:32:05.289031+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294188+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:32:05.294188+0000","last_peered":"2024-09-21T03:32:05.294188+0000","last_clean":"2024-09-21T03:32:05.294188+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:32:05.294188+0000","last_undegraded":"2024-09-21T03:32:05.294188+0000","last_fullsized":"2024-09-21T03:32:05.294188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"77'3","reported_seq":90,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:53.420040+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:32:53.420040+0000","last_peered":"2024-09-21T03:32:53.420040+0000","last_clean":"2024-09-21T03:32:53.420040+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:32:53.420040+0000","last_undegraded":"2024-09-21T03:32:53.420040+0000","last_fullsized":"2024-09-21T03:32:53.420040+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293409+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:32:05.293409+0000","last_peered":"2024-09-21T03:32:05.293409+0000","last_clean":"2024-09-21T03:32:05.293409+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:32:05.293409+0000","last_undegraded":"2024-09-21T03:32:05.293409+0000","last_fullsized":"2024-09-21T03:32:05.293409+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":36,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.299586+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:32:05.299586+0000","last_peered":"2024-09-21T03:32:05.299586+0000","last_clean":"2024-09-21T03:32:05.299586+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:32:05.299586+0000","last_undegraded":"2024-09-21T03:32:05.299586+0000","last_fullsized":"2024-09-21T03:32:05.299586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294332+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:32:05.294332+0000","last_peered":"2024-09-21T03:32:05.294332+0000","last_clean":"2024-09-21T03:32:05.294332+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:32:05.294332+0000","last_undegraded":"2024-09-21T03:32:05.294332+0000","last_fullsized":"2024-09-21T03:32:05.294332+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289196+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:32:05.289196+0000","last_peered":"2024-09-21T03:32:05.289196+0000","last_clean":"2024-09-21T03:32:05.289196+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:32:05.289196+0000","last_undegraded":"2024-09-21T03:32:05.289196+0000","last_fullsized":"2024-09-21T03:32:05.289196+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293032+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:32:05.293032+0000","last_peered":"2024-09-21T03:32:05.293032+0000","last_clean":"2024-09-21T03:32:05.293032+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:32:05.293032+0000","last_undegraded":"2024-09-21T03:32:05.293032+0000","last_fullsized":"2024-09-21T03:32:05.293032+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":188,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:54.421584+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:32:54.421584+0000","last_peered":"2024-09-21T03:32:54.421584+0000","last_clean":"2024-09-21T03:32:54.421584+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:32:54.421584+0000","last_undegraded":"2024-09-21T03:32:54.421584+0000","last_fullsized":"2024-09-21T03:32:54.421584+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292316+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:32:05.292316+0000","last_peered":"2024-09-21T03:32:05.292316+0000","last_clean":"2024-09-21T03:32:05.292316+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:32:05.292316+0000","last_undegraded":"2024-09-21T03:32:05.292316+0000","last_fullsized":"2024-09-21T03:32:05.292316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":30,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295294+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:32:05.295294+0000","last_peered":"2024-09-21T03:32:05.295294+0000","last_clean":"2024-09-21T03:32:05.295294+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:32:05.295294+0000","last_undegraded":"2024-09-21T03:32:05.295294+0000","last_fullsized":"2024-09-21T03:32:05.295294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295892+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:32:05.295892+0000","last_peered":"2024-09-21T03:32:05.295892+0000","last_clean":"2024-09-21T03:32:05.295892+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:32:05.295892+0000","last_undegraded":"2024-09-21T03:32:05.295892+0000","last_fullsized":"2024-09-21T03:32:05.295892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289088+0000","last_change":"2024-09-21T03:31:38.477864+0000","last_active":"2024-09-21T03:32:05.289088+0000","last_peered":"2024-09-21T03:32:05.289088+0000","last_clean":"2024-09-21T03:32:05.289088+0000","last_became_active":"2024-09-21T03:31:38.477416+0000","last_became_peered":"2024-09-21T03:31:38.477416+0000","last_unstale":"2024-09-21T03:32:05.289088+0000","last_undegraded":"2024-09-21T03:32:05.289088+0000","last_fullsized":"2024-09-21T03:32:05.289088+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:22:13.946916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294722+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:32:05.294722+0000","last_peered":"2024-09-21T03:32:05.294722+0000","last_clean":"2024-09-21T03:32:05.294722+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:32:05.294722+0000","last_undegraded":"2024-09-21T03:32:05.294722+0000","last_fullsized":"2024-09-21T03:32:05.294722+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"77'4","reported_seq":94,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:53.420072+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:32:53.420072+0000","last_peered":"2024-09-21T03:32:53.420072+0000","last_clean":"2024-09-21T03:32:53.420072+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:32:53.420072+0000","last_undegraded":"2024-09-21T03:32:53.420072+0000","last_fullsized":"2024-09-21T03:32:53.420072+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288760+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:32:05.288760+0000","last_peered":"2024-09-21T03:32:05.288760+0000","last_clean":"2024-09-21T03:32:05.288760+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:32:05.288760+0000","last_undegraded":"2024-09-21T03:32:05.288760+0000","last_fullsized":"2024-09-21T03:32:05.288760+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":64,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.315229+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:32:05.315229+0000","last_peered":"2024-09-21T03:32:05.315229+0000","last_clean":"2024-09-21T03:32:05.315229+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:32:05.315229+0000","last_undegraded":"2024-09-21T03:32:05.315229+0000","last_fullsized":"2024-09-21T03:32:05.315229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289284+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:32:05.289284+0000","last_peered":"2024-09-21T03:32:05.289284+0000","last_clean":"2024-09-21T03:32:05.289284+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:32:05.289284+0000","last_undegraded":"2024-09-21T03:32:05.289284+0000","last_fullsized":"2024-09-21T03:32:05.289284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293720+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:32:05.293720+0000","last_peered":"2024-09-21T03:32:05.293720+0000","last_clean":"2024-09-21T03:32:05.293720+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:32:05.293720+0000","last_undegraded":"2024-09-21T03:32:05.293720+0000","last_fullsized":"2024-09-21T03:32:05.293720+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290504+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:32:05.290504+0000","last_peered":"2024-09-21T03:32:05.290504+0000","last_clean":"2024-09-21T03:32:05.290504+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:32:05.290504+0000","last_undegraded":"2024-09-21T03:32:05.290504+0000","last_fullsized":"2024-09-21T03:32:05.290504+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285609+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:32:05.285609+0000","last_peered":"2024-09-21T03:32:05.285609+0000","last_clean":"2024-09-21T03:32:05.285609+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:32:05.285609+0000","last_undegraded":"2024-09-21T03:32:05.285609+0000","last_fullsized":"2024-09-21T03:32:05.285609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289290+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:32:05.289290+0000","last_peered":"2024-09-21T03:32:05.289290+0000","last_clean":"2024-09-21T03:32:05.289290+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:32:05.289290+0000","last_undegraded":"2024-09-21T03:32:05.289290+0000","last_fullsized":"2024-09-21T03:32:05.289290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289263+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:32:05.289263+0000","last_peered":"2024-09-21T03:32:05.289263+0000","last_clean":"2024-09-21T03:32:05.289263+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:32:05.289263+0000","last_undegraded":"2024-09-21T03:32:05.289263+0000","last_fullsized":"2024-09-21T03:32:05.289263+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288543+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:32:05.288543+0000","last_peered":"2024-09-21T03:32:05.288543+0000","last_clean":"2024-09-21T03:32:05.288543+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:32:05.288543+0000","last_undegraded":"2024-09-21T03:32:05.288543+0000","last_fullsized":"2024-09-21T03:32:05.288543+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295809+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:32:05.295809+0000","last_peered":"2024-09-21T03:32:05.295809+0000","last_clean":"2024-09-21T03:32:05.295809+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:32:05.295809+0000","last_undegraded":"2024-09-21T03:32:05.295809+0000","last_fullsized":"2024-09-21T03:32:05.295809+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288983+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:32:05.288983+0000","last_peered":"2024-09-21T03:32:05.288983+0000","last_clean":"2024-09-21T03:32:05.288983+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:32:05.288983+0000","last_undegraded":"2024-09-21T03:32:05.288983+0000","last_fullsized":"2024-09-21T03:32:05.288983+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":97,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289442+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:32:05.289442+0000","last_peered":"2024-09-21T03:32:05.289442+0000","last_clean":"2024-09-21T03:32:05.289442+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:32:05.289442+0000","last_undegraded":"2024-09-21T03:32:05.289442+0000","last_fullsized":"2024-09-21T03:32:05.289442+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287557+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:32:05.287557+0000","last_peered":"2024-09-21T03:32:05.287557+0000","last_clean":"2024-09-21T03:32:05.287557+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:32:05.287557+0000","last_undegraded":"2024-09-21T03:32:05.287557+0000","last_fullsized":"2024-09-21T03:32:05.287557+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340133+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:32:05.340133+0000","last_peered":"2024-09-21T03:32:05.340133+0000","last_clean":"2024-09-21T03:32:05.340133+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:32:05.340133+0000","last_undegraded":"2024-09-21T03:32:05.340133+0000","last_fullsized":"2024-09-21T03:32:05.340133+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289294+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:32:05.289294+0000","last_peered":"2024-09-21T03:32:05.289294+0000","last_clean":"2024-09-21T03:32:05.289294+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:32:05.289294+0000","last_undegraded":"2024-09-21T03:32:05.289294+0000","last_fullsized":"2024-09-21T03:32:05.289294+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285322+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:32:05.285322+0000","last_peered":"2024-09-21T03:32:05.285322+0000","last_clean":"2024-09-21T03:32:05.285322+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:32:05.285322+0000","last_undegraded":"2024-09-21T03:32:05.285322+0000","last_fullsized":"2024-09-21T03:32:05.285322+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"77'4","reported_seq":92,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:54.421017+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:32:54.421017+0000","last_peered":"2024-09-21T03:32:54.421017+0000","last_clean":"2024-09-21T03:32:54.421017+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:32:54.421017+0000","last_undegraded":"2024-09-21T03:32:54.421017+0000","last_fullsized":"2024-09-21T03:32:54.421017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288948+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:32:05.288948+0000","last_peered":"2024-09-21T03:32:05.288948+0000","last_clean":"2024-09-21T03:32:05.288948+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:32:05.288948+0000","last_undegraded":"2024-09-21T03:32:05.288948+0000","last_fullsized":"2024-09-21T03:32:05.288948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289312+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:32:05.289312+0000","last_peered":"2024-09-21T03:32:05.289312+0000","last_clean":"2024-09-21T03:32:05.289312+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:32:05.289312+0000","last_undegraded":"2024-09-21T03:32:05.289312+0000","last_fullsized":"2024-09-21T03:32:05.289312+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288164+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:32:05.288164+0000","last_peered":"2024-09-21T03:32:05.288164+0000","last_clean":"2024-09-21T03:32:05.288164+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:32:05.288164+0000","last_undegraded":"2024-09-21T03:32:05.288164+0000","last_fullsized":"2024-09-21T03:32:05.288164+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294004+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:32:05.294004+0000","last_peered":"2024-09-21T03:32:05.294004+0000","last_clean":"2024-09-21T03:32:05.294004+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:32:05.294004+0000","last_undegraded":"2024-09-21T03:32:05.294004+0000","last_fullsized":"2024-09-21T03:32:05.294004+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"77'1","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.288229+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:32:05.288229+0000","last_peered":"2024-09-21T03:32:05.288229+0000","last_clean":"2024-09-21T03:32:05.288229+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:32:05.288229+0000","last_undegraded":"2024-09-21T03:32:05.288229+0000","last_fullsized":"2024-09-21T03:32:05.288229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.300572+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:32:05.300572+0000","last_peered":"2024-09-21T03:32:05.300572+0000","last_clean":"2024-09-21T03:32:05.300572+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:32:05.300572+0000","last_undegraded":"2024-09-21T03:32:05.300572+0000","last_fullsized":"2024-09-21T03:32:05.300572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.285614+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:32:05.285614+0000","last_peered":"2024-09-21T03:32:05.285614+0000","last_clean":"2024-09-21T03:32:05.285614+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:32:05.285614+0000","last_undegraded":"2024-09-21T03:32:05.285614+0000","last_fullsized":"2024-09-21T03:32:05.285614+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'10","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:06.509242+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:32:06.509242+0000","last_peered":"2024-09-21T03:32:06.509242+0000","last_clean":"2024-09-21T03:32:06.509242+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:32:06.509242+0000","last_undegraded":"2024-09-21T03:32:06.509242+0000","last_fullsized":"2024-09-21T03:32:06.509242+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340238+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:32:05.340238+0000","last_peered":"2024-09-21T03:32:05.340238+0000","last_clean":"2024-09-21T03:32:05.340238+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:32:05.340238+0000","last_undegraded":"2024-09-21T03:32:05.340238+0000","last_fullsized":"2024-09-21T03:32:05.340238+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":27,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.287672+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:32:05.287672+0000","last_peered":"2024-09-21T03:32:05.287672+0000","last_clean":"2024-09-21T03:32:05.287672+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:32:05.287672+0000","last_undegraded":"2024-09-21T03:32:05.287672+0000","last_fullsized":"2024-09-21T03:32:05.287672+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.293740+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:32:05.293740+0000","last_peered":"2024-09-21T03:32:05.293740+0000","last_clean":"2024-09-21T03:32:05.293740+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:32:05.293740+0000","last_undegraded":"2024-09-21T03:32:05.293740+0000","last_fullsized":"2024-09-21T03:32:05.293740+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292939+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:32:05.292939+0000","last_peered":"2024-09-21T03:32:05.292939+0000","last_clean":"2024-09-21T03:32:05.292939+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:32:05.292939+0000","last_undegraded":"2024-09-21T03:32:05.292939+0000","last_fullsized":"2024-09-21T03:32:05.292939+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291782+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:32:05.291782+0000","last_peered":"2024-09-21T03:32:05.291782+0000","last_clean":"2024-09-21T03:32:05.291782+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:32:05.291782+0000","last_undegraded":"2024-09-21T03:32:05.291782+0000","last_fullsized":"2024-09-21T03:32:05.291782+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":26,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340090+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:32:05.340090+0000","last_peered":"2024-09-21T03:32:05.340090+0000","last_clean":"2024-09-21T03:32:05.340090+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:32:05.340090+0000","last_undegraded":"2024-09-21T03:32:05.340090+0000","last_fullsized":"2024-09-21T03:32:05.340090+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.290664+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:32:05.290664+0000","last_peered":"2024-09-21T03:32:05.290664+0000","last_clean":"2024-09-21T03:32:05.290664+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:32:05.290664+0000","last_undegraded":"2024-09-21T03:32:05.290664+0000","last_fullsized":"2024-09-21T03:32:05.290664+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":24,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294975+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:32:05.294975+0000","last_peered":"2024-09-21T03:32:05.294975+0000","last_clean":"2024-09-21T03:32:05.294975+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:32:05.294975+0000","last_undegraded":"2024-09-21T03:32:05.294975+0000","last_fullsized":"2024-09-21T03:32:05.294975+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340055+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:32:05.340055+0000","last_peered":"2024-09-21T03:32:05.340055+0000","last_clean":"2024-09-21T03:32:05.340055+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:32:05.340055+0000","last_undegraded":"2024-09-21T03:32:05.340055+0000","last_fullsized":"2024-09-21T03:32:05.340055+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291609+0000","last_change":"2024-09-21T03:31:38.474065+0000","last_active":"2024-09-21T03:32:05.291609+0000","last_peered":"2024-09-21T03:32:05.291609+0000","last_clean":"2024-09-21T03:32:05.291609+0000","last_became_active":"2024-09-21T03:31:38.473638+0000","last_became_peered":"2024-09-21T03:31:38.473638+0000","last_unstale":"2024-09-21T03:32:05.291609+0000","last_undegraded":"2024-09-21T03:32:05.291609+0000","last_fullsized":"2024-09-21T03:32:05.291609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:21.078976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.289094+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:32:05.289094+0000","last_peered":"2024-09-21T03:32:05.289094+0000","last_clean":"2024-09-21T03:32:05.289094+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:32:05.289094+0000","last_undegraded":"2024-09-21T03:32:05.289094+0000","last_fullsized":"2024-09-21T03:32:05.289094+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.295022+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:32:05.295022+0000","last_peered":"2024-09-21T03:32:05.295022+0000","last_clean":"2024-09-21T03:32:05.295022+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:32:05.295022+0000","last_undegraded":"2024-09-21T03:32:05.295022+0000","last_fullsized":"2024-09-21T03:32:05.295022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.291755+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:32:05.291755+0000","last_peered":"2024-09-21T03:32:05.291755+0000","last_clean":"2024-09-21T03:32:05.291755+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:32:05.291755+0000","last_undegraded":"2024-09-21T03:32:05.291755+0000","last_fullsized":"2024-09-21T03:32:05.291755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.292963+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:32:05.292963+0000","last_peered":"2024-09-21T03:32:05.292963+0000","last_clean":"2024-09-21T03:32:05.292963+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:32:05.292963+0000","last_undegraded":"2024-09-21T03:32:05.292963+0000","last_fullsized":"2024-09-21T03:32:05.292963+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":40,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.302766+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:32:05.302766+0000","last_peered":"2024-09-21T03:32:05.302766+0000","last_clean":"2024-09-21T03:32:05.302766+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:32:05.302766+0000","last_undegraded":"2024-09-21T03:32:05.302766+0000","last_fullsized":"2024-09-21T03:32:05.302766+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294229+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:32:05.294229+0000","last_peered":"2024-09-21T03:32:05.294229+0000","last_clean":"2024-09-21T03:32:05.294229+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:32:05.294229+0000","last_undegraded":"2024-09-21T03:32:05.294229+0000","last_fullsized":"2024-09-21T03:32:05.294229+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":25,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340409+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:32:05.340409+0000","last_peered":"2024-09-21T03:32:05.340409+0000","last_clean":"2024-09-21T03:32:05.340409+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:32:05.340409+0000","last_undegraded":"2024-09-21T03:32:05.340409+0000","last_fullsized":"2024-09-21T03:32:05.340409+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.340295+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:32:05.340295+0000","last_peered":"2024-09-21T03:32:05.340295+0000","last_clean":"2024-09-21T03:32:05.340295+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:32:05.340295+0000","last_undegraded":"2024-09-21T03:32:05.340295+0000","last_fullsized":"2024-09-21T03:32:05.340295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":33,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-21T03:32:05.294582+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:32:05.294582+0000","last_peered":"2024-09-21T03:32:05.294582+0000","last_clean":"2024-09-21T03:32:05.294582+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:32:05.294582+0000","last_undegraded":"2024-09-21T03:32:05.294582+0000","last_fullsized":"2024-09-21T03:32:05.294582+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":412,"num_read_kb":278,"num_write":162,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":204882,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678045,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":856064,"data_stored":424023,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874273,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":1079775,"data_compressed":43548,"data_compressed_allocated":57344,"data_compressed_original":614400,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037799,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":868352,"data_stored":424237,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201324,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":424135,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":917504,"data_stored":1016478,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561078,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":423626,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":929792,"data_stored":1015771,"data_compressed":41647,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":424566,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117061,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32040,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713112,"statfs":{"total":95995035648,"available":95962226688,"internally_reserved":0,"allocated":872448,"data_stored":423937,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378698,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":933888,"data_stored":488950,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509515,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":487321,"data_compressed":7664,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705748,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":876544,"data_stored":424897,"data_compressed":5763,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":63902,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65531,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":65871,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:32:59.764 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T03:32:59.764 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T03:32:59.764 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T03:32:59.764 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T03:32:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:59 smithi121 ceph-mon[34316]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:32:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:32:59 smithi121 ceph-mon[34316]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:00.010 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:00.380 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:00 smithi102 ceph-mon[31392]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 -- 172.21.15.102:0/910369595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b301083a0 msgr2=0x7f4b301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 --2- 172.21.15.102:0/910369595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b301083a0 0x7f4b301087b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009900 tx=0x7f4b2002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 -- 172.21.15.102:0/910369595 shutdown_connections 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 --2- 172.21.15.102:0/910369595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b301083a0 0x7f4b301087b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 --2- 172.21.15.102:0/910369595 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b30108cf0 0x7f4b3010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 --2- 172.21.15.102:0/910369595 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 0x7f4b30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 -- 172.21.15.102:0/910369595 >> 172.21.15.102:0/910369595 conn(0x7f4b30079760 msgr2=0x7f4b30079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:00.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 -- 172.21.15.102:0/910369595 shutdown_connections 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.614+0000 7f4b371d8640 1 -- 172.21.15.102:0/910369595 wait complete. 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 Processor -- start 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 -- start start 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 0x7f4b3019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b301083a0 0x7f4b3019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30113cb0 con 0x7f4b30108cf0 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30113b30 con 0x7f4b301083a0 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b371d8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4b30113e30 con 0x7f4b30102a60 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57008/0 (socket says 172.21.15.102:57008) 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 -- 172.21.15.102:0/2842554789 learned_addr learned my addr 172.21.15.102:0/2842554789 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:00.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b34f74640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 0x7f4b3019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b27fff640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b301083a0 0x7f4b3019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 -- 172.21.15.102:0/2842554789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 msgr2=0x7f4b3019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 0x7f4b3019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 -- 172.21.15.102:0/2842554789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b301083a0 msgr2=0x7f4b3019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b301083a0 0x7f4b3019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.615+0000 7f4b35775640 1 -- 172.21.15.102:0/2842554789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b301a0690 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b35775640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800b970 tx=0x7f4b2800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28019070 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4b2800cb40 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b301a0980 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b28007650 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.616+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b301a70e0 con 0x7f4b30108cf0 2024-09-21T03:33:00.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.617+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b30103ce0 con 0x7f4b30108cf0 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.618+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f4b2801c070 con 0x7f4b30108cf0 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.619+0000 7f4b25ffb640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 0x7f4b180b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.619+0000 7f4b34f74640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 0x7f4b180b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.619+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f4b280e6a60 con 0x7f4b30108cf0 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.620+0000 7f4b34f74640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 0x7f4b180b8b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006fd0 tx=0x7f4b2c0090e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.624+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b280b1470 con 0x7f4b30108cf0 2024-09-21T03:33:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:00 smithi148 ceph-mon[34651]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:00 smithi121 ceph-mon[34316]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:00.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.838+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4b3019b850 con 0x7f4b30108cf0 2024-09-21T03:33:00.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.839+0000 7f4b25ffb640 1 -- 172.21.15.102:0/2842554789 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4b280b63b0 con 0x7f4b30108cf0 2024-09-21T03:33:00.841 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:00.841 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.841+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 msgr2=0x7f4b180b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.841+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 0x7f4b180b8b80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c006fd0 tx=0x7f4b2c0090e0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.841+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 msgr2=0x7f4b3019ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.841+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800b970 tx=0x7f4b2800be30 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 shutdown_connections 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4b180b6670 0x7f4b180b8b80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b30108cf0 0x7f4b3019ff60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4b301083a0 0x7f4b3019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 --2- 172.21.15.102:0/2842554789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4b30102a60 0x7f4b3019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:00.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 >> 172.21.15.102:0/2842554789 conn(0x7f4b30079760 msgr2=0x7f4b301064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:00.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 shutdown_connections 2024-09-21T03:33:00.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:00.842+0000 7f4b371d8640 1 -- 172.21.15.102:0/2842554789 wait complete. 2024-09-21T03:33:01.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:01 smithi102 ceph-mon[31392]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:01.408 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:01 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2842554789' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:33:01.437 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T03:33:01.437 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:01.682 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:01 smithi148 ceph-mon[34651]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:01 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2842554789' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:33:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:01 smithi121 ceph-mon[34316]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:01 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2842554789' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/1102243277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc8108d20 msgr2=0x7fbfc810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/1102243277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc8108d20 0x7fbfc810f550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009ca0 tx=0x7fbfc002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/1102243277 shutdown_connections 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/1102243277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc8108d20 0x7fbfc810f550 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/1102243277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc81083d0 0x7fbfc81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/1102243277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8102ae0 0x7fbfc8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/1102243277 >> 172.21.15.102:0/1102243277 conn(0x7fbfc8079790 msgr2=0x7fbfc8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/1102243277 shutdown_connections 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.152+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/1102243277 wait complete. 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 Processor -- start 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 -- start start 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc8102ae0 0x7fbfc8199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8108d20 0x7fbfc819ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8112b00 con 0x7fbfc81083d0 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8112980 con 0x7fbfc8102ae0 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.153+0000 7fbfcf7b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc8112c80 con 0x7fbfc8108d20 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:02.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57032/0 (socket says 172.21.15.102:57032) 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 -- 172.21.15.102:0/4029580733 learned_addr learned my addr 172.21.15.102:0/4029580733 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfcd54c640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc8102ae0 0x7fbfc8199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 -- 172.21.15.102:0/4029580733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8108d20 msgr2=0x7fbfc819ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfcdd4d640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8108d20 0x7fbfc819ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8108d20 0x7fbfc819ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 -- 172.21.15.102:0/4029580733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc8102ae0 msgr2=0x7fbfc8199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc8102ae0 0x7fbfc8199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 -- 172.21.15.102:0/4029580733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc819f3c0 con 0x7fbfc81083d0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfccd4b640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400d740 tx=0x7fbfc400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc4017070 con 0x7fbfc81083d0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbfc400de50 con 0x7fbfc81083d0 2024-09-21T03:33:02.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc819f6b0 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc400f620 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.154+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc81a5e10 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.155+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc8102ef0 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.157+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7fbfc401a070 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.157+0000 7fbfba7fc640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 0x7fbfb40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.158+0000 7fbfcd54c640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 0x7fbfb40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.158+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7fbfc40e7050 con 0x7fbfc81083d0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.158+0000 7fbfcd54c640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 0x7fbfb40b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005fd0 tx=0x7fbfbc005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:02.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.161+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbfc40ad680 con 0x7fbfc81083d0 2024-09-21T03:33:02.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.378+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfc802e640 con 0x7fbfc81083d0 2024-09-21T03:33:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.379+0000 7fbfba7fc640 1 -- 172.21.15.102:0/4029580733 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7fbfc40b1a60 con 0x7fbfc81083d0 2024-09-21T03:33:02.381 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:02.381 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:33:02.381 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.381+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 msgr2=0x7fbfb40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.381+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 0x7fbfb40b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc005fd0 tx=0x7fbfbc005850 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 msgr2=0x7fbfc81999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbfc400d740 tx=0x7fbfc400dc00 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 shutdown_connections 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbfb40b65f0 0x7fbfb40b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbfc81083d0 0x7fbfc81999f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbfc8108d20 0x7fbfc819ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 --2- 172.21.15.102:0/4029580733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfc8102ae0 0x7fbfc8199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 >> 172.21.15.102:0/4029580733 conn(0x7fbfc8079790 msgr2=0x7fbfc8104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 shutdown_connections 2024-09-21T03:33:02.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:02.382+0000 7fbfcf7b0640 1 -- 172.21.15.102:0/4029580733 wait complete. 2024-09-21T03:33:03.078 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:03.325 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:03.432 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:03 smithi102 ceph-mon[31392]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:03.432 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:03 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4029580733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:03 smithi148 ceph-mon[34651]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:03 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4029580733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:03 smithi121 ceph-mon[34316]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:03 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4029580733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 -- 172.21.15.102:0/1147962332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 msgr2=0x7f288c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 --2- 172.21.15.102:0/1147962332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c1098b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2880009900 tx=0x7f288002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 -- 172.21.15.102:0/1147962332 shutdown_connections 2024-09-21T03:33:03.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 --2- 172.21.15.102:0/1147962332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c1098b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 --2- 172.21.15.102:0/1147962332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c109df0 0x7f288c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 --2- 172.21.15.102:0/1147962332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f288c103b60 0x7f288c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 -- 172.21.15.102:0/1147962332 >> 172.21.15.102:0/1147962332 conn(0x7f288c07b850 msgr2=0x7f288c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 -- 172.21.15.102:0/1147962332 shutdown_connections 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.771+0000 7f289285c640 1 -- 172.21.15.102:0/1147962332 wait complete. 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.772+0000 7f289285c640 1 Processor -- start 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.772+0000 7f289285c640 1 -- start start 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c103b60 0x7f288c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f288c109df0 0x7f288c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f288c113c30 con 0x7f288c1094a0 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f288c113ab0 con 0x7f288c109df0 2024-09-21T03:33:03.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f288c113db0 con 0x7f288c103b60 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57058/0 (socket says 172.21.15.102:57058) 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 -- 172.21.15.102:0/868747063 learned_addr learned my addr 172.21.15.102:0/868747063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288bfff640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c103b60 0x7f288c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 -- 172.21.15.102:0/868747063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c103b60 msgr2=0x7f288c19a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c103b60 0x7f288c19a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 -- 172.21.15.102:0/868747063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f288c109df0 msgr2=0x7f288c19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f288c109df0 0x7f288c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 -- 172.21.15.102:0/868747063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c1a0550 con 0x7f288c1094a0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f288b7fe640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2880005940 tx=0x7f2880004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288003f030 con 0x7f288c1094a0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2880003cd0 con 0x7f288c1094a0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288c1a07e0 con 0x7f288c1094a0 2024-09-21T03:33:03.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880035070 con 0x7f288c1094a0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.773+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f288c1a6fa0 con 0x7f288c1094a0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.774+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f288c103f70 con 0x7f288c1094a0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.776+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f2880042030 con 0x7f288c1094a0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.777+0000 7f28897fa640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.777+0000 7f288bfff640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.777+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8484+0+0 (secure 0 0 0) 0x7f2880108010 con 0x7f288c1094a0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.777+0000 7f288bfff640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 0x7f28740b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f287c009890 tx=0x7f287c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:03.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.780+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28800ce640 con 0x7f288c1094a0 2024-09-21T03:33:03.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.995+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f288c19b710 con 0x7f288c1094a0 2024-09-21T03:33:03.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.995+0000 7f28897fa640 1 -- 172.21.15.102:0/868747063 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7f288c19b710 con 0x7f288c1094a0 2024-09-21T03:33:03.997 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:03.998 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:33:03.998 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:03.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.997+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 msgr2=0x7f28740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:03.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.997+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 0x7f28740b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f287c009890 tx=0x7f287c008040 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.997+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 msgr2=0x7f288c19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.997+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2880005940 tx=0x7f2880004360 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.997+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 shutdown_connections 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f28740b65f0 0x7f28740b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f288c1094a0 0x7f288c19ab80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f288c109df0 0x7f288c19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 --2- 172.21.15.102:0/868747063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f288c103b60 0x7f288c19a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 >> 172.21.15.102:0/868747063 conn(0x7f288c07b850 msgr2=0x7f288c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 shutdown_connections 2024-09-21T03:33:04.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:03.998+0000 7f289285c640 1 -- 172.21.15.102:0/868747063 wait complete. 2024-09-21T03:33:04.691 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:04 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/868747063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:04.691 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]} : dispatch 2024-09-21T03:33:04.692 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2024-09-21T03:33:04.718 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:33:04.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:04 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/868747063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]} : dispatch 2024-09-21T03:33:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2024-09-21T03:33:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:04 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/868747063' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]} : dispatch 2024-09-21T03:33:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]} : dispatch 2024-09-21T03:33:04.961 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:05.332 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:05 smithi102 ceph-mon[31392]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:05.332 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-21T03:33:05.332 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2024-09-21T03:33:05.332 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:05 smithi102 ceph-mon[31392]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- 172.21.15.102:0/2630789635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c04104a60 msgr2=0x7f2c04104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/2630789635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c04104a60 0x7f2c04104e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009900 tx=0x7f2bf402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- 172.21.15.102:0/2630789635 shutdown_connections 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/2630789635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0410dec0 0x7f2c041103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/2630789635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c041053b0 0x7f2c0410d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/2630789635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c04104a60 0x7f2c04104e70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- 172.21.15.102:0/2630789635 >> 172.21.15.102:0/2630789635 conn(0x7f2c040796d0 msgr2=0x7f2c04079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:05.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- 172.21.15.102:0/2630789635 shutdown_connections 2024-09-21T03:33:05.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- 172.21.15.102:0/2630789635 wait complete. 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 Processor -- start 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.416+0000 7f2c0aed7640 1 -- start start 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04104a60 0x7f2c0419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0410dec0 0x7f2c0419ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04113d40 con 0x7f2c041053b0 2024-09-21T03:33:05.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04113bc0 con 0x7f2c04104a60 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c0aed7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c04113ec0 con 0x7f2c0410dec0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59320/0 (socket says 172.21.15.102:59320) 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 -- 172.21.15.102:0/1533872413 learned_addr learned my addr 172.21.15.102:0/1533872413 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 -- 172.21.15.102:0/1533872413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0410dec0 msgr2=0x7f2c0419ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0410dec0 0x7f2c0419ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c08c73640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04104a60 0x7f2c0419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 -- 172.21.15.102:0/1533872413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04104a60 msgr2=0x7f2c0419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04104a60 0x7f2c0419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 -- 172.21.15.102:0/1533872413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c041a0640 con 0x7f2c041053b0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c03fff640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006fd0 tx=0x7f2bf800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.417+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8011830 con 0x7f2c041053b0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.418+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2bf8016070 con 0x7f2c041053b0 2024-09-21T03:33:05.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.418+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c041a0930 con 0x7f2c041053b0 2024-09-21T03:33:05.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.418+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf800f2e0 con 0x7f2c041053b0 2024-09-21T03:33:05.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.418+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c041a7090 con 0x7f2c041053b0 2024-09-21T03:33:05.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.419+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c04104e70 con 0x7f2c041053b0 2024-09-21T03:33:05.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.420+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f2bf80119d0 con 0x7f2c041053b0 2024-09-21T03:33:05.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.421+0000 7f2c01ffb640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 0x7f2bec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:05.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.421+0000 7f2c08c73640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 0x7f2bec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:05.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.421+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2bf80e6cf0 con 0x7f2c041053b0 2024-09-21T03:33:05.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.422+0000 7f2c08c73640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 0x7f2bec0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005f70 tx=0x7f2bf4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:05.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.426+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bf80ad2f0 con 0x7f2c041053b0 2024-09-21T03:33:05.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.609+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c041a7430 con 0x7f2c041053b0 2024-09-21T03:33:05.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.610+0000 7f2c01ffb640 1 -- 172.21.15.102:0/1533872413 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23292 (secure 0 0 0) 0x7f2bf80b16d0 con 0x7f2c041053b0 2024-09-21T03:33:05.612 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:05.613 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":81,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:33:05.309127+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 msgr2=0x7f2bec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 0x7f2bec0b8b00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005f70 tx=0x7f2bf4000bc0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 msgr2=0x7f2c0419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006fd0 tx=0x7f2bf800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 shutdown_connections 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bec0b65f0 0x7f2bec0b8b00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c041053b0 0x7f2c0419ac70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0410dec0 0x7f2c0419ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 --2- 172.21.15.102:0/1533872413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c04104a60 0x7f2c0419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:05.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 >> 172.21.15.102:0/1533872413 conn(0x7f2c040796d0 msgr2=0x7f2c040ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:05.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.612+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 shutdown_connections 2024-09-21T03:33:05.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:05.613+0000 7f2c0aed7640 1 -- 172.21.15.102:0/1533872413 wait complete. 2024-09-21T03:33:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:05 smithi148 ceph-mon[34651]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-21T03:33:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2024-09-21T03:33:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:05 smithi148 ceph-mon[34651]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:33:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:05 smithi121 ceph-mon[34316]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 4]}]': finished 2024-09-21T03:33:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [5, 11]}]': finished 2024-09-21T03:33:05.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:05 smithi121 ceph-mon[34316]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T03:33:06.342 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:06 smithi102 ceph-mon[31392]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:33:06.342 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:06 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1533872413' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:06.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:06.589 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:06 smithi148 ceph-mon[34651]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:33:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:06 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1533872413' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:06.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:06 smithi121 ceph-mon[34316]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T03:33:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:06 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1533872413' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:07.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 -- 172.21.15.102:0/2450940044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec108d10 msgr2=0x7f1bec10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2450940044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec108d10 0x7f1bec10f540 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1be4009ca0 tx=0x7f1be402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 -- 172.21.15.102:0/2450940044 shutdown_connections 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2450940044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec108d10 0x7f1bec10f540 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2450940044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec1083c0 0x7f1bec1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2450940044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec102a80 0x7f1bec102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 -- 172.21.15.102:0/2450940044 >> 172.21.15.102:0/2450940044 conn(0x7f1bec079740 msgr2=0x7f1bec079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 -- 172.21.15.102:0/2450940044 shutdown_connections 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 -- 172.21.15.102:0/2450940044 wait complete. 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.044+0000 7f1bf2395640 1 Processor -- start 2024-09-21T03:33:07.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 -- start start 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec102a80 0x7f1bec19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec108d10 0x7f1bec19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112b20 con 0x7f1bec1083c0 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec1129a0 con 0x7f1bec102a80 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf2395640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec112ca0 con 0x7f1bec108d10 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1beb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59330/0 (socket says 172.21.15.102:59330) 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1beb7fe640 1 -- 172.21.15.102:0/2300547042 learned_addr learned my addr 172.21.15.102:0/2300547042 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bebfff640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec102a80 0x7f1bec19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.045+0000 7f1bf0932640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec108d10 0x7f1bec19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 -- 172.21.15.102:0/2300547042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec108d10 msgr2=0x7f1bec19bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:07.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec108d10 0x7f1bec19bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 -- 172.21.15.102:0/2300547042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec102a80 msgr2=0x7f1bec19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec102a80 0x7f1bec19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 -- 172.21.15.102:0/2300547042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec1a6570 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1beb7fe640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1be000b450 tx=0x7f1be000b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0015020 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec1a6860 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1be0011d00 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be000f2e0 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.046+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec1a6e70 con 0x7f1bec1083c0 2024-09-21T03:33:07.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.047+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec103d00 con 0x7f1bec1083c0 2024-09-21T03:33:07.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.048+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 21) ==== 154581+0+0 (secure 0 0 0) 0x7f1be0018020 con 0x7f1bec1083c0 2024-09-21T03:33:07.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.049+0000 7f1be97fa640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 0x7f1bd40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:07.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.049+0000 7f1bebfff640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 0x7f1bd40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:07.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.049+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f1be00e7120 con 0x7f1bec1083c0 2024-09-21T03:33:07.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.050+0000 7f1bebfff640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 0x7f1bd40b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06c6a0 tx=0x7f1bdc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:07.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.052+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1be001f020 con 0x7f1bec1083c0 2024-09-21T03:33:07.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.267+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bec102e90 con 0x7f1bec1083c0 2024-09-21T03:33:07.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.267+0000 7f1be97fa640 1 -- 172.21.15.102:0/2300547042 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7f1bec102e90 con 0x7f1bec1083c0 2024-09-21T03:33:07.270 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:07.270 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:33:07.270 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.269+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 msgr2=0x7f1bd40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.269+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 0x7f1bd40b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1bec06c6a0 tx=0x7f1bdc00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.269+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 msgr2=0x7f1bec19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.269+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1be000b450 tx=0x7f1be000b850 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 shutdown_connections 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1bd40b6620 0x7f1bd40b8b30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1bec1083c0 0x7f1bec19b8b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1bec108d10 0x7f1bec19bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 --2- 172.21.15.102:0/2300547042 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1bec102a80 0x7f1bec19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 >> 172.21.15.102:0/2300547042 conn(0x7f1bec079740 msgr2=0x7f1bec105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 shutdown_connections 2024-09-21T03:33:07.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:07.270+0000 7f1bf2395640 1 -- 172.21.15.102:0/2300547042 wait complete. 2024-09-21T03:33:07.586 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:07 smithi102 ceph-mon[31392]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-21T03:33:07.586 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:07 smithi102 ceph-mon[31392]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T03:33:07.586 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:07 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2300547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:07 smithi148 ceph-mon[34651]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-21T03:33:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:07 smithi148 ceph-mon[34651]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T03:33:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:07 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2300547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:07 smithi121 ceph-mon[34316]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 639 B/s wr, 7 op/s 2024-09-21T03:33:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:07 smithi121 ceph-mon[34316]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T03:33:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:07 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2300547042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:07.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:31:41.100708+0000', 'modified': '2024-09-21T03:31:53.013907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24661, 'mds_1': 24659, 'mds_2': 24637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24611': {'gid': 24611, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/2193609869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2193609869}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2193609869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.148:6835/4203175374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 4203175374}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 4203175374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24632': {'gid': 24632, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/3016052537', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 3016052537}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 3016052537}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.148:6837/1009058837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6836', 'nonce': 1009058837}, {'type': 'v1', 'addr': '172.21.15.148:6837', 'nonce': 1009058837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6839/891322364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 891322364}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 891322364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24661': {'gid': 24661, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.148:6839/3369184447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6838', 'nonce': 3369184447}, {'type': 'v1', 'addr': '172.21.15.148:6839', 'nonce': 3369184447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24661, 'qdb_cluster': [24637, 24659, 24661]} 2024-09-21T03:33:07.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:33:07.951 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T03:33:08.194 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:08.574 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:08 smithi102 ceph-mon[31392]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T03:33:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:08 smithi148 ceph-mon[34651]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T03:33:08.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:08 smithi121 ceph-mon[34316]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T03:33:08.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 -- 172.21.15.102:0/498819983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3441094a0 msgr2=0x7fa3441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 --2- 172.21.15.102:0/498819983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3441094a0 0x7fa3441098b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa334009ca0 tx=0x7fa33402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 -- 172.21.15.102:0/498819983 shutdown_connections 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 --2- 172.21.15.102:0/498819983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa3441094a0 0x7fa3441098b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 --2- 172.21.15.102:0/498819983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa344109df0 0x7fa344110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 --2- 172.21.15.102:0/498819983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa344103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 -- 172.21.15.102:0/498819983 >> 172.21.15.102:0/498819983 conn(0x7fa34407b850 msgr2=0x7fa34407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 -- 172.21.15.102:0/498819983 shutdown_connections 2024-09-21T03:33:08.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.815+0000 7fa34b010640 1 -- 172.21.15.102:0/498819983 wait complete. 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.816+0000 7fa34b010640 1 Processor -- start 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.816+0000 7fa34b010640 1 -- start start 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa34419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3441094a0 0x7fa34419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa344113bd0 con 0x7fa344109df0 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa344113a50 con 0x7fa3441094a0 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa344113d50 con 0x7fa344103b60 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59354/0 (socket says 172.21.15.102:59354) 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 -- 172.21.15.102:0/3040799861 learned_addr learned my addr 172.21.15.102:0/3040799861 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:08.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa348dac640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa34419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa343fff640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3441094a0 0x7fa34419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 -- 172.21.15.102:0/3040799861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 msgr2=0x7fa34419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa34419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 -- 172.21.15.102:0/3040799861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3441094a0 msgr2=0x7fa34419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3441094a0 0x7fa34419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 -- 172.21.15.102:0/3040799861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3441a05b0 con 0x7fa344109df0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa348dac640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa34419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa3495ad640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00d950 tx=0x7fa33c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa341ffb640 1 -- 172.21.15.102:0/3040799861 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c017030 con 0x7fa344109df0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3441a08a0 con 0x7fa344109df0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa341ffb640 1 -- 172.21.15.102:0/3040799861 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa33c004020 con 0x7fa344109df0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.817+0000 7fa341ffb640 1 -- 172.21.15.102:0/3040799861 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c003bc0 con 0x7fa344109df0 2024-09-21T03:33:08.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.818+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3441a7000 con 0x7fa344109df0 2024-09-21T03:33:08.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.820+0000 7fa341ffb640 1 -- 172.21.15.102:0/3040799861 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fa33c01a070 con 0x7fa344109df0 2024-09-21T03:33:08.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.820+0000 7fa351584740 1 Processor -- start 2024-09-21T03:33:08.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.820+0000 7fa351584740 1 -- start start 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce0700a0 0x5627ce43f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce43f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5627ce3b6c10 con 0x5627ce098f60 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5627ce3a6040 con 0x5627ce078280 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa351584740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5627ce3a9e50 con 0x5627ce0700a0 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59366/0 (socket says 172.21.15.102:59366) 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 -- 172.21.15.102:0/837583757 learned_addr learned my addr 172.21.15.102:0/837583757 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa348dac640 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce0700a0 0x5627ce43f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 -- 172.21.15.102:0/837583757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce0700a0 msgr2=0x5627ce43f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce0700a0 0x5627ce43f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 -- 172.21.15.102:0/837583757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 msgr2=0x5627ce43f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce43f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 -- 172.21.15.102:0/837583757 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ce104540 con 0x5627ce098f60 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa341ffb640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 0x7fa3300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa348dac640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 0x7fa3300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.821+0000 7fa343fff640 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa34406c9f0 tx=0x7fa3340098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66958aee2d53a444 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa341ffb640 1 -- 172.21.15.102:0/3040799861 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa33c0e6cd0 con 0x7fa344109df0 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa33affd640 1 -- 172.21.15.102:0/837583757 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa334042070 con 0x5627ce098f60 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa33affd640 1 -- 172.21.15.102:0/837583757 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa334036040 con 0x5627ce098f60 2024-09-21T03:33:08.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa33affd640 1 -- 172.21.15.102:0/837583757 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa334004030 con 0x5627ce098f60 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa351584740 1 -- 172.21.15.102:0/837583757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 msgr2=0x5627ce43ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa348dac640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 0x7fa3300b8a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5627ce43db80 tx=0x7fa32c00b6f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.822+0000 7fa351584740 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa34406c9f0 tx=0x7fa3340098b0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 -- 172.21.15.102:0/837583757 shutdown_connections 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce43f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce0700a0 0x5627ce43f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 --2- 172.21.15.102:0/837583757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce43ef00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 -- 172.21.15.102:0/837583757 >> 172.21.15.102:0/837583757 conn(0x5627ce08d350 msgr2=0x5627ce43cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 -- 172.21.15.102:0/837583757 shutdown_connections 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 -- 172.21.15.102:0/837583757 wait complete. 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 -- start start 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.823+0000 7fa351584740 1 Processor -- start 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce4569d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5627ce2075f0 con 0x5627ce0700a0 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5627ce341010 con 0x5627ce078280 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5627ce44d680 con 0x5627ce098f60 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa351584740 10 client.0 _ll_register_callbacks cb 0x5627ce3a0340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59370/0 (socket says 172.21.15.102:59370) 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 -- 172.21.15.102:0/2280844044 learned_addr learned my addr 172.21.15.102:0/2280844044 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa3495ad640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce4569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa343fff640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 -- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 msgr2=0x5627ce4569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce4569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 -- 172.21.15.102:0/2280844044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 msgr2=0x5627ce44afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.824+0000 7fa348dac640 1 -- 172.21.15.102:0/2280844044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ce36ea00 con 0x5627ce0700a0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa348dac640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa32c012720 tx=0x7fa32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836aaffb14e6a1e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00f9a0 con 0x5627ce0700a0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa32c00fb40 con 0x5627ce0700a0 2024-09-21T03:33:08.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa334036040 con 0x5627ce0700a0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa32c00fd40 con 0x5627ce0700a0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa351584740 10 client.15234 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5627ce4596d0 con 0x5627ce0700a0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa334036040 con 0x5627ce0700a0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fa32c02f580 con 0x5627ce0700a0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa351584740 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.825+0000 7fa351584740 10 client.15234 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa351584740 20 client.15234 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce0578e0 0x5627ce45d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa351584740 4 client.15234 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627ce3b8b60 con 0x5627ce0578e0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa343fff640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce0578e0 0x5627ce45d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa323fff640 10 client.15234 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:08.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.826+0000 7fa343fff640 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce0578e0 0x5627ce45d170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e33e8d9b328efb09 server_cookie=5a190424d85c081 in_seq=0 out_seq=0 2024-09-21T03:33:08.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa323fff640 1 -- 172.21.15.102:0/2280844044 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627ce3b8b60 con 0x5627ce0578e0 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa323fff640 10 client.15234 handle_command_reply: tid=0 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 client.15234 shutdown 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 msgr2=0x5627ce44aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa32c012720 tx=0x7fa32c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 shutdown_connections 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce0578e0 0x5627ce45d170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce4569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 --2- 172.21.15.102:0/2280844044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aaa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 >> 172.21.15.102:0/2280844044 conn(0x5627ce08d350 msgr2=0x5627ce4420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.827+0000 7fa323fff640 0 client.15234 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.828+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 shutdown_connections 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.828+0000 7fa351584740 1 -- 172.21.15.102:0/2280844044 wait complete. 2024-09-21T03:33:08.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.828+0000 7fa351584740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T03:33:08.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 Processor -- start 2024-09-21T03:33:08.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 -- start start 2024-09-21T03:33:08.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce465840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45b4b0 con 0x5627ce0700a0 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45bb80 con 0x5627ce078280 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa351584740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45c250 con 0x5627ce098f60 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59382/0 (socket says 172.21.15.102:59382) 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 -- 172.21.15.102:0/3170601938 learned_addr learned my addr 172.21.15.102:0/3170601938 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 -- 172.21.15.102:0/3170601938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 msgr2=0x5627ce465840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce465840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 -- 172.21.15.102:0/3170601938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 msgr2=0x5627ce44afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 -- 172.21.15.102:0/3170601938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627ce4411f0 con 0x5627ce0700a0 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa348dac640 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa32c000c00 tx=0x7fa32c02fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9367e426c5f51e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa33a7fc640 1 -- 172.21.15.102:0/3170601938 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c034070 con 0x5627ce0700a0 2024-09-21T03:33:08.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa33a7fc640 1 -- 172.21.15.102:0/3170601938 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa32c035040 con 0x5627ce0700a0 2024-09-21T03:33:08.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.846+0000 7fa33a7fc640 1 -- 172.21.15.102:0/3170601938 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0052a0 con 0x5627ce0700a0 2024-09-21T03:33:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 -- 172.21.15.102:0/3170601938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 msgr2=0x5627ce44aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa32c000c00 tx=0x7fa32c02fda0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 -- 172.21.15.102:0/3170601938 shutdown_connections 2024-09-21T03:33:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce098f60 0x5627ce465840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce078280 0x5627ce44afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 --2- 172.21.15.102:0/3170601938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce0700a0 0x5627ce44aa80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 -- 172.21.15.102:0/3170601938 >> 172.21.15.102:0/3170601938 conn(0x5627ce08d350 msgr2=0x5627ce456b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 -- 172.21.15.102:0/3170601938 shutdown_connections 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.847+0000 7fa351584740 1 -- 172.21.15.102:0/3170601938 wait complete. 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 -- start start 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 Processor -- start 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce0700a0 0x5627ce4633c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce078280 0x5627ce463900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45cff0 con 0x5627ce098f60 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45c920 con 0x5627ce0700a0 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5627ce45d6c0 con 0x5627ce078280 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa351584740 10 client.0 _ll_register_callbacks cb 0x7fa32c00b9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:08.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa3495ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa3495ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59386/0 (socket says 172.21.15.102:59386) 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa3495ad640 1 -- 172.21.15.102:0/245366039 learned_addr learned my addr 172.21.15.102:0/245366039 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.848+0000 7fa348dac640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce0700a0 0x5627ce4633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa343fff640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce078280 0x5627ce463900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 -- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce078280 msgr2=0x5627ce463900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce078280 0x5627ce463900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 -- 172.21.15.102:0/245366039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce0700a0 msgr2=0x5627ce4633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce0700a0 0x5627ce4633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 -- 172.21.15.102:0/245366039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627ce4cb670 con 0x5627ce098f60 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa3495ad640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0a9300 tx=0x7fa33c0ac7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2df29c327105fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa323fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0ad430 con 0x5627ce098f60 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa33c0041d0 con 0x5627ce098f60 2024-09-21T03:33:08.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa32c035040 con 0x5627ce098f60 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa33c0b1810 con 0x5627ce098f60 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa351584740 10 client.15240 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5627ce4cc8e0 con 0x5627ce098f60 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.849+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa33c098020 con 0x5627ce098f60 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fa33c0e4b60 con 0x5627ce098f60 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 10 client.15240 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 10 client.15240 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 20 client.15240 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce02cc90 0x5627ce4d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 4 client.15240 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "status"}) -- 0x5627ce3b4610 con 0x5627ce02cc90 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.850+0000 7fa348dac640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce02cc90 0x5627ce4d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa323fff640 10 client.15240 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa348dac640 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce02cc90 0x5627ce4d01b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e4f86d294fb6326 server_cookie=e6aab72009120dfe in_seq=0 out_seq=0 2024-09-21T03:33:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa323fff640 1 -- 172.21.15.102:0/245366039 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5627ce3b4610 con 0x5627ce02cc90 2024-09-21T03:33:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa323fff640 10 client.15240 handle_command_reply: tid=0 2024-09-21T03:33:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 client.15240 shutdown 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 msgr2=0x5627ce463e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0a9300 tx=0x7fa33c0ac7b0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 shutdown_connections 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5627ce02cc90 0x5627ce4d01b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5627ce098f60 0x5627ce463e40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5627ce078280 0x5627ce463900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 --2- 172.21.15.102:0/245366039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5627ce0700a0 0x5627ce4633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 >> 172.21.15.102:0/245366039 conn(0x5627ce08d350 msgr2=0x5627ce456b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa323fff640 0 client.15240 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 shutdown_connections 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 1 -- 172.21.15.102:0/245366039 wait complete. 2024-09-21T03:33:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.851+0000 7fa351584740 20 client.15240 trim_cache size 0 max 16384 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 2, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24637, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 78.542674742000003, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 112.44917006599999 2024-09-21T03:33:08.858 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 msgr2=0x7fa3300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 0x7fa3300b8a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x5627ce43db80 tx=0x7fa32c00b6f0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 msgr2=0x7fa34419fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa33c00d950 tx=0x7fa33c00de10 comp rx=0 tx=0).stop 2024-09-21T03:33:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 shutdown_connections 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa3300b6560 0x7fa3300b8a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa344109df0 0x7fa34419fe80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa3441094a0 0x7fa34419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 --2- 172.21.15.102:0/3040799861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa344103b60 0x7fa34419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 >> 172.21.15.102:0/3040799861 conn(0x7fa34407b850 msgr2=0x7fa3441075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 shutdown_connections 2024-09-21T03:33:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:08.852+0000 7fa34b010640 1 -- 172.21.15.102:0/3040799861 wait complete. 2024-09-21T03:33:09.568 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:33:09.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:09 smithi102 ceph-mon[31392]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:09 smithi148 ceph-mon[34651]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:09 smithi121 ceph-mon[34316]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:09.812 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 -- 172.21.15.102:0/3689301463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a0102a60 msgr2=0x7fc2a0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 --2- 172.21.15.102:0/3689301463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a0102a60 0x7fc2a0102e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc290009900 tx=0x7fc29002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 -- 172.21.15.102:0/3689301463 shutdown_connections 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 --2- 172.21.15.102:0/3689301463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 --2- 172.21.15.102:0/3689301463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a01083a0 0x7fc2a01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 --2- 172.21.15.102:0/3689301463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a0102a60 0x7fc2a0102e70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 -- 172.21.15.102:0/3689301463 >> 172.21.15.102:0/3689301463 conn(0x7fc2a0079730 msgr2=0x7fc2a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 -- 172.21.15.102:0/3689301463 shutdown_connections 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.319+0000 7fc2a5378640 1 -- 172.21.15.102:0/3689301463 wait complete. 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 Processor -- start 2024-09-21T03:33:10.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 -- start start 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 0x7fc2a019b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a019bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0112b80 con 0x7fc2a01083a0 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0112a00 con 0x7fc2a0108cf0 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc2a5378640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0112d00 con 0x7fc2a0102a60 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59396/0 (socket says 172.21.15.102:59396) 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc29e7fc640 1 -- 172.21.15.102:0/2634062248 learned_addr learned my addr 172.21.15.102:0/2634062248 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.320+0000 7fc29effd640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 0x7fc2a019b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 -- 172.21.15.102:0/2634062248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 msgr2=0x7fc2a019b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a019bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 0x7fc2a019b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 -- 172.21.15.102:0/2634062248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 msgr2=0x7fc2a019bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a019bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 -- 172.21.15.102:0/2634062248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a01a6720 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29effd640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 0x7fc2a019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc29400b450 tx=0x7fc29400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc287fff640 1 -- 172.21.15.102:0/2634062248 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc294015020 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a01a6a10 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc287fff640 1 -- 172.21.15.102:0/2634062248 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc294011d60 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc287fff640 1 -- 172.21.15.102:0/2634062248 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29400f340 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.321+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01a6fd0 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc287fff640 1 -- 172.21.15.102:0/2634062248 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fc294018020 con 0x7fc2a01083a0 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 Processor -- start 2024-09-21T03:33:10.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 -- start start 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c9579e2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c957959c10 con 0x55c95761b280 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c957949040 con 0x55c95763bf60 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c95794ce50 con 0x55c9576130a0 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59408/0 (socket says 172.21.15.102:59408) 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc29e7fc640 1 -- 172.21.15.102:0/1310287550 learned_addr learned my addr 172.21.15.102:0/1310287550 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.324+0000 7fc29effd640 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c9579e2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc287fff640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 0x7fc2880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 0x7fc2880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 -- 172.21.15.102:0/1310287550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 msgr2=0x55c9579e2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c9579e2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 -- 172.21.15.102:0/1310287550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 msgr2=0x55c9579e1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579e1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 -- 172.21.15.102:0/1310287550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9576a7540 con 0x55c95761b280 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc287fff640 1 -- 172.21.15.102:0/2634062248 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc2940e6f30 con 0x7fc2a01083a0 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc2940652e0 tx=0x7fc294021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9766b582d294e7b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 0x7fc2880b8aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2980137b0 tx=0x7fc298004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc2857fa640 1 -- 172.21.15.102:0/1310287550 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940acd60 con 0x55c95761b280 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc2857fa640 1 -- 172.21.15.102:0/1310287550 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc2940acaa0 con 0x55c95761b280 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.325+0000 7fc2857fa640 1 -- 172.21.15.102:0/1310287550 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940172c0 con 0x55c95761b280 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/1310287550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 msgr2=0x55c9579e2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc2940652e0 tx=0x7fc294021000 comp rx=0 tx=0).stop 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/1310287550 shutdown_connections 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579e2980 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c9579e2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/1310287550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579e1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/1310287550 >> 172.21.15.102:0/1310287550 conn(0x55c957630350 msgr2=0x55c9579dfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/1310287550 shutdown_connections 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.326+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/1310287550 wait complete. 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 -- start start 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 Processor -- start 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c9576130a0 0x55c9579f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c95761b280 0x55c9579f2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c9577aa5f0 con 0x55c95763bf60 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c9578e4010 con 0x55c9576130a0 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c9579f49e0 con 0x55c95761b280 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc2ab8ec740 10 client.0 _ll_register_callbacks cb 0x55c957943340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59424/0 (socket says 172.21.15.102:59424) 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 -- 172.21.15.102:0/4025844785 learned_addr learned my addr 172.21.15.102:0/4025844785 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29effd640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c9576130a0 0x55c9579f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c95761b280 0x55c9579f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 -- 172.21.15.102:0/4025844785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c95761b280 msgr2=0x55c9579f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c95761b280 0x55c9579f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 -- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c9576130a0 msgr2=0x55c9579f1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c9576130a0 0x55c9579f1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.327+0000 7fc29f7fe640 1 -- 172.21.15.102:0/4025844785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c957911a00 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc298010f50 tx=0x7fc298004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb86ff54c9b11b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298022070 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc29801e5f0 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2940acaa0 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc29802e050 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 10 client.15252 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c957a009b0 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc2940acaa0 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc29801d070 con 0x55c95763bf60 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 10 client.15252 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 10 client.15252 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 20 client.15252 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:10.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575fa8e0 0x55c957a04440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 4 client.15252 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.328+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c95795bb60 con 0x55c9575fa8e0 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.329+0000 7fc29effd640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575fa8e0 0x55c957a04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.329+0000 7fc29effd640 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575fa8e0 0x55c957a04440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=50febd2a4470c777 server_cookie=69caf239ee9f6787 in_seq=0 out_seq=0 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.329+0000 7fc282ff5640 10 client.15252 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc282ff5640 1 -- 172.21.15.102:0/4025844785 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c95795bb60 con 0x55c9575fa8e0 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc282ff5640 10 client.15252 handle_command_reply: tid=0 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 client.15252 shutdown 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 msgr2=0x55c9579fdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc298010f50 tx=0x7fc298004b50 comp rx=0 tx=0).stop 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 shutdown_connections 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575fa8e0 0x55c957a04440 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95763bf60 0x55c9579fdd40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c95761b280 0x55c9579f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc282ff5640 0 client.15252 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4025844785 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c9576130a0 0x55c9579f1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 >> 172.21.15.102:0/4025844785 conn(0x55c957630350 msgr2=0x55c9579e38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 shutdown_connections 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4025844785 wait complete. 2024-09-21T03:33:10.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.330+0000 7fc2ab8ec740 20 client.15252 trim_cache size 0 max 16384 2024-09-21T03:33:10.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 Processor -- start 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 -- start start 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a01e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c957a02780 con 0x55c95761b280 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c957a02e50 con 0x55c95763bf60 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c957a03520 con 0x55c9576130a0 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59432/0 (socket says 172.21.15.102:59432) 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 -- 172.21.15.102:0/785782805 learned_addr learned my addr 172.21.15.102:0/785782805 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29effd640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a01e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 -- 172.21.15.102:0/785782805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 msgr2=0x55c957a01e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a01e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 -- 172.21.15.102:0/785782805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 msgr2=0x55c9579f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29e7fc640 1 -- 172.21.15.102:0/785782805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9579e4cc0 con 0x55c95761b280 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.349+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.350+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc294009fd0 tx=0x7fc294009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb95a8d04eaf799 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.350+0000 7fc284ff9640 1 -- 172.21.15.102:0/785782805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ac700 con 0x55c95761b280 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.350+0000 7fc284ff9640 1 -- 172.21.15.102:0/785782805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc2940ad690 con 0x55c95761b280 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.350+0000 7fc284ff9640 1 -- 172.21.15.102:0/785782805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ac8e0 con 0x55c95761b280 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/785782805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 msgr2=0x55c9579daad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc294009fd0 tx=0x7fc294009280 comp rx=0 tx=0).stop 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/785782805 shutdown_connections 2024-09-21T03:33:10.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c9579daad0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c9579f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/785782805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a01e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/785782805 >> 172.21.15.102:0/785782805 conn(0x55c957630350 msgr2=0x55c9579fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/785782805 shutdown_connections 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/785782805 wait complete. 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 -- start start 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 Processor -- start 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.351+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a06e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c957a0bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c957a042c0 con 0x55c95761b280 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c957a03bf0 con 0x55c95763bf60 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c957a04990 con 0x55c9576130a0 2024-09-21T03:33:10.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 10 client.0 _ll_register_callbacks cb 0x7fc298013430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59442/0 (socket says 172.21.15.102:59442) 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 -- 172.21.15.102:0/4228110667 learned_addr learned my addr 172.21.15.102:0/4228110667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29effd640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a06e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29f7fe640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c957a0bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 -- 172.21.15.102:0/4228110667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 msgr2=0x55c957a06e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a06e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 -- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 msgr2=0x55c957a0bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c957a0bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 -- 172.21.15.102:0/4228110667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9579e2cf0 con 0x55c95761b280 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc29e7fc640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ea040 tx=0x7fc2940b1af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a623cb045a97fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc282ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:10.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ea6a0 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc2940a88e0 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2940ad690 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.352+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc2940c83b0 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 10 client.15258 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c957a0d330 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc2940ad690 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fc2940c2c50 con 0x55c95761b280 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 10 client.15258 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 10 client.15258 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 20 client.15258 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575cfc90 0x55c957a72740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 4 client.15258 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "status"}) -- 0x55c957957610 con 0x55c9575cfc90 2024-09-21T03:33:10.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.353+0000 7fc29effd640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575cfc90 0x55c957a72740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc282ff5640 10 client.15258 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc29effd640 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575cfc90 0x55c957a72740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cf58f2cc7402bd6 server_cookie=f0f77ff14e07599e in_seq=0 out_seq=0 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc282ff5640 1 -- 172.21.15.102:0/4228110667 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c957957610 con 0x55c9575cfc90 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc282ff5640 10 client.15258 handle_command_reply: tid=0 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 client.15258 shutdown 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 msgr2=0x55c957a073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc2940ea040 tx=0x7fc2940b1af0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 shutdown_connections 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55c9575cfc90 0x55c957a72740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c95761b280 0x55c957a073a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c95763bf60 0x55c957a0bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 --2- 172.21.15.102:0/4228110667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c9576130a0 0x55c957a06e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc282ff5640 0 client.15258 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 >> 172.21.15.102:0/4228110667 conn(0x55c957630350 msgr2=0x55c9579fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 shutdown_connections 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 1 -- 172.21.15.102:0/4228110667 wait complete. 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.354+0000 7fc2ab8ec740 20 client.15258 trim_cache size 0 max 16384 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 1, 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24659, 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:10.367 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 81.059161162999999, 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 99.484708785999999 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:10.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 msgr2=0x7fc2880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 0x7fc2880b8aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2980137b0 tx=0x7fc298004a40 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 msgr2=0x7fc2a019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc29400b450 tx=0x7fc29400b910 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 shutdown_connections 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc2880b6590 0x7fc2880b8aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2a01083a0 0x7fc2a019b9d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2a0108cf0 0x7fc2a019bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 --2- 172.21.15.102:0/2634062248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc2a0102a60 0x7fc2a019b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 >> 172.21.15.102:0/2634062248 conn(0x7fc2a0079730 msgr2=0x7fc2a0101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 shutdown_connections 2024-09-21T03:33:10.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:10.355+0000 7fc2a5378640 1 -- 172.21.15.102:0/2634062248 wait complete. 2024-09-21T03:33:10.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:10 smithi102 ceph-mon[31392]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:10 smithi102 ceph-mon[31392]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T03:33:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:10 smithi102 ceph-mon[31392]: Cluster is now healthy 2024-09-21T03:33:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:10 smithi148 ceph-mon[34651]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:10 smithi148 ceph-mon[34651]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T03:33:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:10 smithi148 ceph-mon[34651]: Cluster is now healthy 2024-09-21T03:33:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:10 smithi121 ceph-mon[34316]: pgmap v312: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 895 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:10 smithi121 ceph-mon[34316]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-21T03:33:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:10 smithi121 ceph-mon[34316]: Cluster is now healthy 2024-09-21T03:33:11.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:33:11.321 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 -- 172.21.15.102:0/2131033653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 msgr2=0x7f9974103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 --2- 172.21.15.102:0/2131033653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974103610 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9964009900 tx=0x7f996402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 -- 172.21.15.102:0/2131033653 shutdown_connections 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 --2- 172.21.15.102:0/2131033653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 0x7f997410f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 --2- 172.21.15.102:0/2131033653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f99741055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 --2- 172.21.15.102:0/2131033653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974103610 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 -- 172.21.15.102:0/2131033653 >> 172.21.15.102:0/2131033653 conn(0x7f9974079e10 msgr2=0x7f997407a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 -- 172.21.15.102:0/2131033653 shutdown_connections 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.793+0000 7f9979756640 1 -- 172.21.15.102:0/2131033653 wait complete. 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 Processor -- start 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 -- start start 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f9974110590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 0x7f9974110ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9974113c00 con 0x7f9974103200 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9974113a80 con 0x7f9974105b20 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9979756640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9974113d80 con 0x7f99741051d0 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59454/0 (socket says 172.21.15.102:59454) 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f9972ffd640 1 -- 172.21.15.102:0/3031822965 learned_addr learned my addr 172.21.15.102:0/3031822965 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f99727fc640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f9974110590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.794+0000 7f99737fe640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 0x7f9974110ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 -- 172.21.15.102:0/3031822965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 msgr2=0x7f9974110590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f9974110590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 -- 172.21.15.102:0/3031822965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 msgr2=0x7f9974110ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 0x7f9974110ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 -- 172.21.15.102:0/3031822965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99741a8830 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f99727fc640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f9974110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9972ffd640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9964005ab0 tx=0x7f99640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f996bfff640 1 -- 172.21.15.102:0/3031822965 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996403f030 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99741a8ac0 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f996bfff640 1 -- 172.21.15.102:0/3031822965 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9964003ac0 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f996bfff640 1 -- 172.21.15.102:0/3031822965 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964035070 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.795+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99741a8fa0 con 0x7f9974103200 2024-09-21T03:33:11.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.797+0000 7f996bfff640 1 -- 172.21.15.102:0/3031822965 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f9964042030 con 0x7f9974103200 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 Processor -- start 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 -- start start 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28df0a0 0x55b6f2cae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2c25c10 con 0x55b6f2907f60 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2c15040 con 0x55b6f28e7280 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f997fcca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2c18e50 con 0x55b6f28df0a0 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f99737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f99737fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59456/0 (socket says 172.21.15.102:59456) 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.798+0000 7f99737fe640 1 -- 172.21.15.102:0/1666019805 learned_addr learned my addr 172.21.15.102:0/1666019805 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:11.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f9972ffd640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28df0a0 0x55b6f2cae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f996bfff640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 0x7f99600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99727fc640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 0x7f99600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 -- 172.21.15.102:0/1666019805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28df0a0 msgr2=0x55b6f2cae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28df0a0 0x55b6f2cae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 -- 172.21.15.102:0/1666019805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 msgr2=0x55b6f2cae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 -- 172.21.15.102:0/1666019805 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f2973540 con 0x55b6f2907f60 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99727fc640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f996bfff640 1 -- 172.21.15.102:0/3031822965 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9964107cc0 con 0x7f9974103200 2024-09-21T03:33:11.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f996c014b90 tx=0x7f996c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80bc8803b04809f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99697fa640 1 -- 172.21.15.102:0/1666019805 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c025070 con 0x55b6f2907f60 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99737fe640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 0x7f99600b8a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f996c022000 tx=0x7f996c020000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99697fa640 1 -- 172.21.15.102:0/1666019805 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f996c014da0 con 0x55b6f2907f60 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.799+0000 7f99697fa640 1 -- 172.21.15.102:0/1666019805 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996c0209d0 con 0x55b6f2907f60 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 -- 172.21.15.102:0/1666019805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 msgr2=0x55b6f2cadf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f996c014b90 tx=0x7f996c0107a0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 -- 172.21.15.102:0/1666019805 shutdown_connections 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28df0a0 0x55b6f2cae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 --2- 172.21.15.102:0/1666019805 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f2907f60 0x55b6f2cadf00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 -- 172.21.15.102:0/1666019805 >> 172.21.15.102:0/1666019805 conn(0x55b6f28fc350 msgr2=0x55b6f2cabdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 -- 172.21.15.102:0/1666019805 shutdown_connections 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.800+0000 7f997fcca740 1 -- 172.21.15.102:0/1666019805 wait complete. 2024-09-21T03:33:11.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 -- start start 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 Processor -- start 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cb9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f2907f60 0x55b6f2cc59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2a765f0 con 0x55b6f28df0a0 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2bb0010 con 0x55b6f28e7280 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2cbc6e0 con 0x55b6f2907f60 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f997fcca740 10 client.0 _ll_register_callbacks cb 0x55b6f2c0f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59458/0 (socket says 172.21.15.102:59458) 2024-09-21T03:33:11.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.801+0000 7f9972ffd640 1 -- 172.21.15.102:0/539220639 learned_addr learned my addr 172.21.15.102:0/539220639 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f99737fe640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f2907f60 0x55b6f2cc59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 -- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f2907f60 msgr2=0x55b6f2cc59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f2907f60 0x55b6f2cc59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 -- 172.21.15.102:0/539220639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 msgr2=0x55b6f2cb9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cb9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 -- 172.21.15.102:0/539220639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f2bdda00 con 0x55b6f28df0a0 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f9972ffd640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99640cda20 tx=0x7f99640092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f04126e0cb8764 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f995a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.802+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964109030 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f99640c9f90 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f996c014da0 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9964049070 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 10 client.15270 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b6f2cc86a0 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f996c014da0 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f99640d72b0 con 0x55b6f28df0a0 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 10 client.15270 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 10 client.15270 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 20 client.15270 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f28c68e0 0x55b6f2ccc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 4 client.15270 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.803+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6f2c27b60 con 0x55b6f28c68e0 2024-09-21T03:33:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.804+0000 7f99727fc640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f28c68e0 0x55b6f2ccc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.804+0000 7f99727fc640 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f28c68e0 0x55b6f2ccc130 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3db2be084d24c41 server_cookie=ebce629c4622191b in_seq=0 out_seq=0 2024-09-21T03:33:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.804+0000 7f995a7fc640 10 client.15270 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f995a7fc640 1 -- 172.21.15.102:0/539220639 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b6f2c27b60 con 0x55b6f28c68e0 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f995a7fc640 10 client.15270 handle_command_reply: tid=0 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 client.15270 shutdown 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 msgr2=0x55b6f2cb9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f99640cda20 tx=0x7f99640092f0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 shutdown_connections 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f2907f60 0x55b6f2cc59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f28e7280 0x55b6f2cb9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f28c68e0 0x55b6f2ccc130 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 --2- 172.21.15.102:0/539220639 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cb9a60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 >> 172.21.15.102:0/539220639 conn(0x55b6f28fc350 msgr2=0x55b6f2cb10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f995a7fc640 0 client.15270 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 shutdown_connections 2024-09-21T03:33:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 1 -- 172.21.15.102:0/539220639 wait complete. 2024-09-21T03:33:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.805+0000 7f997fcca740 20 client.15270 trim_cache size 0 max 16384 2024-09-21T03:33:11.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 Processor -- start 2024-09-21T03:33:11.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 -- start start 2024-09-21T03:33:11.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cb4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cb4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.823+0000 7f997fcca740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2cca470 con 0x55b6f28df0a0 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f997fcca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2ccab40 con 0x55b6f2907f60 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f997fcca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2ccb210 con 0x55b6f28e7280 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59472/0 (socket says 172.21.15.102:59472) 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 -- 172.21.15.102:0/2956160380 learned_addr learned my addr 172.21.15.102:0/2956160380 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f99727fc640 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cb4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 -- 172.21.15.102:0/2956160380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 msgr2=0x55b6f2cb4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cb4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f99737fe640 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cb4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 -- 172.21.15.102:0/2956160380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 msgr2=0x55b6f2cb4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cb4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 -- 172.21.15.102:0/2956160380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f2ca6080 con 0x55b6f28df0a0 2024-09-21T03:33:11.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9972ffd640 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99640096c0 tx=0x7f99640cdc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451be7ad419fcc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9968ff9640 1 -- 172.21.15.102:0/2956160380 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640cd830 con 0x55b6f28df0a0 2024-09-21T03:33:11.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9968ff9640 1 -- 172.21.15.102:0/2956160380 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f99640b9020 con 0x55b6f28df0a0 2024-09-21T03:33:11.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.824+0000 7f9968ff9640 1 -- 172.21.15.102:0/2956160380 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640d7410 con 0x55b6f28df0a0 2024-09-21T03:33:11.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 -- 172.21.15.102:0/2956160380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 msgr2=0x55b6f2cc5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99640096c0 tx=0x7f99640cdc20 comp rx=0 tx=0).stop 2024-09-21T03:33:11.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 -- 172.21.15.102:0/2956160380 shutdown_connections 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cb4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cb4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 --2- 172.21.15.102:0/2956160380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cc5940 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 -- 172.21.15.102:0/2956160380 >> 172.21.15.102:0/2956160380 conn(0x55b6f28fc350 msgr2=0x55b6f2cc99f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 -- 172.21.15.102:0/2956160380 shutdown_connections 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.825+0000 7f997fcca740 1 -- 172.21.15.102:0/2956160380 wait complete. 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 -- start start 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 Processor -- start 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cd3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cd3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2ccbfb0 con 0x55b6f28df0a0 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2ccb8e0 con 0x55b6f2907f60 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2ccc680 con 0x55b6f28e7280 2024-09-21T03:33:11.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f997fcca740 10 client.0 _ll_register_callbacks cb 0x7f9964005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59486/0 (socket says 172.21.15.102:59486) 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 -- 172.21.15.102:0/1443615835 learned_addr learned my addr 172.21.15.102:0/1443615835 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f99727fc640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cd3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 -- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 msgr2=0x55b6f2cd3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cd3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 -- 172.21.15.102:0/1443615835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 msgr2=0x55b6f2cd3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cd3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.826+0000 7f9972ffd640 1 -- 172.21.15.102:0/1443615835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f2cd1d20 con 0x55b6f28df0a0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f9972ffd640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f996407b040 tx=0x7f99640d5f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2253d4d3d2246625 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640cd830 con 0x55b6f28df0a0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9964105b50 con 0x55b6f28df0a0 2024-09-21T03:33:11.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99640b9020 con 0x55b6f28df0a0 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f99640e9140 con 0x55b6f28df0a0 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 10 client.15276 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b6f2cd1d20 con 0x55b6f28df0a0 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f99640b9020 con 0x55b6f28df0a0 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f996403bb50 con 0x55b6f28df0a0 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 10 client.15276 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 10 client.15276 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 20 client.15276 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:11.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f289bc90 0x55b6f2d3ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 4 client.15276 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.827+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "status"}) -- 0x55b6f2c23610 con 0x55b6f289bc90 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f99727fc640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f289bc90 0x55b6f2d3ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f995a7fc640 10 client.15276 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f99727fc640 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f289bc90 0x55b6f2d3ab10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e44d019b685dde server_cookie=cfd5c657784d8178 in_seq=0 out_seq=0 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f995a7fc640 1 -- 172.21.15.102:0/1443615835 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55b6f2c23610 con 0x55b6f289bc90 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f995a7fc640 10 client.15276 handle_command_reply: tid=0 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 client.15276 shutdown 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 msgr2=0x55b6f2cd2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f996407b040 tx=0x7f99640d5f20 comp rx=0 tx=0).stop 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 shutdown_connections 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6f2907f60 0x55b6f2cd3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b6f28e7280 0x55b6f2cd3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b6f289bc90 0x55b6f2d3ab10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f997fcca740 1 --2- 172.21.15.102:0/1443615835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b6f28df0a0 0x55b6f2cd2bc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 >> 172.21.15.102:0/1443615835 conn(0x55b6f28fc350 msgr2=0x55b6f2cab710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.828+0000 7f995a7fc640 0 client.15276 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 shutdown_connections 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f997fcca740 1 -- 172.21.15.102:0/1443615835 wait complete. 2024-09-21T03:33:11.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f997fcca740 20 client.15276 trim_cache size 0 max 16384 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24661, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 90.330009286999996, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 110.246068236 2024-09-21T03:33:11.837 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 msgr2=0x7f99600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 0x7f99600b8a70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f996c022000 tx=0x7f996c020000 comp rx=0 tx=0).stop 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 msgr2=0x7f9974110050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9964005ab0 tx=0x7f99640040c0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 shutdown_connections 2024-09-21T03:33:11.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f99600b6560 0x7f99600b8a70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9974105b20 0x7f9974110ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f99741051d0 0x7f9974110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 --2- 172.21.15.102:0/3031822965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9974103200 0x7f9974110050 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 >> 172.21.15.102:0/3031822965 conn(0x7f9974079e10 msgr2=0x7f9974107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 shutdown_connections 2024-09-21T03:33:11.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:11.829+0000 7f9979756640 1 -- 172.21.15.102:0/3031822965 wait complete. 2024-09-21T03:33:12.496 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T03:33:12.496 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:33:12.505 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:33:12.505 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T03:33:12.748 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 -- 172.21.15.102:0/860495581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108450 msgr2=0x7f732c108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 --2- 172.21.15.102:0/860495581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108450 0x7f732c108860 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f7320009900 tx=0x7f732002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 -- 172.21.15.102:0/860495581 shutdown_connections 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 --2- 172.21.15.102:0/860495581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108450 0x7f732c108860 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 --2- 172.21.15.102:0/860495581 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108da0 0x7f732c10f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 --2- 172.21.15.102:0/860495581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 -- 172.21.15.102:0/860495581 >> 172.21.15.102:0/860495581 conn(0x7f732c0796d0 msgr2=0x7f732c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 -- 172.21.15.102:0/860495581 shutdown_connections 2024-09-21T03:33:13.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.242+0000 7f733341e640 1 -- 172.21.15.102:0/860495581 wait complete. 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.243+0000 7f733341e640 1 Processor -- start 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.243+0000 7f733341e640 1 -- start start 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108450 0x7f732c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f732c112b80 con 0x7f732c108da0 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f732c112a00 con 0x7f732c102b10 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f732c112d00 con 0x7f732c108450 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:59496/0 (socket says 172.21.15.102:59496) 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 -- 172.21.15.102:0/2518684986 learned_addr learned my addr 172.21.15.102:0/2518684986 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73311ba640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73309b9640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108450 0x7f732c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:13.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 -- 172.21.15.102:0/2518684986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108450 msgr2=0x7f732c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108450 0x7f732c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 -- 172.21.15.102:0/2518684986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 msgr2=0x7f732c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 -- 172.21.15.102:0/2518684986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f732c1a66a0 con 0x7f732c108da0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73311ba640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f73319bb640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f731c00eaa0 tx=0x7f731c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c00cdb0 con 0x7f732c108da0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f731c005020 con 0x7f732c108da0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f732c1a6990 con 0x7f732c108da0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f732c1a6ea0 con 0x7f732c108da0 2024-09-21T03:33:13.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.244+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c0116d0 con 0x7f732c108da0 2024-09-21T03:33:13.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.246+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f732c102f20 con 0x7f732c108da0 2024-09-21T03:33:13.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.247+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f731c0051d0 con 0x7f732c108da0 2024-09-21T03:33:13.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.248+0000 7f732a7fc640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 0x7f73140b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:13.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.248+0000 7f73311ba640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 0x7f73140b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:13.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.248+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f731c0e7b10 con 0x7f732c108da0 2024-09-21T03:33:13.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.248+0000 7f73311ba640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 0x7f73140b8aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7324005fd0 tx=0x7f7324005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:13.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.251+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f731c016030 con 0x7f732c108da0 2024-09-21T03:33:13.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.447+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f732c063800 con 0x7f73140b6590 2024-09-21T03:33:13.450 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:13 smithi102 ceph-mon[31392]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 895 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:13.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.448+0000 7f732a7fc640 1 -- 172.21.15.102:0/2518684986 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f732c063800 con 0x7f73140b6590 2024-09-21T03:33:13.450 INFO:teuthology.orchestra.run.smithi102.stdout:Backend: cephadm 2024-09-21T03:33:13.450 INFO:teuthology.orchestra.run.smithi102.stdout:Available: Yes 2024-09-21T03:33:13.450 INFO:teuthology.orchestra.run.smithi102.stdout:Paused: No 2024-09-21T03:33:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 msgr2=0x7f73140b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 0x7f73140b8aa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7324005fd0 tx=0x7f7324005850 comp rx=0 tx=0).stop 2024-09-21T03:33:13.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 msgr2=0x7f732c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f731c00eaa0 tx=0x7f731c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 shutdown_connections 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f73140b6590 0x7f73140b8aa0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f732c108da0 0x7f732c19be90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f732c108450 0x7f732c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 --2- 172.21.15.102:0/2518684986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f732c102b10 0x7f732c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 >> 172.21.15.102:0/2518684986 conn(0x7f732c0796d0 msgr2=0x7f732c1064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 shutdown_connections 2024-09-21T03:33:13.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:13.451+0000 7f733341e640 1 -- 172.21.15.102:0/2518684986 wait complete. 2024-09-21T03:33:13.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:13 smithi148 ceph-mon[34651]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 895 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:13 smithi121 ceph-mon[34316]: pgmap v313: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 895 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:14.115 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T03:33:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3978091745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98109df0 msgr2=0x7fec98110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3978091745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98109df0 0x7fec98110620 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fec90009ca0 tx=0x7fec9002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3978091745 shutdown_connections 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3978091745 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98109df0 0x7fec98110620 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3978091745 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 0x7fec981098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3978091745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98103b60 0x7fec98103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3978091745 >> 172.21.15.102:0/3978091745 conn(0x7fec9807b850 msgr2=0x7fec9807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:14.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3978091745 shutdown_connections 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.817+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3978091745 wait complete. 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 Processor -- start 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 -- start start 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 0x7fec9819cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98109df0 0x7fec981a2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fec98113bf0 con 0x7fec98103b60 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec98113a70 con 0x7fec98109df0 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec9d7a6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fec98113d70 con 0x7fec981094a0 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec96ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:14.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec96ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55868/0 (socket says 172.21.15.102:55868) 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec96ffd640 1 -- 172.21.15.102:0/3082306903 learned_addr learned my addr 172.21.15.102:0/3082306903 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec8ffff640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 0x7fec9819cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.818+0000 7fec977fe640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98109df0 0x7fec981a2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 -- 172.21.15.102:0/3082306903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 msgr2=0x7fec9819cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 0x7fec9819cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 -- 172.21.15.102:0/3082306903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98109df0 msgr2=0x7fec981a2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98109df0 0x7fec981a2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 -- 172.21.15.102:0/3082306903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec981a2750 con 0x7fec98103b60 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec96ffd640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d950 tx=0x7fec8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88017070 con 0x7fec98103b60 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fec88009c30 con 0x7fec98103b60 2024-09-21T03:33:14.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec981a2a40 con 0x7fec98103b60 2024-09-21T03:33:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8800f6b0 con 0x7fec98103b60 2024-09-21T03:33:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.819+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec981a91a0 con 0x7fec98103b60 2024-09-21T03:33:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.820+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec98103f70 con 0x7fec98103b60 2024-09-21T03:33:14.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.822+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fec880109c0 con 0x7fec98103b60 2024-09-21T03:33:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.822+0000 7fec94ff9640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 0x7fec780b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.823+0000 7fec8ffff640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 0x7fec780b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.823+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fec880e6fe0 con 0x7fec98103b60 2024-09-21T03:33:14.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.823+0000 7fec8ffff640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 0x7fec780b8af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec98106300 tx=0x7fec8000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:14.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:14.827+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fec88009de0 con 0x7fec98103b60 2024-09-21T03:33:15.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.015+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fec981079c0 con 0x7fec780b65e0 2024-09-21T03:33:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.027+0000 7fec94ff9640 1 -- 172.21.15.102:0/3082306903 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fec981079c0 con 0x7fec780b65e0 2024-09-21T03:33:15.029 INFO:teuthology.orchestra.run.smithi102.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T03:33:15.029 INFO:teuthology.orchestra.run.smithi102.stdout:mds.a smithi102 running (107s) 19s ago 106s 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 f717343ee920 2024-09-21T03:33:15.029 INFO:teuthology.orchestra.run.smithi102.stdout:mds.b smithi121 running (104s) 38s ago 104s 88.0M - 19.3.0-5120-g18432218 ddce307e1f32 1b0c74b8569b 2024-09-21T03:33:15.029 INFO:teuthology.orchestra.run.smithi102.stdout:mds.c smithi148 running (119s) 38s ago 118s 85.3M - 19.3.0-5120-g18432218 ddce307e1f32 5ad41be66f81 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.d smithi102 running (2m) 19s ago 2m 81.7M - 19.3.0-5120-g18432218 ddce307e1f32 8f811a034a8d 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.e smithi121 running (2m) 38s ago 2m 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 8cc48cda188d 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.f smithi148 running (2m) 38s ago 2m 84.5M - 19.3.0-5120-g18432218 ddce307e1f32 7f64063aa051 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.g smithi102 running (110s) 19s ago 110s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 d4683057eb1a 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.h smithi121 running (116s) 38s ago 115s 88.0M - 19.3.0-5120-g18432218 ddce307e1f32 5bf6d72af172 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.i smithi148 running (113s) 38s ago 113s 93.8M - 19.3.0-5120-g18432218 ddce307e1f32 2f4ae004e658 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.j smithi102 running (2m) 19s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 ad24f03b47bc 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.k smithi121 running (2m) 38s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 31acd6426aa1 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mds.l smithi148 running (2m) 38s ago 2m 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 391456710c1f 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mgr.x smithi102 *:9283,8765 running (9m) 19s ago 9m 585M - 19.3.0-5120-g18432218 ddce307e1f32 89d0b031c554 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mgr.y smithi121 *:8443,8765 running (8m) 38s ago 8m 525M - 19.3.0-5120-g18432218 ddce307e1f32 d8e4d65a5d71 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mgr.z smithi148 *:8443,8765 running (8m) 38s ago 8m 523M - 19.3.0-5120-g18432218 ddce307e1f32 42928696b395 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mon.a smithi102 running (9m) 19s ago 9m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 99eda1481348 2024-09-21T03:33:15.030 INFO:teuthology.orchestra.run.smithi102.stdout:mon.b smithi121 running (8m) 38s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 f2839885bf23 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:mon.c smithi148 running (8m) 38s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 851b4c797c30 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0 smithi102 running (7m) 19s ago 7m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 280aae514856 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1 smithi121 running (6m) 38s ago 6m 112M 4271M 19.3.0-5120-g18432218 ddce307e1f32 e1b7d23aac36 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2 smithi148 running (6m) 38s ago 6m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 f16a4a48ee96 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3 smithi102 running (5m) 19s ago 5m 124M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8e330fd00015 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4 smithi121 running (5m) 38s ago 5m 112M 4271M 19.3.0-5120-g18432218 ddce307e1f32 9b8acba1013d 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5 smithi148 running (5m) 38s ago 5m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b9cd6b7cc97f 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6 smithi102 running (4m) 19s ago 4m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8257ac31a83b 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7 smithi121 running (4m) 38s ago 4m 122M 4271M 19.3.0-5120-g18432218 ddce307e1f32 e3fe6ddaa79b 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.8 smithi148 running (3m) 38s ago 3m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 3e71e5ddfd9f 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.9 smithi102 running (3m) 19s ago 3m 119M 4272M 19.3.0-5120-g18432218 ddce307e1f32 45a4cef0423b 2024-09-21T03:33:15.031 INFO:teuthology.orchestra.run.smithi102.stdout:osd.10 smithi121 running (2m) 38s ago 2m 111M 4271M 19.3.0-5120-g18432218 ddce307e1f32 6c0443b1a8ae 2024-09-21T03:33:15.032 INFO:teuthology.orchestra.run.smithi102.stdout:osd.11 smithi148 running (2m) 38s ago 2m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 53642f093db4 2024-09-21T03:33:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 msgr2=0x7fec780b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 0x7fec780b8af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec98106300 tx=0x7fec8000b390 comp rx=0 tx=0).stop 2024-09-21T03:33:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 msgr2=0x7fec9819c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fec8800d950 tx=0x7fec8800de10 comp rx=0 tx=0).stop 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 shutdown_connections 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fec780b65e0 0x7fec780b8af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec98109df0 0x7fec981a2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fec981094a0 0x7fec9819cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.029+0000 7fec9d7a6640 1 --2- 172.21.15.102:0/3082306903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fec98103b60 0x7fec9819c7e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.030+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 >> 172.21.15.102:0/3082306903 conn(0x7fec9807b850 msgr2=0x7fec981072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.030+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 shutdown_connections 2024-09-21T03:33:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:15.030+0000 7fec9d7a6640 1 -- 172.21.15.102:0/3082306903 wait complete. 2024-09-21T03:33:15.510 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:15 smithi102 ceph-mon[31392]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:15.510 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:15 smithi102 ceph-mon[31392]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 721 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:15 smithi148 ceph-mon[34651]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:15 smithi148 ceph-mon[34651]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 721 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:15 smithi121 ceph-mon[34316]: from='client.15282 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:15.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:15 smithi121 ceph-mon[34316]: pgmap v314: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 721 B/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:15.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T03:33:16.104 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:16.482 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:16 smithi102 ceph-mon[31392]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:16.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 -- 172.21.15.102:0/1597609447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c107c30 msgr2=0x7f157c1080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:16.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 --2- 172.21.15.102:0/1597609447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c107c30 0x7f157c1080f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1574009ca0 tx=0x7f157402a8e0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 -- 172.21.15.102:0/1597609447 shutdown_connections 2024-09-21T03:33:16.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 --2- 172.21.15.102:0/1597609447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c107c30 0x7f157c1080f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 --2- 172.21.15.102:0/1597609447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 --2- 172.21.15.102:0/1597609447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c102820 0x7f157c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 -- 172.21.15.102:0/1597609447 >> 172.21.15.102:0/1597609447 conn(0x7f157c079790 msgr2=0x7f157c079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 -- 172.21.15.102:0/1597609447 shutdown_connections 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.572+0000 7f1583e39640 1 -- 172.21.15.102:0/1597609447 wait complete. 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 Processor -- start 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 -- start start 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1a1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 0x7f157c1a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f157c11a270 con 0x7f157c102820 2024-09-21T03:33:16.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f157c11a0f0 con 0x7f157c103170 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1583e39640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f157c11a3f0 con 0x7f157c107c30 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55874/0 (socket says 172.21.15.102:55874) 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 -- 172.21.15.102:0/352696816 learned_addr learned my addr 172.21.15.102:0/352696816 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f15813d4640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f15823d6640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 0x7f157c1a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 -- 172.21.15.102:0/352696816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 msgr2=0x7f157c1a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 0x7f157c1a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 -- 172.21.15.102:0/352696816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 msgr2=0x7f157c1a1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:16.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1a1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f1581bd5640 1 -- 172.21.15.102:0/352696816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c1a6c30 con 0x7f157c102820 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f15813d4640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.573+0000 7f15823d6640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 0x7f157c1a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1581bd5640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f157800b4a0 tx=0x7f157800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578014070 con 0x7f157c102820 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c1a6f20 con 0x7f157c102820 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1578010ae0 con 0x7f157c102820 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578017ce0 con 0x7f157c102820 2024-09-21T03:33:16.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.574+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c1ad680 con 0x7f157c102820 2024-09-21T03:33:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.575+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c107720 con 0x7f157c102820 2024-09-21T03:33:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.577+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f1578017070 con 0x7f157c102820 2024-09-21T03:33:16.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.578+0000 7f1572ffd640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 0x7f15680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.578+0000 7f15813d4640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 0x7f15680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.578+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f15780e6b20 con 0x7f157c102820 2024-09-21T03:33:16.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.578+0000 7f15813d4640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 0x7f15680b8a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f157c079cb0 tx=0x7f156c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:16.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.581+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15780ad280 con 0x7f157c102820 2024-09-21T03:33:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:16 smithi148 ceph-mon[34651]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:16.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.769+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f157c106d70 con 0x7f15680b6560 2024-09-21T03:33:16.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.776+0000 7f1572ffd640 1 -- 172.21.15.102:0/352696816 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f157c106d70 con 0x7f15680b6560 2024-09-21T03:33:16.778 INFO:teuthology.orchestra.run.smithi102.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T03:33:16.778 INFO:teuthology.orchestra.run.smithi102.stdout:mds.all 12/12 39s ago 2m smithi102=a;smithi102=d;smithi102=g;smithi102=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi148=c;smithi148=f;smithi148=i;smithi148=l;count:12 2024-09-21T03:33:16.778 INFO:teuthology.orchestra.run.smithi102.stdout:mgr 3/3 39s ago 8m smithi102=x;smithi121=y;smithi148=z;count:3 2024-09-21T03:33:16.779 INFO:teuthology.orchestra.run.smithi102.stdout:mon 3/3 39s ago 8m smithi102:172.21.15.102=a;smithi121:172.21.15.121=b;smithi148:172.21.15.148=c;count:3 2024-09-21T03:33:16.779 INFO:teuthology.orchestra.run.smithi102.stdout:osd 12 39s ago - 2024-09-21T03:33:16.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 msgr2=0x7f15680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:16.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 0x7f15680b8a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f157c079cb0 tx=0x7f156c008040 comp rx=0 tx=0).stop 2024-09-21T03:33:16.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 msgr2=0x7f157c1a0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:16.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f157800b4a0 tx=0x7f157800b960 comp rx=0 tx=0).stop 2024-09-21T03:33:16.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 shutdown_connections 2024-09-21T03:33:16.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15680b6560 0x7f15680b8a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f157c107c30 0x7f157c1a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f157c103170 0x7f157c1a1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 --2- 172.21.15.102:0/352696816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f157c102820 0x7f157c1a0cc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:16.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 >> 172.21.15.102:0/352696816 conn(0x7f157c079790 msgr2=0x7f157c105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:16.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 shutdown_connections 2024-09-21T03:33:16.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:16.778+0000 7f1583e39640 1 -- 172.21.15.102:0/352696816 wait complete. 2024-09-21T03:33:16.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:16 smithi121 ceph-mon[34316]: from='client.15288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:17.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:17 smithi102 ceph-mon[31392]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:17.507 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T03:33:17.645 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:17 smithi148 ceph-mon[34651]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:17.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:17 smithi121 ceph-mon[34316]: pgmap v315: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 187 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:17.767 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:18.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 -- 172.21.15.102:0/3177258443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 msgr2=0x7f5b60102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:18.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 --2- 172.21.15.102:0/3177258443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b60102e70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009900 tx=0x7f5b5002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 -- 172.21.15.102:0/3177258443 shutdown_connections 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 --2- 172.21.15.102:0/3177258443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b60108cf0 0x7f5b6010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 --2- 172.21.15.102:0/3177258443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b601083a0 0x7f5b601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 --2- 172.21.15.102:0/3177258443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b60102e70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 -- 172.21.15.102:0/3177258443 >> 172.21.15.102:0/3177258443 conn(0x7f5b60079730 msgr2=0x7f5b60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 -- 172.21.15.102:0/3177258443 shutdown_connections 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 -- 172.21.15.102:0/3177258443 wait complete. 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.215+0000 7f5b654cd640 1 Processor -- start 2024-09-21T03:33:18.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 -- start start 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b601083a0 0x7f5b6019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b60108cf0 0x7f5b6019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60112a80 con 0x7f5b60102a60 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60112900 con 0x7f5b60108cf0 2024-09-21T03:33:18.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b654cd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5b60112c00 con 0x7f5b601083a0 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b5effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b5effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55900/0 (socket says 172.21.15.102:55900) 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b5effd640 1 -- 172.21.15.102:0/2642838038 learned_addr learned my addr 172.21.15.102:0/2642838038 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b5f7fe640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b60108cf0 0x7f5b6019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.216+0000 7f5b5e7fc640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b601083a0 0x7f5b6019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 -- 172.21.15.102:0/2642838038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b601083a0 msgr2=0x7f5b6019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b601083a0 0x7f5b6019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 -- 172.21.15.102:0/2642838038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b60108cf0 msgr2=0x7f5b6019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b60108cf0 0x7f5b6019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 -- 172.21.15.102:0/2642838038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b601a0450 con 0x7f5b60102a60 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b5effd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006010 tx=0x7f5b50004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5003f070 con 0x7f5b60102a60 2024-09-21T03:33:18.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5b50031e10 con 0x7f5b60102a60 2024-09-21T03:33:18.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b601a06e0 con 0x7f5b60102a60 2024-09-21T03:33:18.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50035030 con 0x7f5b60102a60 2024-09-21T03:33:18.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.217+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b601a0bc0 con 0x7f5b60102a60 2024-09-21T03:33:18.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.218+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b60102e70 con 0x7f5b60102a60 2024-09-21T03:33:18.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.221+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f5b50042070 con 0x7f5b60102a60 2024-09-21T03:33:18.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.221+0000 7f5b47fff640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 0x7f5b480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:18.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.221+0000 7f5b5e7fc640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 0x7f5b480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:18.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.222+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5b50108600 con 0x7f5b60102a60 2024-09-21T03:33:18.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.222+0000 7f5b5e7fc640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 0x7f5b480b8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b60100b70 tx=0x7f5b5400a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:18.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.225+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b500ced60 con 0x7f5b60102a60 2024-09-21T03:33:18.420 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:18 smithi102 ceph-mon[31392]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:18.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.417+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f5b601016f0 con 0x7f5b480b6590 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.419+0000 7f5b47fff640 1 -- 172.21.15.102:0/2642838038 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f5b601016f0 con 0x7f5b480b6590 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:HOST ADDR LABELS STATUS 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102 172.21.15.102 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:smithi121 172.21.15.121 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:smithi148 172.21.15.148 2024-09-21T03:33:18.421 INFO:teuthology.orchestra.run.smithi102.stdout:3 hosts in cluster 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 msgr2=0x7f5b480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 0x7f5b480b8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b60100b70 tx=0x7f5b5400a4c0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 msgr2=0x7f5b6019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5b50006010 tx=0x7f5b50004430 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 shutdown_connections 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5b480b6590 0x7f5b480b8aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5b60108cf0 0x7f5b6019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5b601083a0 0x7f5b6019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.421+0000 7f5b654cd640 1 --2- 172.21.15.102:0/2642838038 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5b60102a60 0x7f5b6019a5a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.422+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 >> 172.21.15.102:0/2642838038 conn(0x7f5b60079730 msgr2=0x7f5b60106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.422+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 shutdown_connections 2024-09-21T03:33:18.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:18.422+0000 7f5b654cd640 1 -- 172.21.15.102:0/2642838038 wait complete. 2024-09-21T03:33:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:18 smithi148 ceph-mon[34651]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:18.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:18 smithi121 ceph-mon[34316]: from='client.15294 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:19.141 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T03:33:19.387 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:19.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:19 smithi102 ceph-mon[31392]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:19.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:19 smithi148 ceph-mon[34651]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:19 smithi121 ceph-mon[34316]: pgmap v316: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 -- 172.21.15.102:0/882374282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0103b80 msgr2=0x7f81d0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 --2- 172.21.15.102:0/882374282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0103b80 0x7f81d0103f90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009900 tx=0x7f81c002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:19.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 -- 172.21.15.102:0/882374282 shutdown_connections 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 --2- 172.21.15.102:0/882374282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0109e10 0x7f81d0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 --2- 172.21.15.102:0/882374282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 0x7f81d01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 --2- 172.21.15.102:0/882374282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0103b80 0x7f81d0103f90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 -- 172.21.15.102:0/882374282 >> 172.21.15.102:0/882374282 conn(0x7f81d00ff5d0 msgr2=0x7f81d0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 -- 172.21.15.102:0/882374282 shutdown_connections 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 -- 172.21.15.102:0/882374282 wait complete. 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.918+0000 7f81d70a7640 1 Processor -- start 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 -- start start 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0103b80 0x7f81d0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 0x7f81d0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0113bf0 con 0x7f81d0109e10 2024-09-21T03:33:19.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0113a70 con 0x7f81d01094c0 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d70a7640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81d0113d70 con 0x7f81d0103b80 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55908/0 (socket says 172.21.15.102:55908) 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 -- 172.21.15.102:0/816913829 learned_addr learned my addr 172.21.15.102:0/816913829 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d4e43640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0103b80 0x7f81d0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81cffff640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 0x7f81d0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 -- 172.21.15.102:0/816913829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0103b80 msgr2=0x7f81d0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0103b80 0x7f81d0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 -- 172.21.15.102:0/816913829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 msgr2=0x7f81d0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 0x7f81d0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 -- 172.21.15.102:0/816913829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d01a8840 con 0x7f81d0109e10 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.919+0000 7f81d5644640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81c800eaa0 tx=0x7f81c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.920+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c800cdb0 con 0x7f81d0109e10 2024-09-21T03:33:19.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.920+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81c8005020 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.920+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d01a8b30 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.920+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80116d0 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.920+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d01a9020 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.921+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d0103f90 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.922+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f81c80051d0 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.923+0000 7f81cdffb640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 0x7f81b80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.923+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f81c80e76c0 con 0x7f81d0109e10 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.923+0000 7f81d4e43640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 0x7f81b80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:19.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.923+0000 7f81d4e43640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 0x7f81b80b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f81d0077160 tx=0x7f81c00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:19.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:19.927+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81c8016030 con 0x7f81d0109e10 2024-09-21T03:33:20.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.114+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f81d0063800 con 0x7f81b80b6560 2024-09-21T03:33:20.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.116+0000 7f81cdffb640 1 -- 172.21.15.102:0/816913829 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f81d0063800 con 0x7f81b80b6560 2024-09-21T03:33:20.118 INFO:teuthology.orchestra.run.smithi102.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T03:33:20.118 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VK400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-21T03:33:20.118 INFO:teuthology.orchestra.run.smithi102.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:33:20.118 INFO:teuthology.orchestra.run.smithi102.stdout:smithi148 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005G400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T03:33:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 msgr2=0x7f81b80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:20.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 0x7f81b80b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f81d0077160 tx=0x7f81c00058d0 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 msgr2=0x7f81d0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f81c800eaa0 tx=0x7f81c800ef60 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 shutdown_connections 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81b80b6560 0x7f81b80b8a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81d0109e10 0x7f81d0076190 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81d01094c0 0x7f81d0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 --2- 172.21.15.102:0/816913829 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81d0103b80 0x7f81d0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 >> 172.21.15.102:0/816913829 conn(0x7f81d00ff5d0 msgr2=0x7f81d01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 shutdown_connections 2024-09-21T03:33:20.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:20.118+0000 7f81d70a7640 1 -- 172.21.15.102:0/816913829 wait complete. 2024-09-21T03:33:20.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:20 smithi102 ceph-mon[31392]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:20 smithi148 ceph-mon[34651]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:20.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:20 smithi121 ceph-mon[34316]: from='client.15300 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:20.877 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T03:33:20.886 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:33:20.886 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T03:33:21.133 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:21.510 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:21 smithi102 ceph-mon[31392]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:21.510 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:21 smithi102 ceph-mon[31392]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:21.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 -- 172.21.15.102:0/3686574250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7608102ae0 msgr2=0x7f7608102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 --2- 172.21.15.102:0/3686574250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7608102ae0 0x7f7608102ef0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f75f8009ca0 tx=0x7f75f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 -- 172.21.15.102:0/3686574250 shutdown_connections 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 --2- 172.21.15.102:0/3686574250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608108d20 0x7f760810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 --2- 172.21.15.102:0/3686574250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76081083d0 0x7f76081087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 --2- 172.21.15.102:0/3686574250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7608102ae0 0x7f7608102ef0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 -- 172.21.15.102:0/3686574250 >> 172.21.15.102:0/3686574250 conn(0x7f7608079760 msgr2=0x7f7608079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 -- 172.21.15.102:0/3686574250 shutdown_connections 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.598+0000 7f760fb08640 1 -- 172.21.15.102:0/3686574250 wait complete. 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 Processor -- start 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 -- start start 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 0x7f7608199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:21.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7608108d20 0x7f760819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7608112ab0 con 0x7f76081083d0 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7608112930 con 0x7f7608108d20 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760fb08640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7608112c30 con 0x7f7608102ae0 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760d0a3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760d0a3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55922/0 (socket says 172.21.15.102:55922) 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.599+0000 7f760d0a3640 1 -- 172.21.15.102:0/191207593 learned_addr learned my addr 172.21.15.102:0/191207593 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d8a4640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 0x7f7608199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760e0a5640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7608108d20 0x7f760819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 -- 172.21.15.102:0/191207593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 msgr2=0x7f7608199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 0x7f7608199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 -- 172.21.15.102:0/191207593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7608108d20 msgr2=0x7f760819ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:21.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7608108d20 0x7f760819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 -- 172.21.15.102:0/191207593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760819f2b0 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d8a4640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 0x7f7608199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760d0a3640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c970 tx=0x7f75fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc007bb0 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760819f5a0 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f75fc007d50 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc01d060 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.600+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76081a5dc0 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.601+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7608103d10 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.603+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f75fc004ec0 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.603+0000 7f7606ffd640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 0x7f75f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.603+0000 7f760d8a4640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 0x7f75f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.604+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f75fc0e7580 con 0x7f76081083d0 2024-09-21T03:33:21.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.604+0000 7f760d8a4640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 0x7f75f00b8aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000f80 tx=0x7f75f802f3a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:21.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.607+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75fc014030 con 0x7f76081083d0 2024-09-21T03:33:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:21 smithi148 ceph-mon[34651]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:21 smithi148 ceph-mon[34651]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:21 smithi121 ceph-mon[34316]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:21.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:21 smithi121 ceph-mon[34316]: pgmap v317: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T03:33:21.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.822+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f760819a530 con 0x7f76081083d0 2024-09-21T03:33:21.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.822+0000 7f7606ffd640 1 -- 172.21.15.102:0/191207593 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3101 (secure 0 0 0) 0x7f760819a530 con 0x7f76081083d0 2024-09-21T03:33:21.825 INFO:teuthology.orchestra.run.smithi102.stdout:e23 2024-09-21T03:33:21.825 INFO:teuthology.orchestra.run.smithi102.stdout:btime 2024-09-21T03:31:53:321330+0000 2024-09-21T03:33:21.825 INFO:teuthology.orchestra.run.smithi102.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:legacy client fscid: 1 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:Filesystem 'cephfs' (1) 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:fs_name cephfs 2024-09-21T03:33:21.826 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 23 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-21T03:31:41.100708+0000 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:modified 2024-09-21T03:31:53.013907+0000 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:tableserver 0 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:root 0 2024-09-21T03:33:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:session_timeout 300 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:session_autoclose 300 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:max_file_size 1099511627776 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:max_xattr_size 65536 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:required_client_features {} 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:last_failure 0 2024-09-21T03:33:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:last_failure_osd_epoch 0 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:max_mds 3 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:in 0,1,2 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:up {0=24661,1=24659,2=24637} 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:failed 2024-09-21T03:33:21.829 INFO:teuthology.orchestra.run.smithi102.stdout:damaged 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:stopped 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:data_pools [3] 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:metadata_pool 2 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:inline_data disabled 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:balancer 2024-09-21T03:33:21.830 INFO:teuthology.orchestra.run.smithi102.stdout:bal_rank_mask -1 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:standby_count_wanted 0 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:qdb_cluster leader: 24661 members: 24637,24659,24661 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.i{0:24661} state up:active seq 6 addr [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.h{0:24632} state up:standby-replay seq 1 addr [v2:172.21.15.121:6836/3016052537,v1:172.21.15.121:6837/3016052537] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b{1:24659} state up:active seq 6 addr [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.f{1:24628} state up:standby-replay seq 1 addr [v2:172.21.15.148:6834/4203175374,v1:172.21.15.148:6835/4203175374] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.831 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c{2:24637} state up:active seq 10 addr [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.e{2:24611} state up:standby-replay seq 1 addr [v2:172.21.15.121:6834/2193609869,v1:172.21.15.121:6835/2193609869] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout:Standby daemons: 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.j{-1:14766} state up:standby seq 1 addr [v2:172.21.15.102:6834/1688882523,v1:172.21.15.102:6835/1688882523] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.832 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d{-1:14778} state up:standby seq 1 addr [v2:172.21.15.102:6836/2970785732,v1:172.21.15.102:6837/2970785732] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.g{-1:14832} state up:standby seq 1 addr [v2:172.21.15.102:6838/3219085509,v1:172.21.15.102:6839/3219085509] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a{-1:14844} state up:standby seq 1 addr [v2:172.21.15.102:6840/4025152844,v1:172.21.15.102:6841/4025152844] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.k{-1:24584} state up:standby seq 1 addr [v2:172.21.15.121:6832/172872234,v1:172.21.15.121:6833/172872234] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.l{-1:24595} state up:standby seq 1 addr [v2:172.21.15.148:6832/1886877979,v1:172.21.15.148:6833/1886877979] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T03:33:21.834 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:21.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 msgr2=0x7f75f00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:21.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 0x7f75f00b8aa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75f8000f80 tx=0x7f75f802f3a0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 msgr2=0x7f76081999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:21.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c970 tx=0x7f75fc00ce30 comp rx=0 tx=0).stop 2024-09-21T03:33:21.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 shutdown_connections 2024-09-21T03:33:21.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f75f00b6590 0x7f75f00b8aa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76081083d0 0x7f76081999a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7608108d20 0x7f760819ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 --2- 172.21.15.102:0/191207593 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7608102ae0 0x7f7608199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:21.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 >> 172.21.15.102:0/191207593 conn(0x7f7608079760 msgr2=0x7f7608101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:21.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 shutdown_connections 2024-09-21T03:33:21.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:21.825+0000 7f760fb08640 1 -- 172.21.15.102:0/191207593 wait complete. 2024-09-21T03:33:22.466 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T03:33:22.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/191207593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:33:22.710 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/191207593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:33:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/191207593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T03:33:23.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/1468309738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f781094a0 msgr2=0x7f4f781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:23.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/1468309738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f781094a0 0x7f4f781098b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009900 tx=0x7f4f6c02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/1468309738 shutdown_connections 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/1468309738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f781094a0 0x7f4f781098b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/1468309738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f78109df0 0x7f4f78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/1468309738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78103b60 0x7f4f78103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/1468309738 >> 172.21.15.102:0/1468309738 conn(0x7f4f7807b850 msgr2=0x7f4f7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/1468309738 shutdown_connections 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.198+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/1468309738 wait complete. 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 Processor -- start 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 -- start start 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f781094a0 0x7f4f7819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:23.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78109df0 0x7f4f7819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f78113bd0 con 0x7f4f78103b60 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4f78113a50 con 0x7f4f78109df0 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f7dcf4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4f78113d50 con 0x7f4f781094a0 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f777fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55942/0 (socket says 172.21.15.102:55942) 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.199+0000 7f4f777fe640 1 -- 172.21.15.102:0/970605956 learned_addr learned my addr 172.21.15.102:0/970605956 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f76ffd640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f781094a0 0x7f4f7819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f77fff640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78109df0 0x7f4f7819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 -- 172.21.15.102:0/970605956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f781094a0 msgr2=0x7f4f7819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f781094a0 0x7f4f7819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 -- 172.21.15.102:0/970605956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78109df0 msgr2=0x7f4f7819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78109df0 0x7f4f7819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 -- 172.21.15.102:0/970605956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f781a0490 con 0x7f4f78103b60 2024-09-21T03:33:23.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f777fe640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800c920 tx=0x7f4f6800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f68007c70 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f781a0780 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4f68007e10 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f680188c0 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.200+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f781a6fa0 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.201+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f78103f70 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.203+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f4f68018a60 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.203+0000 7f4f74ff9640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 0x7f4f600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.203+0000 7f4f76ffd640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 0x7f4f600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.204+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f4f680e7860 con 0x7f4f78103b60 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.204+0000 7f4f76ffd640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 0x7f4f600b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c005940 tx=0x7f4f6c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:23.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.207+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f68014030 con 0x7f4f78103b60 2024-09-21T03:33:23.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.389+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f4f7810bc40 con 0x7f4f78103b60 2024-09-21T03:33:23.391 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:23 smithi102 ceph-mon[31392]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:33:23.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.390+0000 7f4f74ff9640 1 -- 172.21.15.102:0/970605956 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v81) ==== 56+0+5805 (secure 0 0 0) 0x7f4f680ae050 con 0x7f4f78103b60 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 81 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-21T03:23:16.722760+0000 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:modified 2024-09-21T03:33:05.309127+0000 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:crush_version 26 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:full_ratio 0.95 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:backfillfull_ratio 0.9 2024-09-21T03:33:23.392 INFO:teuthology.orchestra.run.smithi102.stdout:nearfull_ratio 0.85 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:require_min_compat_client luminous 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:min_compat_client luminous 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:require_osd_release squid 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:stretch_mode_enabled false 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:max_osd 12 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.0 up in weight 1 up_from 9 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6802/3173439186,v1:172.21.15.102:6803/3173439186] [v2:172.21.15.102:6804/3173439186,v1:172.21.15.102:6805/3173439186] exists,up aa4011b8-e09e-475a-9c72-baa73d3c2bc0 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.1 up in weight 1 up_from 15 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/864903414,v1:172.21.15.121:6801/864903414] [v2:172.21.15.121:6802/864903414,v1:172.21.15.121:6803/864903414] exists,up 2419af68-299f-44c9-bb97-66c3a6ef0f47 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.2 up in weight 1 up_from 19 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6800/807337613,v1:172.21.15.148:6801/807337613] [v2:172.21.15.148:6802/807337613,v1:172.21.15.148:6803/807337613] exists,up 4b9b4159-420e-4fcf-bf82-eeb15e5674c3 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.3 up in weight 1 up_from 27 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6810/4062411354,v1:172.21.15.102:6811/4062411354] [v2:172.21.15.102:6812/4062411354,v1:172.21.15.102:6813/4062411354] exists,up a79de33f-eac7-49a7-9045-be22d0ae933c 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.4 up in weight 1 up_from 33 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6808/3405274815,v1:172.21.15.121:6809/3405274815] [v2:172.21.15.121:6810/3405274815,v1:172.21.15.121:6811/3405274815] exists,up 7fb68fd9-b5d3-4847-b717-10a7e9ac1319 2024-09-21T03:33:23.393 INFO:teuthology.orchestra.run.smithi102.stdout:osd.5 up in weight 1 up_from 38 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6808/1887027995,v1:172.21.15.148:6809/1887027995] [v2:172.21.15.148:6810/1887027995,v1:172.21.15.148:6811/1887027995] exists,up 921fdc95-272e-4059-912a-76c97e920465 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.6 up in weight 1 up_from 44 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6818/3311755502,v1:172.21.15.102:6819/3311755502] [v2:172.21.15.102:6820/3311755502,v1:172.21.15.102:6821/3311755502] exists,up 0d2ec93c-5842-4c44-83a6-85b40ea4dfb6 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.7 up in weight 1 up_from 49 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6816/2625959446,v1:172.21.15.121:6817/2625959446] [v2:172.21.15.121:6818/2625959446,v1:172.21.15.121:6819/2625959446] exists,up 57d52535-2844-4895-b02c-543c561ee54b 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.8 up in weight 1 up_from 55 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6816/1644910051,v1:172.21.15.148:6817/1644910051] [v2:172.21.15.148:6818/1644910051,v1:172.21.15.148:6819/1644910051] exists,up 0c9af4a2-c599-4c13-916a-482f92ff1ef6 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.9 up in weight 1 up_from 60 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.102:6826/171485892,v1:172.21.15.102:6827/171485892] [v2:172.21.15.102:6828/171485892,v1:172.21.15.102:6829/171485892] exists,up 42776936-bb0a-4c50-8985-7362fc3d88cf 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.10 up in weight 1 up_from 65 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6824/3942483179,v1:172.21.15.121:6825/3942483179] [v2:172.21.15.121:6826/3942483179,v1:172.21.15.121:6827/3942483179] exists,up 127447a0-18cf-4a03-a1da-4d4a1a3c2268 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:osd.11 up in weight 1 up_from 71 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.148:6824/3639095642,v1:172.21.15.148:6825/3639095642] [v2:172.21.15.148:6826/3639095642,v1:172.21.15.148:6827/3639095642] exists,up 17bb6286-d812-42d3-b399-87e75901b950 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.5 [8,11] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.b [7,4] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.10 [2,4] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.12 [5,11] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.16 [2,4] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.1a [8,1] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 2.1d [2,6] 2024-09-21T03:33:23.394 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 3.12 [3,9] 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 3.13 [4,9] 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 3.1d [4,6] 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 3.2c [4,9] 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:pg_upmap_items 3.37 [5,8] 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/4149087988 expires 2024-09-22T03:25:04.133377+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/3263495485 expires 2024-09-22T03:23:38.629653+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/2843523961 expires 2024-09-22T03:23:38.629653+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/300734679 expires 2024-09-22T03:23:38.629653+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6801/3956447939 expires 2024-09-22T03:24:03.539725+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6800/2870558437 expires 2024-09-22T03:23:38.629653+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6800/3956447939 expires 2024-09-22T03:24:03.539725+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6801/4066875674 expires 2024-09-22T03:25:04.133377+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/2031600970 expires 2024-09-22T03:24:03.539725+0000 2024-09-21T03:33:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6800/4066875674 expires 2024-09-22T03:25:04.133377+0000 2024-09-21T03:33:23.396 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/2561662143 expires 2024-09-22T03:24:03.539725+0000 2024-09-21T03:33:23.396 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:6801/2870558437 expires 2024-09-22T03:23:38.629653+0000 2024-09-21T03:33:23.396 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/1964871279 expires 2024-09-22T03:25:04.133377+0000 2024-09-21T03:33:23.396 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/427898860 expires 2024-09-22T03:25:04.133377+0000 2024-09-21T03:33:23.396 INFO:teuthology.orchestra.run.smithi102.stdout:blocklist 172.21.15.102:0/1752373453 expires 2024-09-22T03:24:03.539725+0000 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 msgr2=0x7f4f600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 0x7f4f600b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c005940 tx=0x7f4f6c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 msgr2=0x7f4f7819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800c920 tx=0x7f4f6800cde0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 shutdown_connections 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f4f600b6590 0x7f4f600b8aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4f78109df0 0x7f4f7819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4f781094a0 0x7f4f7819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 --2- 172.21.15.102:0/970605956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f78103b60 0x7f4f7819a5e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 >> 172.21.15.102:0/970605956 conn(0x7f4f7807b850 msgr2=0x7f4f78107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 shutdown_connections 2024-09-21T03:33:23.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:23.392+0000 7f4f7dcf4640 1 -- 172.21.15.102:0/970605956 wait complete. 2024-09-21T03:33:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:23 smithi148 ceph-mon[34651]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:33:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:23 smithi121 ceph-mon[34316]: pgmap v318: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:33:24.092 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T03:33:24.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:24.349 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:24.615 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:24 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/970605956' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:33:24.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:24 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/970605956' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:33:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:24 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/970605956' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 -- 172.21.15.102:0/278266895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c108cf0 msgr2=0x7f3d7c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 --2- 172.21.15.102:0/278266895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c10f520 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009ca0 tx=0x7f3d7402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 -- 172.21.15.102:0/278266895 shutdown_connections 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 --2- 172.21.15.102:0/278266895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c10f520 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 --2- 172.21.15.102:0/278266895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 --2- 172.21.15.102:0/278266895 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c102a60 0x7f3d7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 -- 172.21.15.102:0/278266895 >> 172.21.15.102:0/278266895 conn(0x7f3d7c079730 msgr2=0x7f3d7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:24.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 -- 172.21.15.102:0/278266895 shutdown_connections 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.822+0000 7f3d815d0640 1 -- 172.21.15.102:0/278266895 wait complete. 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 Processor -- start 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 -- start start 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c112a80 con 0x7f3d7c102a60 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c112900 con 0x7f3d7c108cf0 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d815d0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c112c00 con 0x7f3d7c1083a0 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d7affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d7affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49850/0 (socket says 172.21.15.102:49850) 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.823+0000 7f3d7affd640 1 -- 172.21.15.102:0/1161848648 learned_addr learned my addr 172.21.15.102:0/1161848648 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7b7fe640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:24.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d727fc640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 -- 172.21.15.102:0/1161848648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c1083a0 msgr2=0x7f3d7c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 -- 172.21.15.102:0/1161848648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c108cf0 msgr2=0x7f3d7c19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 -- 172.21.15.102:0/1161848648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c1a6580 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d7affd640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c890 tx=0x7f3d6c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c004220 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c1a6870 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d6c0043c0 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0049e0 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.824+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c1a6e00 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.825+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c102e70 con 0x7f3d7c102a60 2024-09-21T03:33:24.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.827+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f3d6c005140 con 0x7f3d7c102a60 2024-09-21T03:33:24.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.827+0000 7f3d78ff9640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 0x7f3d680b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:24.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.827+0000 7f3d727fc640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 0x7f3d680b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:24.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.828+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3d6c0e7650 con 0x7f3d7c102a60 2024-09-21T03:33:24.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.828+0000 7f3d727fc640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 0x7f3d680b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c079b80 tx=0x7f3d6400c4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:24.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:24.830+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d6c014030 con 0x7f3d7c102a60 2024-09-21T03:33:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.046+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d7c06b290 con 0x7f3d7c102a60 2024-09-21T03:33:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.046+0000 7f3d78ff9640 1 -- 172.21.15.102:0/1161848648 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7f3d6c0addb0 con 0x7f3d7c102a60 2024-09-21T03:33:25.049 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:25.049 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:33:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 msgr2=0x7f3d680b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 0x7f3d680b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c079b80 tx=0x7f3d6400c4a0 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 msgr2=0x7f3d7c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c890 tx=0x7f3d6c00cd50 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 shutdown_connections 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d680b6560 0x7f3d680b8a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 --2- 172.21.15.102:0/1161848648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d7c102a60 0x7f3d7c19b350 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 >> 172.21.15.102:0/1161848648 conn(0x7f3d7c079730 msgr2=0x7f3d7c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 shutdown_connections 2024-09-21T03:33:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:25.049+0000 7f3d815d0640 1 -- 172.21.15.102:0/1161848648 wait complete. 2024-09-21T03:33:25.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:25 smithi102 ceph-mon[31392]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:25.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:25 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1161848648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:25 smithi148 ceph-mon[34651]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:25.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:25 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1161848648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:25.769 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:25.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:25 smithi121 ceph-mon[34316]: pgmap v319: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:25.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:25 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1161848648' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:26.011 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:26.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 -- 172.21.15.102:0/3175218623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 msgr2=0x7fcab810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:26.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 --2- 172.21.15.102:0/3175218623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab810f540 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009ca0 tx=0x7fcab002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 -- 172.21.15.102:0/3175218623 shutdown_connections 2024-09-21T03:33:26.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 --2- 172.21.15.102:0/3175218623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab810f540 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 --2- 172.21.15.102:0/3175218623 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab81083c0 0x7fcab81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 --2- 172.21.15.102:0/3175218623 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab8102a80 0x7fcab8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 -- 172.21.15.102:0/3175218623 >> 172.21.15.102:0/3175218623 conn(0x7fcab8079740 msgr2=0x7fcab8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 -- 172.21.15.102:0/3175218623 shutdown_connections 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.500+0000 7fcabf096640 1 -- 172.21.15.102:0/3175218623 wait complete. 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 Processor -- start 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 -- start start 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8102a80 0x7fcab8199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 0x7fcab81999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8112ac0 con 0x7fcab8108d10 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8112940 con 0x7fcab81083c0 2024-09-21T03:33:26.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabf096640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcab8112c40 con 0x7fcab8102a80 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabd633640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabd633640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49854/0 (socket says 172.21.15.102:49854) 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabd633640 1 -- 172.21.15.102:0/2872269922 learned_addr learned my addr 172.21.15.102:0/2872269922 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcabce32640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8102a80 0x7fcab8199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.501+0000 7fcab7fff640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 0x7fcab81999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 -- 172.21.15.102:0/2872269922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8102a80 msgr2=0x7fcab8199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8102a80 0x7fcab8199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 -- 172.21.15.102:0/2872269922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 msgr2=0x7fcab81999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 0x7fcab81999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 -- 172.21.15.102:0/2872269922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab819f3a0 con 0x7fcab8108d10 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcab7fff640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 0x7fcab81999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:26.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabd633640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005e30 tx=0x7fcab0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab004a070 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcab0031660 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab002f930 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab819f630 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.502+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab806bb40 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.503+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab8103d00 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.505+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fcab004d070 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.505+0000 7fcab5ffb640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 0x7fcaa80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.505+0000 7fcabce32640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 0x7fcaa80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.506+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcab0109ba0 con 0x7fcab8108d10 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.506+0000 7fcabce32640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 0x7fcaa80b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00bbe0 tx=0x7fcaac00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:26.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.509+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcab0084710 con 0x7fcab8108d10 2024-09-21T03:33:26.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.726+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcab8102e90 con 0x7fcab8108d10 2024-09-21T03:33:26.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.727+0000 7fcab5ffb640 1 -- 172.21.15.102:0/2872269922 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11933 (secure 0 0 0) 0x7fcab8102e90 con 0x7fcab8108d10 2024-09-21T03:33:26.729 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:26.730 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":23,"btime":"2024-09-21T03:31:53:321330+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:31:53.013907+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:33:26.730 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 23 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 msgr2=0x7fcaa80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 0x7fcaa80b8af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcaac00bbe0 tx=0x7fcaac00b390 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 msgr2=0x7fcab819ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcab0005e30 tx=0x7fcab0003f10 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 shutdown_connections 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcaa80b65e0 0x7fcaa80b8af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcab8108d10 0x7fcab819ec70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcab81083c0 0x7fcab81999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 --2- 172.21.15.102:0/2872269922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcab8102a80 0x7fcab8199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 >> 172.21.15.102:0/2872269922 conn(0x7fcab8079740 msgr2=0x7fcab8104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 shutdown_connections 2024-09-21T03:33:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:26.730+0000 7fcabf096640 1 -- 172.21.15.102:0/2872269922 wait complete. 2024-09-21T03:33:27.451 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:27 smithi102 ceph-mon[31392]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:27.451 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:27 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2872269922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:27.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:33:27.726 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:27.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:27 smithi148 ceph-mon[34651]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:27 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2872269922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:27 smithi121 ceph-mon[34316]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:27 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2872269922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 -- 172.21.15.102:0/281087597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c104a60 msgr2=0x7f374c104e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 --2- 172.21.15.102:0/281087597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c104a60 0x7f374c104e70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f373c009900 tx=0x7f373c02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:28.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 -- 172.21.15.102:0/281087597 shutdown_connections 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 --2- 172.21.15.102:0/281087597 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c10dec0 0x7f374c1103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 --2- 172.21.15.102:0/281087597 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c1053b0 0x7f374c10d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 --2- 172.21.15.102:0/281087597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c104a60 0x7f374c104e70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 -- 172.21.15.102:0/281087597 >> 172.21.15.102:0/281087597 conn(0x7f374c0796d0 msgr2=0x7f374c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 -- 172.21.15.102:0/281087597 shutdown_connections 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.200+0000 7f3751d1b640 1 -- 172.21.15.102:0/281087597 wait complete. 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 Processor -- start 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 -- start start 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c104a60 0x7f374c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:28.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 0x7f374c19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f374c113ce0 con 0x7f374c1053b0 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f374c113b60 con 0x7f374c10dec0 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.201+0000 7f3751d1b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f374c113e60 con 0x7f374c104a60 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49868/0 (socket says 172.21.15.102:49868) 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 -- 172.21.15.102:0/1016497368 learned_addr learned my addr 172.21.15.102:0/1016497368 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374b7fe640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c104a60 0x7f374c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374bfff640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 0x7f374c19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 -- 172.21.15.102:0/1016497368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c104a60 msgr2=0x7f374c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c104a60 0x7f374c19a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 -- 172.21.15.102:0/1016497368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 msgr2=0x7f374c19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:28.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 0x7f374c19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 -- 172.21.15.102:0/1016497368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f374c1a0580 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374bfff640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 0x7f374c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f374affd640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f373400e9f0 tx=0x7f373400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373400ccc0 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f374c1a0870 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3734010900 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3734018900 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.202+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f374c1a6fd0 con 0x7f374c1053b0 2024-09-21T03:33:28.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.204+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f374c104e70 con 0x7f374c1053b0 2024-09-21T03:33:28.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.205+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f3734010ab0 con 0x7f374c1053b0 2024-09-21T03:33:28.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.206+0000 7f3748ff9640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 0x7f37380b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:28.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.206+0000 7f374b7fe640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 0x7f37380b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:28.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.206+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f37340e7cb0 con 0x7f374c1053b0 2024-09-21T03:33:28.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.207+0000 7f374b7fe640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 0x7f37380b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f373c009230 tx=0x7f373c0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:28.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.209+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f37340ae410 con 0x7f374c1053b0 2024-09-21T03:33:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.388+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f374c1a7230 con 0x7f374c1053b0 2024-09-21T03:33:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.389+0000 7f3748ff9640 1 -- 172.21.15.102:0/1016497368 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23292 (secure 0 0 0) 0x7f37340b27f0 con 0x7f374c1053b0 2024-09-21T03:33:28.391 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:28.391 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":81,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:33:05.309127+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:33:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 msgr2=0x7f37380b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 0x7f37380b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f373c009230 tx=0x7f373c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 msgr2=0x7f374c19abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f373400e9f0 tx=0x7f373400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 shutdown_connections 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37380b6560 0x7f37380b8a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f374c1053b0 0x7f374c19abb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f374c10dec0 0x7f374c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 --2- 172.21.15.102:0/1016497368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f374c104a60 0x7f374c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.391+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 >> 172.21.15.102:0/1016497368 conn(0x7f374c0796d0 msgr2=0x7f374c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.392+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 shutdown_connections 2024-09-21T03:33:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:28.392+0000 7f3751d1b640 1 -- 172.21.15.102:0/1016497368 wait complete. 2024-09-21T03:33:29.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T03:31:41.100708+0000', 'modified': '2024-09-21T03:31:53.013907+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24661, 'mds_1': 24659, 'mds_2': 24637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24611': {'gid': 24611, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/2193609869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 2193609869}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 2193609869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24628': {'gid': 24628, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.148:6835/4203175374', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6834', 'nonce': 4203175374}, {'type': 'v1', 'addr': '172.21.15.148:6835', 'nonce': 4203175374}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24632': {'gid': 24632, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/3016052537', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 3016052537}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 3016052537}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'c', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.148:6837/1009058837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6836', 'nonce': 1009058837}, {'type': 'v1', 'addr': '172.21.15.148:6837', 'nonce': 1009058837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24659': {'gid': 24659, 'name': 'b', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.121:6839/891322364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 891322364}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 891322364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24661': {'gid': 24661, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.148:6839/3369184447', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.148:6838', 'nonce': 3369184447}, {'type': 'v1', 'addr': '172.21.15.148:6839', 'nonce': 3369184447}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24661, 'qdb_cluster': [24637, 24659, 24661]} 2024-09-21T03:33:29.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T03:33:29.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T03:33:29.435 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:29.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:29 smithi102 ceph-mon[31392]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:29.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:29 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1016497368' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:29 smithi148 ceph-mon[34651]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:29 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1016497368' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:29 smithi121 ceph-mon[34316]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:29.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:29 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1016497368' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 -- 172.21.15.102:0/745895664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224102a60 msgr2=0x7f4224102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 --2- 172.21.15.102:0/745895664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224102a60 0x7f4224102e70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f421c009ca0 tx=0x7f421c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 -- 172.21.15.102:0/745895664 shutdown_connections 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 --2- 172.21.15.102:0/745895664 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224108cf0 0x7f422410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 --2- 172.21.15.102:0/745895664 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 0x7f42241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 --2- 172.21.15.102:0/745895664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224102a60 0x7f4224102e70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 -- 172.21.15.102:0/745895664 >> 172.21.15.102:0/745895664 conn(0x7f4224079730 msgr2=0x7f4224079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 -- 172.21.15.102:0/745895664 shutdown_connections 2024-09-21T03:33:29.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.945+0000 7f4228feb640 1 -- 172.21.15.102:0/745895664 wait complete. 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 Processor -- start 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 -- start start 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224102a60 0x7f422419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 0x7f422419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4224112aa0 con 0x7f4224108cf0 2024-09-21T03:33:29.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4224112920 con 0x7f4224102a60 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4228feb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4224112c20 con 0x7f42241083a0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4222d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4222d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49888/0 (socket says 172.21.15.102:49888) 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4222d9d640 1 -- 172.21.15.102:0/4170678975 learned_addr learned my addr 172.21.15.102:0/4170678975 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f4221d9b640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 0x7f422419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.946+0000 7f422259c640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224102a60 0x7f422419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 -- 172.21.15.102:0/4170678975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 msgr2=0x7f422419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 0x7f422419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 -- 172.21.15.102:0/4170678975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224102a60 msgr2=0x7f422419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224102a60 0x7f422419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 -- 172.21.15.102:0/4170678975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42241a0510 con 0x7f4224108cf0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4222d9d640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f421400c970 tx=0x7f421400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f421b7fe640 1 -- 172.21.15.102:0/4170678975 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214007bb0 con 0x7f4224108cf0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f421b7fe640 1 -- 172.21.15.102:0/4170678975 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4214007d50 con 0x7f4224108cf0 2024-09-21T03:33:29.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f421b7fe640 1 -- 172.21.15.102:0/4170678975 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421400f450 con 0x7f4224108cf0 2024-09-21T03:33:29.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42241a0800 con 0x7f4224108cf0 2024-09-21T03:33:29.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.947+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42241a6f60 con 0x7f4224108cf0 2024-09-21T03:33:29.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.950+0000 7f422f55f740 1 Processor -- start 2024-09-21T03:33:29.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f421b7fe640 1 -- 172.21.15.102:0/4170678975 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f4214004f40 con 0x7f4224108cf0 2024-09-21T03:33:29.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 -- start start 2024-09-21T03:33:29.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f1e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f1e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561746e95c10 con 0x561746b77f60 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561746e85040 con 0x561746b4f0a0 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f422f55f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561746e88e50 con 0x561746b57280 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f4221d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f4221d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49902/0 (socket says 172.21.15.102:49902) 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.951+0000 7f4221d9b640 1 -- 172.21.15.102:0/2522521675 learned_addr learned my addr 172.21.15.102:0/2522521675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f422259c640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f1e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f1e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 -- 172.21.15.102:0/2522521675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 msgr2=0x561746f1e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f1e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 -- 172.21.15.102:0/2522521675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 msgr2=0x561746f1e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f1e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f421b7fe640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 0x7f42100b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 -- 172.21.15.102:0/2522521675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561746be3540 con 0x561746b77f60 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f422259c640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f1e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f421b7fe640 1 -- 172.21.15.102:0/4170678975 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f42140e6f90 con 0x7f4224108cf0 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 0x7f42100b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f420c00b8b0 tx=0x7f420c004210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc2557897ed224c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.952+0000 7f4218ff9640 1 -- 172.21.15.102:0/2522521675 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c010460 con 0x561746b77f60 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f4218ff9640 1 -- 172.21.15.102:0/2522521675 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c020900 con 0x561746b77f60 2024-09-21T03:33:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f4218ff9640 1 -- 172.21.15.102:0/2522521675 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c00f780 con 0x561746b77f60 2024-09-21T03:33:29.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 -- 172.21.15.102:0/2522521675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 msgr2=0x561746f1df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f420c00b8b0 tx=0x7f420c004210 comp rx=0 tx=0).stop 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f4221d9b640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 0x7f42100b8af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f420c01f000 tx=0x7f420c01c000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 -- 172.21.15.102:0/2522521675 shutdown_connections 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f1e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f1e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 --2- 172.21.15.102:0/2522521675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b77f60 0x561746f1df00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.953+0000 7f422f55f740 1 -- 172.21.15.102:0/2522521675 >> 172.21.15.102:0/2522521675 conn(0x561746b6c350 msgr2=0x561746f1bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 -- 172.21.15.102:0/2522521675 shutdown_connections 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 -- 172.21.15.102:0/2522521675 wait complete. 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 -- start start 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 Processor -- start 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f29df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.954+0000 7f422f55f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b77f60 0x561746f35a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561746ce65f0 con 0x561746b4f0a0 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561746e20010 con 0x561746b77f60 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561746f2c6e0 con 0x561746b57280 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49904/0 (socket says 172.21.15.102:49904) 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 -- 172.21.15.102:0/1440255763 learned_addr learned my addr 172.21.15.102:0/1440255763 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 10 client.0 _ll_register_callbacks cb 0x561746e7f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4222d9d640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b77f60 0x561746f35a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4221d9b640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f29df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 -- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 msgr2=0x561746f29df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f29df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 -- 172.21.15.102:0/1440255763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b77f60 msgr2=0x561746f35a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b77f60 0x561746f35a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 -- 172.21.15.102:0/1440255763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561746e4da00 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4221d9b640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f29df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422259c640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f421c009ca0 tx=0x7f421c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0ccb251ba7fe5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c003d40 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f421c031450 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420c020900 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f421c004b40 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 10 client.15348 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.955+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561746f385a0 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c020900 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f421c0045a0 con 0x561746b4f0a0 2024-09-21T03:33:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 10 client.15348 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 10 client.15348 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 20 client.15348 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b368e0 0x561746f3c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 4 client.15348 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561746e97b60 con 0x561746b368e0 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.956+0000 7f4221d9b640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b368e0 0x561746f3c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.957+0000 7f4221d9b640 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b368e0 0x561746f3c120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8612e1986b230c8 server_cookie=a3dbf9b06e5df224 in_seq=0 out_seq=0 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.957+0000 7f4209ffb640 10 client.15348 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.957+0000 7f4209ffb640 1 -- 172.21.15.102:0/1440255763 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561746e97b60 con 0x561746b368e0 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.957+0000 7f4209ffb640 10 client.15348 handle_command_reply: tid=0 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.957+0000 7f422f55f740 1 client.15348 shutdown 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 msgr2=0x561746f29830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f421c009ca0 tx=0x7f421c02f450 comp rx=0 tx=0).stop 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 shutdown_connections 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b368e0 0x561746f3c120 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f4209ffb640 0 client.15348 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b77f60 0x561746f35a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f29df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 --2- 172.21.15.102:0/1440255763 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b4f0a0 0x561746f29830 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 >> 172.21.15.102:0/1440255763 conn(0x561746b6c350 msgr2=0x561746f210e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 shutdown_connections 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 1 -- 172.21.15.102:0/1440255763 wait complete. 2024-09-21T03:33:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.958+0000 7f422f55f740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 Processor -- start 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 -- start start 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 0x561746f359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b4f0a0 0x561746f35ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561746f3a460 con 0x561746b57280 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561746f3ab30 con 0x561746b368e0 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422f55f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561746f3b200 con 0x561746b4f0a0 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49916/0 (socket says 172.21.15.102:49916) 2024-09-21T03:33:29.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 -- 172.21.15.102:0/95392344 learned_addr learned my addr 172.21.15.102:0/95392344 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4221d9b640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b4f0a0 0x561746f35ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422259c640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 0x561746f359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 -- 172.21.15.102:0/95392344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b4f0a0 msgr2=0x561746f35ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b4f0a0 0x561746f35ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 -- 172.21.15.102:0/95392344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 msgr2=0x561746f359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 0x561746f359a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 -- 172.21.15.102:0/95392344 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561746f201f0 con 0x561746b57280 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f422259c640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 0x561746f359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.976+0000 7f4222d9d640 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f42140e4cd0 tx=0x7f42140a9060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9e9a5bc4d620fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f420bfff640 1 -- 172.21.15.102:0/95392344 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421401d040 con 0x561746b57280 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f420bfff640 1 -- 172.21.15.102:0/95392344 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f42140b4e50 con 0x561746b57280 2024-09-21T03:33:29.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f420bfff640 1 -- 172.21.15.102:0/95392344 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42140ac060 con 0x561746b57280 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 -- 172.21.15.102:0/95392344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 msgr2=0x561746f1b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f42140e4cd0 tx=0x7f42140a9060 comp rx=0 tx=0).stop 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 -- 172.21.15.102:0/95392344 shutdown_connections 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b57280 0x561746f1b600 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b4f0a0 0x561746f35ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 --2- 172.21.15.102:0/95392344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b368e0 0x561746f359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 -- 172.21.15.102:0/95392344 >> 172.21.15.102:0/95392344 conn(0x561746b6c350 msgr2=0x561746f39a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 -- 172.21.15.102:0/95392344 shutdown_connections 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.977+0000 7f422f55f740 1 -- 172.21.15.102:0/95392344 wait complete. 2024-09-21T03:33:29.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 -- start start 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 Processor -- start 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f3ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f43e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561746f3bfa0 con 0x561746b368e0 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561746f3b8d0 con 0x561746b4f0a0 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561746f3c670 con 0x561746b57280 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422f55f740 10 client.0 _ll_register_callbacks cb 0x7f421c02f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49930/0 (socket says 172.21.15.102:49930) 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.978+0000 7f422259c640 1 -- 172.21.15.102:0/2147892229 learned_addr learned my addr 172.21.15.102:0/2147892229 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4222d9d640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f43e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 -- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 msgr2=0x561746f43e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f3ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f43e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 -- 172.21.15.102:0/2147892229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 msgr2=0x561746f3ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f3ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 -- 172.21.15.102:0/2147892229 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561746f3f530 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4222d9d640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f43e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422259c640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f421c005e30 tx=0x7f421c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fee6e255d87477 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4209ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c031660 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f421c031800 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42140b4e50 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f421c05e050 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422f55f740 10 client.15354 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x561746fa7b50 con 0x561746b368e0 2024-09-21T03:33:29.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.979+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f42140b4e50 con 0x561746b368e0 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f421c055070 con 0x561746b368e0 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 10 client.15354 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 10 client.15354 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 20 client.15354 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b77f60 0x561746fab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 4 client.15354 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "status"}) -- 0x561746e93610 con 0x561746b77f60 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b77f60 0x561746fab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f4221d9b640 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b77f60 0x561746fab4b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad94ae85424b40af server_cookie=ecb7b698ef8ed82d in_seq=0 out_seq=0 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.980+0000 7f4209ffb640 10 client.15354 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4209ffb640 1 -- 172.21.15.102:0/2147892229 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x561746e93610 con 0x561746b77f60 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4209ffb640 10 client.15354 handle_command_reply: tid=0 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 client.15354 shutdown 2024-09-21T03:33:29.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 msgr2=0x561746f3e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f421c005e30 tx=0x7f421c000f40 comp rx=0 tx=0).stop 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 shutdown_connections 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561746b77f60 0x561746fab4b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561746b57280 0x561746f43e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561746b4f0a0 0x561746f3ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 --2- 172.21.15.102:0/2147892229 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561746b368e0 0x561746f3e720 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 >> 172.21.15.102:0/2147892229 conn(0x561746b6c350 msgr2=0x561746f1b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4209ffb640 0 client.15354 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 shutdown_connections 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 1 -- 172.21.15.102:0/2147892229 wait complete. 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f422f55f740 20 client.15354 trim_cache size 0 max 16384 2024-09-21T03:33:29.988 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 2, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24637, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 99.672431779999997, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 133.578927007 2024-09-21T03:33:29.989 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 msgr2=0x7f42100b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 0x7f42100b8af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f420c01f000 tx=0x7f420c01c000 comp rx=0 tx=0).stop 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 msgr2=0x7f422419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f421400c970 tx=0x7f421400ce30 comp rx=0 tx=0).stop 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.981+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 shutdown_connections 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42100b65e0 0x7f42100b8af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4224108cf0 0x7f422419fde0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f42241083a0 0x7f422419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 --2- 172.21.15.102:0/4170678975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4224102a60 0x7f422419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:29.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 >> 172.21.15.102:0/4170678975 conn(0x7f4224079730 msgr2=0x7f4224106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:29.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 shutdown_connections 2024-09-21T03:33:29.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:29.982+0000 7f4228feb640 1 -- 172.21.15.102:0/4170678975 wait complete. 2024-09-21T03:33:30.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T03:33:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:31.575 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:31 smithi102 ceph-mon[31392]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:31.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 -- 172.21.15.102:0/2054302405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f441083a0 msgr2=0x7f5f441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/2054302405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f441083a0 0x7f5f441087b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009900 tx=0x7f5f2c02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:31.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 -- 172.21.15.102:0/2054302405 shutdown_connections 2024-09-21T03:33:31.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/2054302405 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f441083a0 0x7f5f441087b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/2054302405 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44108cf0 0x7f5f4410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/2054302405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44102a60 0x7f5f44102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 -- 172.21.15.102:0/2054302405 >> 172.21.15.102:0/2054302405 conn(0x7f5f44079730 msgr2=0x7f5f44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 -- 172.21.15.102:0/2054302405 shutdown_connections 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.663+0000 7f5f4a77e640 1 -- 172.21.15.102:0/2054302405 wait complete. 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 Processor -- start 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 -- start start 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44102a60 0x7f5f4419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 0x7f5f4419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44112b60 con 0x7f5f44108cf0 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f441129e0 con 0x7f5f441083a0 2024-09-21T03:33:31.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f4a77e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5f44112ce0 con 0x7f5f44102a60 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49946/0 (socket says 172.21.15.102:49946) 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.664+0000 7f5f48d1b640 1 -- 172.21.15.102:0/701839289 learned_addr learned my addr 172.21.15.102:0/701839289 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f437fe640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 0x7f5f4419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f43fff640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44102a60 0x7f5f4419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 -- 172.21.15.102:0/701839289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44102a60 msgr2=0x7f5f4419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44102a60 0x7f5f4419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 -- 172.21.15.102:0/701839289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 msgr2=0x7f5f4419ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 0x7f5f4419ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 -- 172.21.15.102:0/701839289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f441a6790 con 0x7f5f44108cf0 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f437fe640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 0x7f5f4419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:31.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00b970 tx=0x7f5f3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f417fa640 1 -- 172.21.15.102:0/701839289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c019070 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f417fa640 1 -- 172.21.15.102:0/701839289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f3c00cb40 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f441a6a80 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f417fa640 1 -- 172.21.15.102:0/701839289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c007650 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.665+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441a7010 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 Processor -- start 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f417fa640 1 -- 172.21.15.102:0/701839289 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f5f3c01c070 con 0x7f5f44108cf0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 -- start start 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a2f4148c10 con 0x55a2f3e0a280 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a2f4138040 con 0x55a2f3e020a0 2024-09-21T03:33:31.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2f413be50 con 0x55a2f3e2af60 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49956/0 (socket says 172.21.15.102:49956) 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 -- 172.21.15.102:0/129681720 learned_addr learned my addr 172.21.15.102:0/129681720 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f43fff640 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 -- 172.21.15.102:0/129681720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 msgr2=0x55a2f41d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41d0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 -- 172.21.15.102:0/129681720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 msgr2=0x55a2f41d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f417fa640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 0x7f5f300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.668+0000 7f5f437fe640 1 -- 172.21.15.102:0/129681720 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f3e96540 con 0x55a2f3e0a280 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f417fa640 1 -- 172.21.15.102:0/701839289 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5f3c0e6a20 con 0x7f5f44108cf0 2024-09-21T03:33:31.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f437fe640 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0096c0 tx=0x7f5f2c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0d647d024cb829 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f437fe640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 0x7f5f300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f3a7fc640 1 -- 172.21.15.102:0/129681720 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c035040 con 0x55a2f3e0a280 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f3a7fc640 1 -- 172.21.15.102:0/129681720 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f2c004230 con 0x55a2f3e0a280 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.669+0000 7f5f3a7fc640 1 -- 172.21.15.102:0/129681720 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c03d9f0 con 0x55a2f3e0a280 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- 172.21.15.102:0/129681720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 msgr2=0x55a2f41d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f437fe640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 0x7f5f300b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c044000 tx=0x7f5f2c03dd40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0096c0 tx=0x7f5f2c009560 comp rx=0 tx=0).stop 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- 172.21.15.102:0/129681720 shutdown_connections 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41d1980 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/129681720 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41d0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- 172.21.15.102:0/129681720 >> 172.21.15.102:0/129681720 conn(0x55a2f3e1f350 msgr2=0x55a2f41cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- 172.21.15.102:0/129681720 shutdown_connections 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- 172.21.15.102:0/129681720 wait complete. 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 -- start start 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.670+0000 7f5f50cf2740 1 Processor -- start 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41dc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a2f3f995f0 con 0x55a2f3e0a280 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a2f40d3010 con 0x55a2f3e020a0 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41df680 con 0x55a2f3e2af60 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f50cf2740 10 client.0 _ll_register_callbacks cb 0x55a2f4132340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49970/0 (socket says 172.21.15.102:49970) 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 -- 172.21.15.102:0/2196785988 learned_addr learned my addr 172.21.15.102:0/2196785988 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:31.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f43fff640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41dc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 -- 172.21.15.102:0/2196785988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 msgr2=0x55a2f41e89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41e89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 -- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 msgr2=0x55a2f41dc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41dc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 -- 172.21.15.102:0/2196785988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f4100a00 con 0x55a2f3e0a280 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f43fff640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f437fe640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c005f70 tx=0x7f5f2c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2640b27c2a09b661 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f237fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.671+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c035070 con 0x55a2f3e0a280 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5f2c03dab0 con 0x55a2f3e0a280 2024-09-21T03:33:31.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f2c004230 con 0x55a2f3e0a280 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5f2c003e10 con 0x55a2f3e0a280 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 10 client.15366 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a2f41eb580 con 0x55a2f3e0a280 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f2c004230 con 0x55a2f3e0a280 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5f2c03a040 con 0x55a2f3e0a280 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 10 client.15366 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 10 client.15366 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 20 client.15366 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3de98e0 0x55a2f41eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 4 client.15366 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2f414ab60 con 0x55a2f3de98e0 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.672+0000 7f5f43fff640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3de98e0 0x55a2f41eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.673+0000 7f5f43fff640 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3de98e0 0x55a2f41eeb80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=af5e6f5b044a8261 server_cookie=24d0a09ee6803260 in_seq=0 out_seq=0 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.673+0000 7f5f237fe640 10 client.15366 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f237fe640 1 -- 172.21.15.102:0/2196785988 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2f414ab60 con 0x55a2f3de98e0 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f237fe640 10 client.15366 handle_command_reply: tid=0 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 client.15366 shutdown 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 msgr2=0x55a2f41dcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c005f70 tx=0x7f5f2c041000 comp rx=0 tx=0).stop 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 shutdown_connections 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3de98e0 0x55a2f41eeb80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41dcec0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f237fe640 0 client.15366 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e2af60 0x55a2f41e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/2196785988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41dc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 >> 172.21.15.102:0/2196785988 conn(0x55a2f3e1f350 msgr2=0x55a2f41d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 shutdown_connections 2024-09-21T03:33:31.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 1 -- 172.21.15.102:0/2196785988 wait complete. 2024-09-21T03:33:31.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.674+0000 7f5f50cf2740 20 client.15366 trim_cache size 0 max 16384 2024-09-21T03:33:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.692+0000 7f5f50cf2740 1 Processor -- start 2024-09-21T03:33:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.692+0000 7f5f50cf2740 1 -- start start 2024-09-21T03:33:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.692+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3de98e0 0x55a2f41d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 0x55a2f41ced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41ecec0 con 0x55a2f3e0a280 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41ed590 con 0x55a2f3de98e0 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41edc60 con 0x55a2f3e020a0 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49986/0 (socket says 172.21.15.102:49986) 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 -- 172.21.15.102:0/1980397759 learned_addr learned my addr 172.21.15.102:0/1980397759 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f43fff640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3de98e0 0x55a2f41d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f437fe640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 0x55a2f41ced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 -- 172.21.15.102:0/1980397759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 msgr2=0x55a2f41ced10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 0x55a2f41ced10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 -- 172.21.15.102:0/1980397759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3de98e0 msgr2=0x55a2f41d7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3de98e0 0x55a2f41d7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 -- 172.21.15.102:0/1980397759 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2f41d31f0 con 0x55a2f3e0a280 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f437fe640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 0x55a2f41ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000f80 tx=0x7f5f3c0ac3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06ad75cab1a5efb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f39ffb640 1 -- 172.21.15.102:0/1980397759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0ad180 con 0x55a2f3e0a280 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f39ffb640 1 -- 172.21.15.102:0/1980397759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f3c0a8050 con 0x55a2f3e0a280 2024-09-21T03:33:31.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.693+0000 7f5f39ffb640 1 -- 172.21.15.102:0/1980397759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0a83d0 con 0x55a2f3e0a280 2024-09-21T03:33:31.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 -- 172.21.15.102:0/1980397759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 msgr2=0x55a2f41e8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c000f80 tx=0x7f5f3c0ac3d0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 -- 172.21.15.102:0/1980397759 shutdown_connections 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41e8910 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3e020a0 0x55a2f41ced10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/1980397759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3de98e0 0x55a2f41d7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 -- 172.21.15.102:0/1980397759 >> 172.21.15.102:0/1980397759 conn(0x55a2f3e1f350 msgr2=0x55a2f41ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 -- 172.21.15.102:0/1980397759 shutdown_connections 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.694+0000 7f5f50cf2740 1 -- 172.21.15.102:0/1980397759 wait complete. 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 -- start start 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 Processor -- start 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3de98e0 0x55a2f41f7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41eea00 con 0x55a2f3e0a280 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41ee330 con 0x55a2f3e020a0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a2f41ef0d0 con 0x55a2f3de98e0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f50cf2740 10 client.0 _ll_register_callbacks cb 0x7f5f2c032ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f48d1b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49992/0 (socket says 172.21.15.102:49992) 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.695+0000 7f5f48d1b640 1 -- 172.21.15.102:0/397375219 learned_addr learned my addr 172.21.15.102:0/397375219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f437fe640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f43fff640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3de98e0 0x55a2f41f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 -- 172.21.15.102:0/397375219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3de98e0 msgr2=0x55a2f41f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3de98e0 0x55a2f41f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 -- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 msgr2=0x55a2f41f0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:31.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41f0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 -- 172.21.15.102:0/397375219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2f41f1970 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f48d1b640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009a00 tx=0x7f5f3c0a8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5741fd67fdf5288 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f237fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0b1040 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5f3c0a83d0 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f3c0a8050 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5f3c0d4020 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f50cf2740 10 client.15372 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a2f425a0b0 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.696+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5f3c0a8050 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f5f3c097030 con 0x55a2f3e0a280 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 10 client.15372 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:31.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 10 client.15372 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 20 client.15372 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3e2af60 0x55a2f425d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 4 client.15372 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "status"}) -- 0x55a2f4146610 con 0x55a2f3e2af60 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f43fff640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3e2af60 0x55a2f425d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f237fe640 10 client.15372 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.697+0000 7f5f43fff640 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3e2af60 0x55a2f425d490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12a516b9de5a148b server_cookie=de991da0b26f685c in_seq=0 out_seq=0 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f237fe640 1 -- 172.21.15.102:0/397375219 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55a2f4146610 con 0x55a2f3e2af60 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f237fe640 10 client.15372 handle_command_reply: tid=0 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 client.15372 shutdown 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 msgr2=0x55a2f41f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009a00 tx=0x7f5f3c0a8f90 comp rx=0 tx=0).stop 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 shutdown_connections 2024-09-21T03:33:31.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a2f3e2af60 0x55a2f425d490 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a2f3e0a280 0x55a2f41f11e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a2f3e020a0 0x55a2f41f0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 --2- 172.21.15.102:0/397375219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a2f3de98e0 0x55a2f41f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 >> 172.21.15.102:0/397375219 conn(0x55a2f3e1f350 msgr2=0x55a2f41d1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f237fe640 0 client.15372 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 shutdown_connections 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 1 -- 172.21.15.102:0/397375219 wait complete. 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.698+0000 7f5f50cf2740 20 client.15372 trim_cache size 0 max 16384 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:31.705 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 1, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24659, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 102.404030445, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 120.829577106 2024-09-21T03:33:31.706 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 msgr2=0x7f5f300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 0x7f5f300b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c044000 tx=0x7f5f2c03dd40 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 msgr2=0x7f5f4419bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00b970 tx=0x7f5f3c00be30 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 shutdown_connections 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5f300b6560 0x7f5f300b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f44108cf0 0x7f5f4419bf50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441083a0 0x7f5f4419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 --2- 172.21.15.102:0/701839289 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5f44102a60 0x7f5f4419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:31.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 >> 172.21.15.102:0/701839289 conn(0x7f5f44079730 msgr2=0x7f5f441052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:31.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 shutdown_connections 2024-09-21T03:33:31.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:31.699+0000 7f5f4a77e640 1 -- 172.21.15.102:0/701839289 wait complete. 2024-09-21T03:33:31.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:31 smithi148 ceph-mon[34651]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:31 smithi121 ceph-mon[34316]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:32.519 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T03:33:32.764 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:33.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 -- 172.21.15.102:0/2851517173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 msgr2=0x7f9acc104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 --2- 172.21.15.102:0/2851517173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc104dc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009900 tx=0x7f9abc02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:33.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 -- 172.21.15.102:0/2851517173 shutdown_connections 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 --2- 172.21.15.102:0/2851517173 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 --2- 172.21.15.102:0/2851517173 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 --2- 172.21.15.102:0/2851517173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc104dc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.230+0000 7f9ad1938640 1 -- 172.21.15.102:0/2851517173 >> 172.21.15.102:0/2851517173 conn(0x7f9acc079730 msgr2=0x7f9acc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.231+0000 7f9ad1938640 1 -- 172.21.15.102:0/2851517173 shutdown_connections 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.231+0000 7f9ad1938640 1 -- 172.21.15.102:0/2851517173 wait complete. 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.231+0000 7f9ad1938640 1 Processor -- start 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.231+0000 7f9ad1938640 1 -- start start 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113c90 con 0x7f9acc1049b0 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113b10 con 0x7f9acc10de10 2024-09-21T03:33:33.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc113e10 con 0x7f9acc105300 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50020/0 (socket says 172.21.15.102:50020) 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 -- 172.21.15.102:0/1440662591 learned_addr learned my addr 172.21.15.102:0/1440662591 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 -- 172.21.15.102:0/1440662591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 msgr2=0x7f9acc19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 -- 172.21.15.102:0/1440662591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 msgr2=0x7f9acc19ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc19ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 -- 172.21.15.102:0/1440662591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc1a0670 con 0x7f9acc1049b0 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005940 tx=0x7f9abc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad0936640 1 -- 172.21.15.102:0/1440662591 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc03f030 con 0x7f9acc1049b0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc1a0900 con 0x7f9acc1049b0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad0936640 1 -- 172.21.15.102:0/1440662591 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9abc003cd0 con 0x7f9acc1049b0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.232+0000 7f9ad0936640 1 -- 172.21.15.102:0/1440662591 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc035070 con 0x7f9acc1049b0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.233+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1a70c0 con 0x7f9acc1049b0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.235+0000 7f9ad7eac740 1 Processor -- start 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 -- start start 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714455f60 0x5597147fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714435280 0x5597147fc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559714773c10 con 0x55971442d0a0 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559714763040 con 0x559714455f60 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559714766e50 con 0x559714435280 2024-09-21T03:33:33.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ad0936640 1 -- 172.21.15.102:0/1440662591 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f9abc042030 con 0x7f9acc1049b0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50030/0 (socket says 172.21.15.102:50030) 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 -- 172.21.15.102:0/1119753540 learned_addr learned my addr 172.21.15.102:0/1119753540 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714455f60 0x5597147fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714435280 0x5597147fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 -- 172.21.15.102:0/1119753540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714435280 msgr2=0x5597147fc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714435280 0x5597147fc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 -- 172.21.15.102:0/1119753540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714455f60 msgr2=0x5597147fbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714455f60 0x5597147fbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.236+0000 7f9acaffd640 1 -- 172.21.15.102:0/1119753540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597144c1540 con 0x55971442d0a0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9abc10be50 tx=0x7f9abc10bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479d352725a5a254 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9ac1ffb640 1 -- 172.21.15.102:0/1119753540 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc110ba0 con 0x55971442d0a0 2024-09-21T03:33:33.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9ad0936640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 0x7f9ab80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9ac1ffb640 1 -- 172.21.15.102:0/1119753540 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9abc115070 con 0x55971442d0a0 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9ac1ffb640 1 -- 172.21.15.102:0/1119753540 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc097f30 con 0x55971442d0a0 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 0x7f9ab80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.237+0000 7f9ad0936640 1 -- 172.21.15.102:0/1440662591 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9abc107d20 con 0x7f9acc1049b0 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1119753540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 msgr2=0x5597147fc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 0x7f9ab80b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400f4c0 tx=0x7f9ac4007740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9abc10be50 tx=0x7f9abc10bf40 comp rx=0 tx=0).stop 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1119753540 shutdown_connections 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597147fc440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714435280 0x5597147fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1119753540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714455f60 0x5597147fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1119753540 >> 172.21.15.102:0/1119753540 conn(0x55971444a350 msgr2=0x5597147f9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1119753540 shutdown_connections 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1119753540 wait complete. 2024-09-21T03:33:33.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.238+0000 7f9ad7eac740 1 -- start start 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 Processor -- start 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x559714807da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x559714813700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5597145c45f0 con 0x55971442d0a0 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5597146fe010 con 0x559714435280 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55971480a4a0 con 0x559714455f60 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ad7eac740 10 client.0 _ll_register_callbacks cb 0x55971475d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50044/0 (socket says 172.21.15.102:50044) 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 -- 172.21.15.102:0/1052256714 learned_addr learned my addr 172.21.15.102:0/1052256714 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x559714813700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x559714807da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 -- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 msgr2=0x559714813700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x559714813700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 -- 172.21.15.102:0/1052256714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 msgr2=0x559714807da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x559714807da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.239+0000 7f9acaffd640 1 -- 172.21.15.102:0/1052256714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971472ba00 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0cdcb0 tx=0x7f9abc03b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9923f4392a606dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc096f10 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9abc1057a0 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9abc115070 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9abc097180 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 10 client.15384 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5597148162d0 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9abc115070 con 0x55971442d0a0 2024-09-21T03:33:33.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f9abc0c9f90 con 0x55971442d0a0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 10 client.15384 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 10 client.15384 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 20 client.15384 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597144148e0 0x559714819a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 4 client.15384 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.240+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559714775b60 con 0x5597144148e0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.241+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597144148e0 0x559714819a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.241+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597144148e0 0x559714819a20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f356a69eae53110e server_cookie=26a55b77499b0056 in_seq=0 out_seq=0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.241+0000 7f9aaaffd640 10 client.15384 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1052256714 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559714775b60 con 0x5597144148e0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9aaaffd640 10 client.15384 handle_command_reply: tid=0 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 client.15384 shutdown 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 msgr2=0x5597148077c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0cdcb0 tx=0x7f9abc03b460 comp rx=0 tx=0).stop 2024-09-21T03:33:33.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 shutdown_connections 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x559714813700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x559714807da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597144148e0 0x559714819a20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1052256714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x5597148077c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9aaaffd640 0 client.15384 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 >> 172.21.15.102:0/1052256714 conn(0x55971444a350 msgr2=0x5597147ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 shutdown_connections 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1052256714 wait complete. 2024-09-21T03:33:33.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.242+0000 7f9ad7eac740 20 client.15384 trim_cache size 0 max 16384 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.260+0000 7f9ad7eac740 1 Processor -- start 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.260+0000 7f9ad7eac740 1 -- start start 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.260+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 0x559714802020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.260+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.260+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x5597148139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559714817d60 con 0x559714435280 2024-09-21T03:33:33.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559714818430 con 0x55971442d0a0 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559714818b00 con 0x559714455f60 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50056/0 (socket says 172.21.15.102:50056) 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 0x559714802020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 -- 172.21.15.102:0/1842119440 learned_addr learned my addr 172.21.15.102:0/1842119440 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 -- 172.21.15.102:0/1842119440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 msgr2=0x5597148139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x5597148139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 -- 172.21.15.102:0/1842119440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 msgr2=0x559714802020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 0x559714802020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 -- 172.21.15.102:0/1842119440 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597148082e0 con 0x559714435280 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 0x559714802020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9babeb3df9187aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac17fa640 1 -- 172.21.15.102:0/1842119440 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40158d0 con 0x559714435280 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.261+0000 7f9ac17fa640 1 -- 172.21.15.102:0/1842119440 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ab40133a0 con 0x559714435280 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ac17fa640 1 -- 172.21.15.102:0/1842119440 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40225f0 con 0x559714435280 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1842119440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 msgr2=0x559714813490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4006fd0 tx=0x7f9ab4008040 comp rx=0 tx=0).stop 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1842119440 shutdown_connections 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559714435280 0x559714813490 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x5597148139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1842119440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55971442d0a0 0x559714802020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1842119440 >> 172.21.15.102:0/1842119440 conn(0x55971444a350 msgr2=0x5597148029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1842119440 shutdown_connections 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.262+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1842119440 wait complete. 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 -- start start 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 Processor -- start 2024-09-21T03:33:33.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x55971481bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x55971481c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5597148198a0 con 0x55971442d0a0 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5597148191d0 con 0x559714435280 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559714819f70 con 0x559714455f60 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9ad7eac740 10 client.0 _ll_register_callbacks cb 0x7f9ac40075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.263+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:50064/0 (socket says 172.21.15.102:50064) 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 -- 172.21.15.102:0/1537852161 learned_addr learned my addr 172.21.15.102:0/1537852161 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x55971481bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x55971481c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 -- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 msgr2=0x55971481c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x55971481c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 -- 172.21.15.102:0/1537852161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 msgr2=0x55971481bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x55971481bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 -- 172.21.15.102:0/1537852161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55971481c940 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x55971481bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acb7fe640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x55971481c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9acaffd640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9abc03d040 tx=0x7f9abc10bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5608750d330092 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9aaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc10a060 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9abc03b4f0 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.264+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ab40133a0 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9abc049020 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 10 client.15390 fetch_fsmap learned FSMap version 23 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x559714884fb0 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9ab40133a0 con 0x55971442d0a0 2024-09-21T03:33:33.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f9abc10b530 con 0x55971442d0a0 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 10 client.15390 fetch_fsmap finished waiting for FSMap version 23 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 10 client.15390 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 20 client.15390 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597143e9c90 0x559714888640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 4 client.15390 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "status"}) -- 0x559714771610 con 0x5597143e9c90 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.265+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597143e9c90 0x559714888640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9aaaffd640 10 client.15390 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ac27fc640 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597143e9c90 0x559714888640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ce7221aa177978 server_cookie=5b9aa1e79b8de9a0 in_seq=0 out_seq=0 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9aaaffd640 1 -- 172.21.15.102:0/1537852161 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559714771610 con 0x5597143e9c90 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9aaaffd640 10 client.15390 handle_command_reply: tid=0 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 client.15390 shutdown 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 msgr2=0x559714822610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9abc03d040 tx=0x7f9abc10bca0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 shutdown_connections 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559714455f60 0x55971481c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559714435280 0x55971481bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5597143e9c90 0x559714888640 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 --2- 172.21.15.102:0/1537852161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55971442d0a0 0x559714822610 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9aaaffd640 0 client.15390 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.266+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 >> 172.21.15.102:0/1537852161 conn(0x55971444a350 msgr2=0x5597147f9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 shutdown_connections 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad7eac740 1 -- 172.21.15.102:0/1537852161 wait complete. 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad7eac740 20 client.15390 trim_cache size 0 max 16384 2024-09-21T03:33:33.280 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "cluster_fsid": "a5dfbe26-77c8-11ef-baf5-efdc52797490", 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "whoami": 0, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "id": 24661, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "want_state": "up:active", 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "state": "up:active", 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "fs_name": "cephfs", 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "rank_uptime": 111.767851369, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "mdsmap_epoch": 23, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch": 81, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_epoch_barrier": 77, 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout: "uptime": 131.68391109199999 2024-09-21T03:33:33.281 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 msgr2=0x7f9ab80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 0x7f9ab80b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400f4c0 tx=0x7f9ac4007740 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 msgr2=0x7f9acc19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005940 tx=0x7f9abc004360 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 shutdown_connections 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9ab80b6560 0x7f9ab80b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9acc10de10 0x7f9acc19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9acc105300 0x7f9acc19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 --2- 172.21.15.102:0/1440662591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9acc1049b0 0x7f9acc19a700 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:33.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.267+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 >> 172.21.15.102:0/1440662591 conn(0x7f9acc079730 msgr2=0x7f9acc100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:33.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.268+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 shutdown_connections 2024-09-21T03:33:33.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:33.268+0000 7f9ad1938640 1 -- 172.21.15.102:0/1440662591 wait complete. 2024-09-21T03:33:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:33 smithi102 ceph-mon[31392]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:33.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:33 smithi148 ceph-mon[34651]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:33 smithi121 ceph-mon[34316]: pgmap v323: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:33:33.912 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T03:33:33.936 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T03:33:33.936 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T03:33:33.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:33.936 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-21T03:33:33.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:33.953 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-21T03:33:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-21T03:33:34.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:33:34.024 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T03:33:34.024 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T03:33:34.024 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:34.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T03:33:34.309 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 -- 172.21.15.102:0/950629161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6781094b0 msgr2=0x7fb6781098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 --2- 172.21.15.102:0/950629161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6781094b0 0x7fb6781098c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb674009900 tx=0x7fb67402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 -- 172.21.15.102:0/950629161 shutdown_connections 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 --2- 172.21.15.102:0/950629161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb6781094b0 0x7fb6781098c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 --2- 172.21.15.102:0/950629161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 0x7fb678110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 --2- 172.21.15.102:0/950629161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb678103bc0 0x7fb678103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 -- 172.21.15.102:0/950629161 >> 172.21.15.102:0/950629161 conn(0x7fb67807b910 msgr2=0x7fb67807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 -- 172.21.15.102:0/950629161 shutdown_connections 2024-09-21T03:33:34.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.815+0000 7fb6805d2640 1 -- 172.21.15.102:0/950629161 wait complete. 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 Processor -- start 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 -- start start 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6781094b0 0x7fb67819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 0x7fb67819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb678113be0 con 0x7fb678103bc0 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb678113a60 con 0x7fb6781094b0 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb6805d2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb678113d60 con 0x7fb678109e00 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58584/0 (socket says 172.21.15.102:58584) 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 -- 172.21.15.102:0/4239537469 learned_addr learned my addr 172.21.15.102:0/4239537469 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67db6d640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6781094b0 0x7fb67819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67eb6f640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 0x7fb67819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 -- 172.21.15.102:0/4239537469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 msgr2=0x7fb67819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 0x7fb67819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 -- 172.21.15.102:0/4239537469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6781094b0 msgr2=0x7fb67819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6781094b0 0x7fb67819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.816+0000 7fb67e36e640 1 -- 172.21.15.102:0/4239537469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6781a0340 con 0x7fb678103bc0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb67e36e640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c920 tx=0x7fb66800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668007c70 con 0x7fb678103bc0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6781a0630 con 0x7fb678103bc0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb668007e10 con 0x7fb678103bc0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6680188c0 con 0x7fb678103bc0 2024-09-21T03:33:34.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.817+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781a6e50 con 0x7fb678103bc0 2024-09-21T03:33:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.818+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb678103fd0 con 0x7fb678103bc0 2024-09-21T03:33:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.819+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fb668018a60 con 0x7fb678103bc0 2024-09-21T03:33:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.820+0000 7fb66f7fe640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 0x7fb6640b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.820+0000 7fb67db6d640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 0x7fb6640b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:34.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.820+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb6680e77b0 con 0x7fb678103bc0 2024-09-21T03:33:34.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.821+0000 7fb67db6d640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 0x7fb6640b8aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb674005940 tx=0x7fb6740058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:34.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:34.823+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb668014030 con 0x7fb678103bc0 2024-09-21T03:33:35.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.041+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb67810bc30 con 0x7fb678103bc0 2024-09-21T03:33:35.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.041+0000 7fb66f7fe640 1 -- 172.21.15.102:0/4239537469 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7fb6680adfa0 con 0x7fb678103bc0 2024-09-21T03:33:35.044 INFO:teuthology.orchestra.run.smithi102.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 msgr2=0x7fb6640b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 0x7fb6640b8aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb674005940 tx=0x7fb6740058d0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 msgr2=0x7fb67819a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb66800c920 tx=0x7fb66800cde0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 shutdown_connections 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb6640b6590 0x7fb6640b8aa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb678109e00 0x7fb67819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6781094b0 0x7fb67819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 --2- 172.21.15.102:0/4239537469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb678103bc0 0x7fb67819a490 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:35.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 >> 172.21.15.102:0/4239537469 conn(0x7fb67807b910 msgr2=0x7fb6781074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:35.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 shutdown_connections 2024-09-21T03:33:35.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35.044+0000 7fb6805d2640 1 -- 172.21.15.102:0/4239537469 wait complete. 2024-09-21T03:33:35.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:35 smithi102 ceph-mon[31392]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:35 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4239537469' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:33:35.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:35 smithi148 ceph-mon[34651]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:35 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4239537469' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:33:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:35 smithi121 ceph-mon[34316]: pgmap v324: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:33:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:35 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4239537469' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T03:33:35.829 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:33:35.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:35.830 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-21T03:33:35.845 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T03:33:35.845 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T03:33:35.845 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T03:33:35.846 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-21T03:33:35.847 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T03:33:35.847 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42122sec preferred_lft 42122sec 2024-09-21T03:33:35.847 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link noprefixroute 2024-09-21T03:33:35.847 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-21T03:33:35.847 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T03:33:35.847 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:33:35.847 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-21T03:33:35.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-09-21T03:33:35.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-09-21T03:33:35.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-09-21T03:33:35.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T03:33:35.848 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-21T03:33:35.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:36.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:36.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:36.060 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T03:33:36.084 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-21T03:33:36.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:36.086 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-21T03:33:36.157 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-21T03:33:36.157 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T03:33:36.157 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T03:33:36.157 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T03:33:36.157 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T03:33:36.158 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-21T03:33:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:36.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:36.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:36.454 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-21T03:33:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:36.471 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-21T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-21T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T03:33:36.526 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-21T03:33:36.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:36.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:36.644 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T03:33:36.644 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-21T03:33:36.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:36.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:36.772 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T03:33:36.772 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-21T03:33:36.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-21T03:33:36.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T03:33:36.773 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-21T03:33:36.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:36.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:36.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:33:36.849 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:36.864 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T03:33:36.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T03:33:36.864 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:36.919 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T03:33:36.919 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T03:33:36.919 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/0cee5881-3719-455f-8534-f9c9b7a77e8e 2024-09-21T03:33:36.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:36.920 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/0cee5881-3719-455f-8534-f9c9b7a77e8e /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T03:33:37.031 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T03:33:37.032 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T03:33:37.032 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-21T03:33:37.161 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T03:33:37.161 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T03:33:37.162 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-21T03:33:37.162 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.102:3300,172.21.15.121:3300,172.21.15.148:3300" 2024-09-21T03:33:37.162 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.102:3300,172.21.15.121:3300,172.21.15.148:3300:/volumes/qa/sv_1/0cee5881-3719-455f-8534-f9c9b7a77e8e 2024-09-21T03:33:37.162 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=a5dfbe26-77c8-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T03:33:37.163 INFO:teuthology.orchestra.run.smithi102.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T03:33:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: You just mounted a file system that supports labels which does not 2024-09-21T03:33:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T03:33:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T03:33:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T03:33:37.164 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T03:33:37.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:33:37.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:37.191 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:33:37.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:33:37.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:37.287 INFO:teuthology.orchestra.run.smithi102.stdout:client15399 2024-09-21T03:33:37.288 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:33:37.288 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:33:37.304 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:33:37.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:33:37.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:37.400 INFO:teuthology.orchestra.run.smithi102.stdout:client15399 2024-09-21T03:33:37.400 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T03:33:37.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T03:33:37.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:37.456 INFO:teuthology.orchestra.run.smithi102.stdout:client15399 2024-09-21T03:33:37.456 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490.client15399/status') 2024-09-21T03:33:37.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T03:33:37.514 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.15399 (3)192.168.0.1:0/487336425 2024-09-21T03:33:37.514 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-09-21T03:33:37.515 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-09-21T03:33:37.515 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-09-21T03:33:37.515 INFO:teuthology.orchestra.run.smithi102.stderr:69 bytes copied, 2.3248e-05 s, 3.0 MB/s 2024-09-21T03:33:37.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T03:33:37.522 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:33:37.531 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:33:37.531 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:33:37.531 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T03:33:37.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 -- 172.21.15.102:0/4142733588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 msgr2=0x7f5a28102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 --2- 172.21.15.102:0/4142733588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a28102df0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009900 tx=0x7f5a2402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 -- 172.21.15.102:0/4142733588 shutdown_connections 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 --2- 172.21.15.102:0/4142733588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 0x7f5a2810f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 --2- 172.21.15.102:0/4142733588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 0x7f5a28108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 --2- 172.21.15.102:0/4142733588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a28102df0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 -- 172.21.15.102:0/4142733588 >> 172.21.15.102:0/4142733588 conn(0x7f5a280fe3e0 msgr2=0x7f5a28100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 -- 172.21.15.102:0/4142733588 shutdown_connections 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.640+0000 7f5a2facc640 1 -- 172.21.15.102:0/4142733588 wait complete. 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 Processor -- start 2024-09-21T03:33:37.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 -- start start 2024-09-21T03:33:37.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 0x7f5a2819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 0x7f5a2819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28112a60 con 0x7f5a281029e0 2024-09-21T03:33:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5a281128e0 con 0x7f5a28108310 2024-09-21T03:33:37.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2facc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5a28112be0 con 0x7f5a28108c60 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2d868640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2d868640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58600/0 (socket says 172.21.15.102:58600) 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2d868640 1 -- 172.21.15.102:0/3090746272 learned_addr learned my addr 172.21.15.102:0/3090746272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2e069640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 0x7f5a2819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.641+0000 7f5a2d067640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 0x7f5a2819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 -- 172.21.15.102:0/3090746272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 msgr2=0x7f5a2819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 0x7f5a2819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:37.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 -- 172.21.15.102:0/3090746272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 msgr2=0x7f5a2819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 0x7f5a2819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 -- 172.21.15.102:0/3090746272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a281a0460 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2d868640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005ab0 tx=0x7f5a240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2403f030 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5a24003cd0 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a281a06f0 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a24035070 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.642+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a281a6ee0 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.643+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a28102df0 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.645+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f5a24042030 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.645+0000 7f5a1effd640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 0x7f5a140b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.646+0000 7f5a2d067640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 0x7f5a140b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.646+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5a24107c40 con 0x7f5a281029e0 2024-09-21T03:33:37.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.646+0000 7f5a2d067640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 0x7f5a140b8af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a28101ae0 tx=0x7f5a1800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:37.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.649+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a240ce3a0 con 0x7f5a281029e0 2024-09-21T03:33:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:37 smithi102 ceph-mon[31392]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:37.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:37 smithi148 ceph-mon[34651]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:37 smithi121 ceph-mon[34316]: pgmap v325: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:33:37.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:37.867+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f5a2819b650 con 0x7f5a281029e0 2024-09-21T03:33:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.362+0000 7f5a1effd640 1 -- 172.21.15.102:0/3090746272 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f5a2819b650 con 0x7f5a281029e0 2024-09-21T03:33:38.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 msgr2=0x7f5a140b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 0x7f5a140b8af0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5a28101ae0 tx=0x7f5a1800a4c0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 msgr2=0x7f5a2819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5a24005ab0 tx=0x7f5a240042f0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 shutdown_connections 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5a140b65e0 0x7f5a140b8af0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5a28108c60 0x7f5a2819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5a28108310 0x7f5a2819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 --2- 172.21.15.102:0/3090746272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a281029e0 0x7f5a2819a530 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 >> 172.21.15.102:0/3090746272 conn(0x7f5a280fe3e0 msgr2=0x7f5a28107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 shutdown_connections 2024-09-21T03:33:38.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.365+0000 7f5a2facc640 1 -- 172.21.15.102:0/3090746272 wait complete. 2024-09-21T03:33:38.379 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T03:33:38.389 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T03:33:38.399 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:33:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 -- 172.21.15.102:0/3943598702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 msgr2=0x7f61201086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 --2- 172.21.15.102:0/3943598702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f61201086f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6108009900 tx=0x7f610802a410 comp rx=0 tx=0).stop 2024-09-21T03:33:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 -- 172.21.15.102:0/3943598702 shutdown_connections 2024-09-21T03:33:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 --2- 172.21.15.102:0/3943598702 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f61201086f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 --2- 172.21.15.102:0/3943598702 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 0x7f612010f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 --2- 172.21.15.102:0/3943598702 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 0x7f6120102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 -- 172.21.15.102:0/3943598702 >> 172.21.15.102:0/3943598702 conn(0x7f61200fe3f0 msgr2=0x7f6120100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 -- 172.21.15.102:0/3943598702 shutdown_connections 2024-09-21T03:33:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 -- 172.21.15.102:0/3943598702 wait complete. 2024-09-21T03:33:38.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.510+0000 7f6126020640 1 Processor -- start 2024-09-21T03:33:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 -- start start 2024-09-21T03:33:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 0x7f612019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 0x7f612019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6120113b30 con 0x7f61201082e0 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f61201139b0 con 0x7f6120108c30 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f6126020640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6120113cb0 con 0x7f61201029b0 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58622/0 (socket says 172.21.15.102:58622) 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 -- 172.21.15.102:0/3742934444 learned_addr learned my addr 172.21.15.102:0/3742934444 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611ffff640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 0x7f612019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611f7fe640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 0x7f612019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 -- 172.21.15.102:0/3742934444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 msgr2=0x7f612019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 0x7f612019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 -- 172.21.15.102:0/3742934444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 msgr2=0x7f612019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 0x7f612019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.511+0000 7f611effd640 1 -- 172.21.15.102:0/3742934444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61201a0410 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f611effd640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6108005940 tx=0x7f6108004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610803f030 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61201a06a0 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6108003cd0 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108035070 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.512+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61201a0be0 con 0x7f61201082e0 2024-09-21T03:33:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.513+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6120102dc0 con 0x7f61201082e0 2024-09-21T03:33:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.515+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f6108042030 con 0x7f61201082e0 2024-09-21T03:33:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.515+0000 7f611cff9640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 0x7f610c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.516+0000 7f611f7fe640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 0x7f610c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.516+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6108107d40 con 0x7f61201082e0 2024-09-21T03:33:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.516+0000 7f611f7fe640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 0x7f610c0b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6110005c40 tx=0x7f611000a570 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.519+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61080d2880 con 0x7f61201082e0 2024-09-21T03:33:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.697+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f612002e640 con 0x7f61201082e0 2024-09-21T03:33:38.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.698+0000 7f611cff9640 1 -- 172.21.15.102:0/3742934444 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23292 (secure 0 0 0) 0x7f61080d77c0 con 0x7f61201082e0 2024-09-21T03:33:38.700 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:38.701 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":81,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:33:05.309127+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 msgr2=0x7f610c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 0x7f610c0b8a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6110005c40 tx=0x7f611000a570 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 msgr2=0x7f612019ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6108005940 tx=0x7f6108004360 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 shutdown_connections 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f610c0b6560 0x7f610c0b8a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f61201082e0 0x7f612019ab10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6120108c30 0x7f612019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 --2- 172.21.15.102:0/3742934444 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f61201029b0 0x7f612019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 >> 172.21.15.102:0/3742934444 conn(0x7f61200fe3f0 msgr2=0x7f6120100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:38.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.700+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 shutdown_connections 2024-09-21T03:33:38.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.701+0000 7f6126020640 1 -- 172.21.15.102:0/3742934444 wait complete. 2024-09-21T03:33:38.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:33:38.714 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:27:06.439475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:31:37.203364+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:31:39.048176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:33:38.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:33:38.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:33:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T03:33:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 -- 172.21.15.102:0/1884431778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 msgr2=0x7f3b1c1086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 --2- 172.21.15.102:0/1884431778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c1086d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3b04009900 tx=0x7f3b0402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 -- 172.21.15.102:0/1884431778 shutdown_connections 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 --2- 172.21.15.102:0/1884431778 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c1086d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 --2- 172.21.15.102:0/1884431778 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c108c10 0x7f3b1c10f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 --2- 172.21.15.102:0/1884431778 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c102990 0x7f3b1c102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 -- 172.21.15.102:0/1884431778 >> 172.21.15.102:0/1884431778 conn(0x7f3b1c0fe3b0 msgr2=0x7f3b1c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 -- 172.21.15.102:0/1884431778 shutdown_connections 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 -- 172.21.15.102:0/1884431778 wait complete. 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.826+0000 7f3b2168b640 1 Processor -- start 2024-09-21T03:33:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 -- start start 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c102990 0x7f3b1c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c108c10 0x7f3b1c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1129f0 con 0x7f3b1c1082c0 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112870 con 0x7f3b1c102990 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b2168b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c112b70 con 0x7f3b1c108c10 2024-09-21T03:33:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58638/0 (socket says 172.21.15.102:58638) 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 -- 172.21.15.102:0/3709545012 learned_addr learned my addr 172.21.15.102:0/3709545012 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b1b7fe640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c108c10 0x7f3b1c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b1affd640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c102990 0x7f3b1c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 -- 172.21.15.102:0/3709545012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c108c10 msgr2=0x7f3b1c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c108c10 0x7f3b1c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 -- 172.21.15.102:0/3709545012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c102990 msgr2=0x7f3b1c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c102990 0x7f3b1c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.827+0000 7f3b127fc640 1 -- 172.21.15.102:0/3709545012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c1a0360 con 0x7f3b1c1082c0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b127fc640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005940 tx=0x7f3b040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0403f030 con 0x7f3b1c1082c0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b04031910 con 0x7f3b1c1082c0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b04035070 con 0x7f3b1c1082c0 2024-09-21T03:33:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1a05f0 con 0x7f3b1c1082c0 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.828+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a0b30 con 0x7f3b1c1082c0 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.829+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c102da0 con 0x7f3b1c1082c0 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.830+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f3b04042030 con 0x7f3b1c1082c0 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.831+0000 7f3b18ff9640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 0x7f3b080b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.831+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3b04107ab0 con 0x7f3b1c1082c0 2024-09-21T03:33:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.831+0000 7f3b1affd640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 0x7f3b080b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.832+0000 7f3b1affd640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 0x7f3b080b8af0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c005fd0 tx=0x7f3b0c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:38.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:38.834+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3b040d25f0 con 0x7f3b1c1082c0 2024-09-21T03:33:39.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.015+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3b1c1a7010 con 0x7f3b1c1082c0 2024-09-21T03:33:39.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.015+0000 7f3b18ff9640 1 -- 172.21.15.102:0/3709545012 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f3b040d7530 con 0x7f3b1c1082c0 2024-09-21T03:33:39.017 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 msgr2=0x7f3b080b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 0x7f3b080b8af0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c005fd0 tx=0x7f3b0c00b390 comp rx=0 tx=0).stop 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 msgr2=0x7f3b1c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3b04005940 tx=0x7f3b040042f0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 shutdown_connections 2024-09-21T03:33:39.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b080b65e0 0x7f3b080b8af0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c1082c0 0x7f3b1c19aa60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c108c10 0x7f3b1c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 --2- 172.21.15.102:0/3709545012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c102990 0x7f3b1c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 >> 172.21.15.102:0/3709545012 conn(0x7f3b1c0fe3b0 msgr2=0x7f3b1c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 shutdown_connections 2024-09-21T03:33:39.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.018+0000 7f3b2168b640 1 -- 172.21.15.102:0/3709545012 wait complete. 2024-09-21T03:33:39.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:33:39.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 -- 172.21.15.102:0/3015068348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 msgr2=0x7fa2601086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 --2- 172.21.15.102:0/3015068348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa2601086e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa254009900 tx=0x7fa25402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 -- 172.21.15.102:0/3015068348 shutdown_connections 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 --2- 172.21.15.102:0/3015068348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa2601086e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 --2- 172.21.15.102:0/3015068348 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26010f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 --2- 172.21.15.102:0/3015068348 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa260102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 -- 172.21.15.102:0/3015068348 >> 172.21.15.102:0/3015068348 conn(0x7fa2600fe3c0 msgr2=0x7fa260100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:39.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 -- 172.21.15.102:0/3015068348 shutdown_connections 2024-09-21T03:33:39.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.141+0000 7fa2666f2640 1 -- 172.21.15.102:0/3015068348 wait complete. 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.142+0000 7fa2666f2640 1 Processor -- start 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.142+0000 7fa2666f2640 1 -- start start 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa2601993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26019ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa260112a00 con 0x7fa2601082d0 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa260112880 con 0x7fa2601029a0 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa260112b80 con 0x7fa260108c20 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58664/0 (socket says 172.21.15.102:58664) 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 -- 172.21.15.102:0/41609476 learned_addr learned my addr 172.21.15.102:0/41609476 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa264c8f640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26019ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25ffff640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa2601993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 -- 172.21.15.102:0/41609476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 msgr2=0x7fa26019ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26019ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 -- 172.21.15.102:0/41609476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 msgr2=0x7fa2601993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa2601993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 -- 172.21.15.102:0/41609476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26019f310 con 0x7fa2601082d0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25ffff640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa2601993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa264c8f640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25f7fe640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa254005940 tx=0x7fa2540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25403f030 con 0x7fa2601082d0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2540318f0 con 0x7fa2601082d0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26019f5a0 con 0x7fa2601082d0 2024-09-21T03:33:39.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa254035070 con 0x7fa2601082d0 2024-09-21T03:33:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.143+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2601a5d90 con 0x7fa2601082d0 2024-09-21T03:33:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.144+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa260103c10 con 0x7fa2601082d0 2024-09-21T03:33:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.147+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fa254042030 con 0x7fa2601082d0 2024-09-21T03:33:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.147+0000 7fa25d7fa640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 0x7fa2480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.148+0000 7fa25ffff640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 0x7fa2480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.148+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa254107c40 con 0x7fa2601082d0 2024-09-21T03:33:39.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.148+0000 7fa25ffff640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 0x7fa2480b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa250009c20 tx=0x7fa250005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:39.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.151+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2540ce3a0 con 0x7fa2601082d0 2024-09-21T03:33:39.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.330+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa26019a500 con 0x7fa2601082d0 2024-09-21T03:33:39.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.331+0000 7fa25d7fa640 1 -- 172.21.15.102:0/41609476 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) ==== 104+0+11 (secure 0 0 0) 0x7fa2540d2780 con 0x7fa2601082d0 2024-09-21T03:33:39.333 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 msgr2=0x7fa2480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 0x7fa2480b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa250009c20 tx=0x7fa250005f90 comp rx=0 tx=0).stop 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 msgr2=0x7fa260199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa254005940 tx=0x7fa2540042f0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 shutdown_connections 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa2480b6560 0x7fa2480b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2601082d0 0x7fa260199980 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa260108c20 0x7fa26019ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 --2- 172.21.15.102:0/41609476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2601029a0 0x7fa2601993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 >> 172.21.15.102:0/41609476 conn(0x7fa2600fe3c0 msgr2=0x7fa2601007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:39.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 shutdown_connections 2024-09-21T03:33:39.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.333+0000 7fa2666f2640 1 -- 172.21.15.102:0/41609476 wait complete. 2024-09-21T03:33:39.347 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 -- 172.21.15.102:0/3438107572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4301093e0 msgr2=0x7fd4301097f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 --2- 172.21.15.102:0/3438107572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4301093e0 0x7fd4301097f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd424009900 tx=0x7fd42402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 -- 172.21.15.102:0/3438107572 shutdown_connections 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 --2- 172.21.15.102:0/3438107572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd4301093e0 0x7fd4301097f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 --2- 172.21.15.102:0/3438107572 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430109d30 0x7fd430110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 --2- 172.21.15.102:0/3438107572 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd430103ab0 0x7fd430103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 -- 172.21.15.102:0/3438107572 >> 172.21.15.102:0/3438107572 conn(0x7fd4300ff4d0 msgr2=0x7fd430101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 -- 172.21.15.102:0/3438107572 shutdown_connections 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.456+0000 7fd435c07640 1 -- 172.21.15.102:0/3438107572 wait complete. 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 Processor -- start 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 -- start start 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 0x7fd430075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4301093e0 0x7fd430075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd430113b50 con 0x7fd430109d30 2024-09-21T03:33:39.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd4301139d0 con 0x7fd4301093e0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.457+0000 7fd435c07640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd430113cd0 con 0x7fd430103ab0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58668/0 (socket says 172.21.15.102:58668) 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 -- 172.21.15.102:0/747675567 learned_addr learned my addr 172.21.15.102:0/747675567 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42f7fe640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 0x7fd430075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42effd640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4301093e0 0x7fd430075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 -- 172.21.15.102:0/747675567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 msgr2=0x7fd430075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 0x7fd430075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 -- 172.21.15.102:0/747675567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4301093e0 msgr2=0x7fd430075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4301093e0 0x7fd430075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 -- 172.21.15.102:0/747675567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4301a87e0 con 0x7fd430109d30 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42f7fe640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 0x7fd430075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42ffff640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b970 tx=0x7fd42800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428019070 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4301a8ad0 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd42800cb40 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428007610 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.458+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4301a9070 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.459+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd430103ec0 con 0x7fd430109d30 2024-09-21T03:33:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.461+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fd42801c070 con 0x7fd430109d30 2024-09-21T03:33:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.462+0000 7fd42cff9640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 0x7fd4180b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.462+0000 7fd42f7fe640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 0x7fd4180b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.462+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fd4280e6e70 con 0x7fd430109d30 2024-09-21T03:33:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.463+0000 7fd42f7fe640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 0x7fd4180b8aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd430077160 tx=0x7fd420005e70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.465+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4280ad570 con 0x7fd430109d30 2024-09-21T03:33:39.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.642+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd43002e640 con 0x7fd430109d30 2024-09-21T03:33:39.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.642+0000 7fd42cff9640 1 -- 172.21.15.102:0/747675567 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) ==== 100+0+11 (secure 0 0 0) 0x7fd4280b1950 con 0x7fd430109d30 2024-09-21T03:33:39.644 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 msgr2=0x7fd4180b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 0x7fd4180b8aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd430077160 tx=0x7fd420005e70 comp rx=0 tx=0).stop 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 msgr2=0x7fd430076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd42800b970 tx=0x7fd42800be30 comp rx=0 tx=0).stop 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 shutdown_connections 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd4180b6590 0x7fd4180b8aa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd430109d30 0x7fd430076190 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd4301093e0 0x7fd430075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 --2- 172.21.15.102:0/747675567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd430103ab0 0x7fd430075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:39.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 >> 172.21.15.102:0/747675567 conn(0x7fd4300ff4d0 msgr2=0x7fd4301018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:39.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 shutdown_connections 2024-09-21T03:33:39.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:39.645+0000 7fd435c07640 1 -- 172.21.15.102:0/747675567 wait complete. 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3742934444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3709545012' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:39 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/41609476' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.658 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T03:33:39.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3742934444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3709545012' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:39 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/41609476' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: pgmap v326: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:33:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3090746272' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T03:33:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:33:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3742934444' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3709545012' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:39 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/41609476' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:33:39.903 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 -- 172.21.15.102:0/3705666880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff01094a0 msgr2=0x7f9ff01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3705666880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff01094a0 0x7f9ff01098b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009900 tx=0x7f9fd802a410 comp rx=0 tx=0).stop 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 -- 172.21.15.102:0/3705666880 shutdown_connections 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3705666880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff01094a0 0x7f9ff01098b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3705666880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0109df0 0x7f9ff0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3705666880 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff0103b60 0x7f9ff0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 -- 172.21.15.102:0/3705666880 >> 172.21.15.102:0/3705666880 conn(0x7f9ff007b850 msgr2=0x7f9ff007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.388+0000 7f9ff517d640 1 -- 172.21.15.102:0/3705666880 shutdown_connections 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.389+0000 7f9ff517d640 1 -- 172.21.15.102:0/3705666880 wait complete. 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.389+0000 7f9ff517d640 1 Processor -- start 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 -- start start 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff01094a0 0x7f9ff019acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113c90 con 0x7f9ff0109df0 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113b10 con 0x7f9ff0103b60 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9ff517d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff0113e10 con 0x7f9ff01094a0 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58674/0 (socket says 172.21.15.102:58674) 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 -- 172.21.15.102:0/3313669426 learned_addr learned my addr 172.21.15.102:0/3313669426 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:40.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9feed9d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fe659c640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff01094a0 0x7f9ff019acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 -- 172.21.15.102:0/3313669426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff01094a0 msgr2=0x7f9ff019acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff01094a0 0x7f9ff019acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 -- 172.21.15.102:0/3313669426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0103b60 msgr2=0x7f9ff019a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.390+0000 7f9fef59e640 1 -- 172.21.15.102:0/3313669426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff01a0690 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9fef59e640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800b970 tx=0x7f9fe800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8019070 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff01a0980 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9fe8014440 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80075d0 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.391+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff01a70e0 con 0x7f9ff0109df0 2024-09-21T03:33:40.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.392+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ff0103ff0 con 0x7f9ff0109df0 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.395+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f9fe801c070 con 0x7f9ff0109df0 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.395+0000 7f9fecd99640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 0x7f9fdc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.395+0000 7f9feed9d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 0x7f9fdc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.395+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9fe80e6d30 con 0x7f9ff0109df0 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.396+0000 7f9feed9d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 0x7f9fdc0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009990 tx=0x7f9fe0009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:40.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.399+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9fe80b1870 con 0x7f9ff0109df0 2024-09-21T03:33:40.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.615+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ff019b850 con 0x7f9ff0109df0 2024-09-21T03:33:40.617 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:40 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/747675567' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:33:40.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.616+0000 7f9fecd99640 1 -- 172.21.15.102:0/3313669426 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f9ff019b850 con 0x7f9ff0109df0 2024-09-21T03:33:40.618 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:40.618 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"btime":"2024-09-21T03:33:38:357326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:33:37.868919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:33:40.618 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 24 2024-09-21T03:33:40.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 msgr2=0x7f9fdc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:40.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 0x7f9fdc0b8a70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009990 tx=0x7f9fe0009110 comp rx=0 tx=0).stop 2024-09-21T03:33:40.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 msgr2=0x7f9ff019ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:40.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fe800b970 tx=0x7f9fe800bd70 comp rx=0 tx=0).stop 2024-09-21T03:33:40.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 shutdown_connections 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9fdc0b6560 0x7f9fdc0b8a70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ff0109df0 0x7f9ff019ff60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9ff01094a0 0x7f9ff019acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 --2- 172.21.15.102:0/3313669426 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9ff0103b60 0x7f9ff019a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 >> 172.21.15.102:0/3313669426 conn(0x7f9ff007b850 msgr2=0x7f9ff01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 shutdown_connections 2024-09-21T03:33:40.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:40.618+0000 7f9ff517d640 1 -- 172.21.15.102:0/3313669426 wait complete. 2024-09-21T03:33:40.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:40 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/747675567' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:33:40.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:40 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/747675567' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:33:41.441 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T03:33:41.442 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T03:33:41.442 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:33:41.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 -- 172.21.15.102:0/2842752196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c10dd40 msgr2=0x7ffb5c110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 --2- 172.21.15.102:0/2842752196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c110230 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009900 tx=0x7ffb5402a410 comp rx=0 tx=0).stop 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 -- 172.21.15.102:0/2842752196 shutdown_connections 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 --2- 172.21.15.102:0/2842752196 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c110230 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 --2- 172.21.15.102:0/2842752196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 0x7ffb5c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 --2- 172.21.15.102:0/2842752196 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 -- 172.21.15.102:0/2842752196 >> 172.21.15.102:0/2842752196 conn(0x7ffb5c0fe350 msgr2=0x7ffb5c1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 -- 172.21.15.102:0/2842752196 shutdown_connections 2024-09-21T03:33:41.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.569+0000 7ffb6374a640 1 -- 172.21.15.102:0/2842752196 wait complete. 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 Processor -- start 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 -- start start 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 0x7ffb5c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c113ae0 con 0x7ffb5c1048e0 2024-09-21T03:33:41.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c113960 con 0x7ffb5c105230 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb6374a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c113c60 con 0x7ffb5c10dd40 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb614e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb614e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58684/0 (socket says 172.21.15.102:58684) 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.570+0000 7ffb614e6640 1 -- 172.21.15.102:0/956889332 learned_addr learned my addr 172.21.15.102:0/956889332 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb60ce5640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 0x7ffb5c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb61ce7640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 -- 172.21.15.102:0/956889332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c10dd40 msgr2=0x7ffb5c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 -- 172.21.15.102:0/956889332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 msgr2=0x7ffb5c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 0x7ffb5c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 -- 172.21.15.102:0/956889332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c1a0380 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb614e6640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800cce0 tx=0x7ffb5800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800f650 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffb5800fcc0 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c1a0670 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58018c40 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.571+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c1a6e90 con 0x7ffb5c1048e0 2024-09-21T03:33:41.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.572+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c104cf0 con 0x7ffb5c1048e0 2024-09-21T03:33:41.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.575+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7ffb5800f7f0 con 0x7ffb5c1048e0 2024-09-21T03:33:41.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.575+0000 7ffb527fc640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 0x7ffb480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.576+0000 7ffb60ce5640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 0x7ffb480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.576+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ffb580e7b70 con 0x7ffb5c1048e0 2024-09-21T03:33:41.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.576+0000 7ffb60ce5640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 0x7ffb480b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c10efd0 tx=0x7ffb4c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:41.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.579+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb58014030 con 0x7ffb5c1048e0 2024-09-21T03:33:41.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:41 smithi102 ceph-mon[31392]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:41 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3313669426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:41 smithi148 ceph-mon[34651]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:41 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3313669426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:41.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.757+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb5c107e60 con 0x7ffb480b6560 2024-09-21T03:33:41.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.761+0000 7ffb527fc640 1 -- 172.21.15.102:0/956889332 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259136 (secure 0 0 0) 0x7ffb5c107e60 con 0x7ffb480b6560 2024-09-21T03:33:41.765 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:41.767 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:33:41.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 msgr2=0x7ffb480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 0x7ffb480b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c10efd0 tx=0x7ffb4c005f90 comp rx=0 tx=0).stop 2024-09-21T03:33:41.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 msgr2=0x7ffb5c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800cce0 tx=0x7ffb5800a620 comp rx=0 tx=0).stop 2024-09-21T03:33:41.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 shutdown_connections 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffb480b6560 0x7ffb480b8a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffb5c10dd40 0x7ffb5c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffb5c105230 0x7ffb5c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 --2- 172.21.15.102:0/956889332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb5c1048e0 0x7ffb5c19a4e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 >> 172.21.15.102:0/956889332 conn(0x7ffb5c0fe350 msgr2=0x7ffb5c107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.764+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 shutdown_connections 2024-09-21T03:33:41.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.765+0000 7ffb6374a640 1 -- 172.21.15.102:0/956889332 wait complete. 2024-09-21T03:33:41.778 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-21T03:33:40.249625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659427,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":742,"num_read_kb":471,"num_write":296,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":740,"ondisk_log_size":740,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360104,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581720,"statfs":{"total":1151940427776,"available":1151571681280,"internally_reserved":0,"allocated":11059200,"data_stored":7270005,"data_compressed":251955,"data_compressed_allocated":344064,"data_compressed_original":2187264,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319714+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:33:05.319714+0000","last_peered":"2024-09-21T03:33:05.319714+0000","last_clean":"2024-09-21T03:33:05.319714+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:33:05.319714+0000","last_undegraded":"2024-09-21T03:33:05.319714+0000","last_fullsized":"2024-09-21T03:33:05.319714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466400+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:33:05.466400+0000","last_peered":"2024-09-21T03:33:05.466400+0000","last_clean":"2024-09-21T03:33:05.466400+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:33:05.466400+0000","last_undegraded":"2024-09-21T03:33:05.466400+0000","last_fullsized":"2024-09-21T03:33:05.466400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466309+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:33:05.466309+0000","last_peered":"2024-09-21T03:33:05.466309+0000","last_clean":"2024-09-21T03:33:05.466309+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:33:05.466309+0000","last_undegraded":"2024-09-21T03:33:05.466309+0000","last_fullsized":"2024-09-21T03:33:05.466309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444188+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:33:05.444188+0000","last_peered":"2024-09-21T03:33:05.444188+0000","last_clean":"2024-09-21T03:33:05.444188+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:33:05.444188+0000","last_undegraded":"2024-09-21T03:33:05.444188+0000","last_fullsized":"2024-09-21T03:33:05.444188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321904+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:33:05.321904+0000","last_peered":"2024-09-21T03:33:05.321904+0000","last_clean":"2024-09-21T03:33:05.321904+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:33:05.321904+0000","last_undegraded":"2024-09-21T03:33:05.321904+0000","last_fullsized":"2024-09-21T03:33:05.321904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440600+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:33:05.440600+0000","last_peered":"2024-09-21T03:33:05.440600+0000","last_clean":"2024-09-21T03:33:05.440600+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:33:05.440600+0000","last_undegraded":"2024-09-21T03:33:05.440600+0000","last_fullsized":"2024-09-21T03:33:05.440600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321242+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:33:05.321242+0000","last_peered":"2024-09-21T03:33:05.321242+0000","last_clean":"2024-09-21T03:33:05.321242+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:33:05.321242+0000","last_undegraded":"2024-09-21T03:33:05.321242+0000","last_fullsized":"2024-09-21T03:33:05.321242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316842+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:33:05.316842+0000","last_peered":"2024-09-21T03:33:05.316842+0000","last_clean":"2024-09-21T03:33:05.316842+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:33:05.316842+0000","last_undegraded":"2024-09-21T03:33:05.316842+0000","last_fullsized":"2024-09-21T03:33:05.316842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318973+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:33:05.318973+0000","last_peered":"2024-09-21T03:33:05.318973+0000","last_clean":"2024-09-21T03:33:05.318973+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:33:05.318973+0000","last_undegraded":"2024-09-21T03:33:05.318973+0000","last_fullsized":"2024-09-21T03:33:05.318973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441068+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:33:05.441068+0000","last_peered":"2024-09-21T03:33:05.441068+0000","last_clean":"2024-09-21T03:33:05.441068+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:33:05.441068+0000","last_undegraded":"2024-09-21T03:33:05.441068+0000","last_fullsized":"2024-09-21T03:33:05.441068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321625+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:33:05.321625+0000","last_peered":"2024-09-21T03:33:05.321625+0000","last_clean":"2024-09-21T03:33:05.321625+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:33:05.321625+0000","last_undegraded":"2024-09-21T03:33:05.321625+0000","last_fullsized":"2024-09-21T03:33:05.321625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444310+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:33:05.444310+0000","last_peered":"2024-09-21T03:33:05.444310+0000","last_clean":"2024-09-21T03:33:05.444310+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:33:05.444310+0000","last_undegraded":"2024-09-21T03:33:05.444310+0000","last_fullsized":"2024-09-21T03:33:05.444310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441669+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:33:05.441669+0000","last_peered":"2024-09-21T03:33:05.441669+0000","last_clean":"2024-09-21T03:33:05.441669+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:33:05.441669+0000","last_undegraded":"2024-09-21T03:33:05.441669+0000","last_fullsized":"2024-09-21T03:33:05.441669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466052+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:33:05.466052+0000","last_peered":"2024-09-21T03:33:05.466052+0000","last_clean":"2024-09-21T03:33:05.466052+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:33:05.466052+0000","last_undegraded":"2024-09-21T03:33:05.466052+0000","last_fullsized":"2024-09-21T03:33:05.466052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466009+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:33:05.466009+0000","last_peered":"2024-09-21T03:33:05.466009+0000","last_clean":"2024-09-21T03:33:05.466009+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:33:05.466009+0000","last_undegraded":"2024-09-21T03:33:05.466009+0000","last_fullsized":"2024-09-21T03:33:05.466009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318295+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:33:05.318295+0000","last_peered":"2024-09-21T03:33:05.318295+0000","last_clean":"2024-09-21T03:33:05.318295+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:33:05.318295+0000","last_undegraded":"2024-09-21T03:33:05.318295+0000","last_fullsized":"2024-09-21T03:33:05.318295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319762+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:33:05.319762+0000","last_peered":"2024-09-21T03:33:05.319762+0000","last_clean":"2024-09-21T03:33:05.319762+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:33:05.319762+0000","last_undegraded":"2024-09-21T03:33:05.319762+0000","last_fullsized":"2024-09-21T03:33:05.319762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466934+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:33:05.466934+0000","last_peered":"2024-09-21T03:33:05.466934+0000","last_clean":"2024-09-21T03:33:05.466934+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:33:05.466934+0000","last_undegraded":"2024-09-21T03:33:05.466934+0000","last_fullsized":"2024-09-21T03:33:05.466934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324849+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:33:05.324849+0000","last_peered":"2024-09-21T03:33:05.324849+0000","last_clean":"2024-09-21T03:33:05.324849+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:33:05.324849+0000","last_undegraded":"2024-09-21T03:33:05.324849+0000","last_fullsized":"2024-09-21T03:33:05.324849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319379+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:33:05.319379+0000","last_peered":"2024-09-21T03:33:05.319379+0000","last_clean":"2024-09-21T03:33:05.319379+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:33:05.319379+0000","last_undegraded":"2024-09-21T03:33:05.319379+0000","last_fullsized":"2024-09-21T03:33:05.319379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441719+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:33:05.441719+0000","last_peered":"2024-09-21T03:33:05.441719+0000","last_clean":"2024-09-21T03:33:05.441719+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:33:05.441719+0000","last_undegraded":"2024-09-21T03:33:05.441719+0000","last_fullsized":"2024-09-21T03:33:05.441719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318623+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:33:05.318623+0000","last_peered":"2024-09-21T03:33:05.318623+0000","last_clean":"2024-09-21T03:33:05.318623+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:33:05.318623+0000","last_undegraded":"2024-09-21T03:33:05.318623+0000","last_fullsized":"2024-09-21T03:33:05.318623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316902+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:33:05.316902+0000","last_peered":"2024-09-21T03:33:05.316902+0000","last_clean":"2024-09-21T03:33:05.316902+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:33:05.316902+0000","last_undegraded":"2024-09-21T03:33:05.316902+0000","last_fullsized":"2024-09-21T03:33:05.316902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318049+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:33:05.318049+0000","last_peered":"2024-09-21T03:33:05.318049+0000","last_clean":"2024-09-21T03:33:05.318049+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:33:05.318049+0000","last_undegraded":"2024-09-21T03:33:05.318049+0000","last_fullsized":"2024-09-21T03:33:05.318049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317363+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:33:05.317363+0000","last_peered":"2024-09-21T03:33:05.317363+0000","last_clean":"2024-09-21T03:33:05.317363+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:33:05.317363+0000","last_undegraded":"2024-09-21T03:33:05.317363+0000","last_fullsized":"2024-09-21T03:33:05.317363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324848+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:33:05.324848+0000","last_peered":"2024-09-21T03:33:05.324848+0000","last_clean":"2024-09-21T03:33:05.324848+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:33:05.324848+0000","last_undegraded":"2024-09-21T03:33:05.324848+0000","last_fullsized":"2024-09-21T03:33:05.324848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319770+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:33:05.319770+0000","last_peered":"2024-09-21T03:33:05.319770+0000","last_clean":"2024-09-21T03:33:05.319770+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:33:05.319770+0000","last_undegraded":"2024-09-21T03:33:05.319770+0000","last_fullsized":"2024-09-21T03:33:05.319770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441391+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:33:05.441391+0000","last_peered":"2024-09-21T03:33:05.441391+0000","last_clean":"2024-09-21T03:33:05.441391+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:33:05.441391+0000","last_undegraded":"2024-09-21T03:33:05.441391+0000","last_fullsized":"2024-09-21T03:33:05.441391+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466288+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:33:05.466288+0000","last_peered":"2024-09-21T03:33:05.466288+0000","last_clean":"2024-09-21T03:33:05.466288+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:33:05.466288+0000","last_undegraded":"2024-09-21T03:33:05.466288+0000","last_fullsized":"2024-09-21T03:33:05.466288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324490+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:33:05.324490+0000","last_peered":"2024-09-21T03:33:05.324490+0000","last_clean":"2024-09-21T03:33:05.324490+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:33:05.324490+0000","last_undegraded":"2024-09-21T03:33:05.324490+0000","last_fullsized":"2024-09-21T03:33:05.324490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324635+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:33:05.324635+0000","last_peered":"2024-09-21T03:33:05.324635+0000","last_clean":"2024-09-21T03:33:05.324635+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:33:05.324635+0000","last_undegraded":"2024-09-21T03:33:05.324635+0000","last_fullsized":"2024-09-21T03:33:05.324635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319007+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:33:05.319007+0000","last_peered":"2024-09-21T03:33:05.319007+0000","last_clean":"2024-09-21T03:33:05.319007+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:33:05.319007+0000","last_undegraded":"2024-09-21T03:33:05.319007+0000","last_fullsized":"2024-09-21T03:33:05.319007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321896+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:33:05.321896+0000","last_peered":"2024-09-21T03:33:05.321896+0000","last_clean":"2024-09-21T03:33:05.321896+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:33:05.321896+0000","last_undegraded":"2024-09-21T03:33:05.321896+0000","last_fullsized":"2024-09-21T03:33:05.321896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:37.511065+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:33:37.511065+0000","last_peered":"2024-09-21T03:33:37.511065+0000","last_clean":"2024-09-21T03:33:37.511065+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:33:37.511065+0000","last_undegraded":"2024-09-21T03:33:37.511065+0000","last_fullsized":"2024-09-21T03:33:37.511065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318361+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:33:05.318361+0000","last_peered":"2024-09-21T03:33:05.318361+0000","last_clean":"2024-09-21T03:33:05.318361+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:33:05.318361+0000","last_undegraded":"2024-09-21T03:33:05.318361+0000","last_fullsized":"2024-09-21T03:33:05.318361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440660+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:33:05.440660+0000","last_peered":"2024-09-21T03:33:05.440660+0000","last_clean":"2024-09-21T03:33:05.440660+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:33:05.440660+0000","last_undegraded":"2024-09-21T03:33:05.440660+0000","last_fullsized":"2024-09-21T03:33:05.440660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441192+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:33:05.441192+0000","last_peered":"2024-09-21T03:33:05.441192+0000","last_clean":"2024-09-21T03:33:05.441192+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:33:05.441192+0000","last_undegraded":"2024-09-21T03:33:05.441192+0000","last_fullsized":"2024-09-21T03:33:05.441192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316911+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:33:05.316911+0000","last_peered":"2024-09-21T03:33:05.316911+0000","last_clean":"2024-09-21T03:33:05.316911+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:33:05.316911+0000","last_undegraded":"2024-09-21T03:33:05.316911+0000","last_fullsized":"2024-09-21T03:33:05.316911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318374+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:33:05.318374+0000","last_peered":"2024-09-21T03:33:05.318374+0000","last_clean":"2024-09-21T03:33:05.318374+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:33:05.318374+0000","last_undegraded":"2024-09-21T03:33:05.318374+0000","last_fullsized":"2024-09-21T03:33:05.318374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466638+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:33:05.466638+0000","last_peered":"2024-09-21T03:33:05.466638+0000","last_clean":"2024-09-21T03:33:05.466638+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:33:05.466638+0000","last_undegraded":"2024-09-21T03:33:05.466638+0000","last_fullsized":"2024-09-21T03:33:05.466638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:33.503783+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:33:33.503783+0000","last_peered":"2024-09-21T03:33:33.503783+0000","last_clean":"2024-09-21T03:33:33.503783+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:33:33.503783+0000","last_undegraded":"2024-09-21T03:33:33.503783+0000","last_fullsized":"2024-09-21T03:33:33.503783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318748+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:33:05.318748+0000","last_peered":"2024-09-21T03:33:05.318748+0000","last_clean":"2024-09-21T03:33:05.318748+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:33:05.318748+0000","last_undegraded":"2024-09-21T03:33:05.318748+0000","last_fullsized":"2024-09-21T03:33:05.318748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321501+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:33:05.321501+0000","last_peered":"2024-09-21T03:33:05.321501+0000","last_clean":"2024-09-21T03:33:05.321501+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:33:05.321501+0000","last_undegraded":"2024-09-21T03:33:05.321501+0000","last_fullsized":"2024-09-21T03:33:05.321501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466540+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:33:05.466540+0000","last_peered":"2024-09-21T03:33:05.466540+0000","last_clean":"2024-09-21T03:33:05.466540+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:33:05.466540+0000","last_undegraded":"2024-09-21T03:33:05.466540+0000","last_fullsized":"2024-09-21T03:33:05.466540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318577+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:33:05.318577+0000","last_peered":"2024-09-21T03:33:05.318577+0000","last_clean":"2024-09-21T03:33:05.318577+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:33:05.318577+0000","last_undegraded":"2024-09-21T03:33:05.318577+0000","last_fullsized":"2024-09-21T03:33:05.318577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318529+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:33:05.318529+0000","last_peered":"2024-09-21T03:33:05.318529+0000","last_clean":"2024-09-21T03:33:05.318529+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:33:05.318529+0000","last_undegraded":"2024-09-21T03:33:05.318529+0000","last_fullsized":"2024-09-21T03:33:05.318529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:34.487026+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:33:34.487026+0000","last_peered":"2024-09-21T03:33:34.487026+0000","last_clean":"2024-09-21T03:33:34.487026+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:33:34.487026+0000","last_undegraded":"2024-09-21T03:33:34.487026+0000","last_fullsized":"2024-09-21T03:33:34.487026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64151,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":172,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322221+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:33:05.322221+0000","last_peered":"2024-09-21T03:33:05.322221+0000","last_clean":"2024-09-21T03:33:05.322221+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:33:05.322221+0000","last_undegraded":"2024-09-21T03:33:05.322221+0000","last_fullsized":"2024-09-21T03:33:05.322221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324823+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:33:05.324823+0000","last_peered":"2024-09-21T03:33:05.324823+0000","last_clean":"2024-09-21T03:33:05.324823+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:33:05.324823+0000","last_undegraded":"2024-09-21T03:33:05.324823+0000","last_fullsized":"2024-09-21T03:33:05.324823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441237+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:33:05.441237+0000","last_peered":"2024-09-21T03:33:05.441237+0000","last_clean":"2024-09-21T03:33:05.441237+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:33:05.441237+0000","last_undegraded":"2024-09-21T03:33:05.441237+0000","last_fullsized":"2024-09-21T03:33:05.441237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.326329+0000","last_change":"2024-09-21T03:33:05.326218+0000","last_active":"2024-09-21T03:33:05.326329+0000","last_peered":"2024-09-21T03:33:05.326329+0000","last_clean":"2024-09-21T03:33:05.326329+0000","last_became_active":"2024-09-21T03:33:05.322733+0000","last_became_peered":"2024-09-21T03:33:05.322733+0000","last_unstale":"2024-09-21T03:33:05.326329+0000","last_undegraded":"2024-09-21T03:33:05.326329+0000","last_fullsized":"2024-09-21T03:33:05.326329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:13.114223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,7],"acting":[11,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321626+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:33:05.321626+0000","last_peered":"2024-09-21T03:33:05.321626+0000","last_clean":"2024-09-21T03:33:05.321626+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:33:05.321626+0000","last_undegraded":"2024-09-21T03:33:05.321626+0000","last_fullsized":"2024-09-21T03:33:05.321626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:33.503772+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:33:33.503772+0000","last_peered":"2024-09-21T03:33:33.503772+0000","last_clean":"2024-09-21T03:33:33.503772+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:33:33.503772+0000","last_undegraded":"2024-09-21T03:33:33.503772+0000","last_fullsized":"2024-09-21T03:33:33.503772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321173+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:33:05.321173+0000","last_peered":"2024-09-21T03:33:05.321173+0000","last_clean":"2024-09-21T03:33:05.321173+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:33:05.321173+0000","last_undegraded":"2024-09-21T03:33:05.321173+0000","last_fullsized":"2024-09-21T03:33:05.321173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321890+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:33:05.321890+0000","last_peered":"2024-09-21T03:33:05.321890+0000","last_clean":"2024-09-21T03:33:05.321890+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:33:05.321890+0000","last_undegraded":"2024-09-21T03:33:05.321890+0000","last_fullsized":"2024-09-21T03:33:05.321890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318114+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:33:05.318114+0000","last_peered":"2024-09-21T03:33:05.318114+0000","last_clean":"2024-09-21T03:33:05.318114+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:33:05.318114+0000","last_undegraded":"2024-09-21T03:33:05.318114+0000","last_fullsized":"2024-09-21T03:33:05.318114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322700+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:33:05.322700+0000","last_peered":"2024-09-21T03:33:05.322700+0000","last_clean":"2024-09-21T03:33:05.322700+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:33:05.322700+0000","last_undegraded":"2024-09-21T03:33:05.322700+0000","last_fullsized":"2024-09-21T03:33:05.322700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319694+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:33:05.319694+0000","last_peered":"2024-09-21T03:33:05.319694+0000","last_clean":"2024-09-21T03:33:05.319694+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:33:05.319694+0000","last_undegraded":"2024-09-21T03:33:05.319694+0000","last_fullsized":"2024-09-21T03:33:05.319694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441421+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:33:05.441421+0000","last_peered":"2024-09-21T03:33:05.441421+0000","last_clean":"2024-09-21T03:33:05.441421+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:33:05.441421+0000","last_undegraded":"2024-09-21T03:33:05.441421+0000","last_fullsized":"2024-09-21T03:33:05.441421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321593+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:33:05.321593+0000","last_peered":"2024-09-21T03:33:05.321593+0000","last_clean":"2024-09-21T03:33:05.321593+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:33:05.321593+0000","last_undegraded":"2024-09-21T03:33:05.321593+0000","last_fullsized":"2024-09-21T03:33:05.321593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318630+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:33:05.318630+0000","last_peered":"2024-09-21T03:33:05.318630+0000","last_clean":"2024-09-21T03:33:05.318630+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:33:05.318630+0000","last_undegraded":"2024-09-21T03:33:05.318630+0000","last_fullsized":"2024-09-21T03:33:05.318630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321378+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:33:05.321378+0000","last_peered":"2024-09-21T03:33:05.321378+0000","last_clean":"2024-09-21T03:33:05.321378+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:33:05.321378+0000","last_undegraded":"2024-09-21T03:33:05.321378+0000","last_fullsized":"2024-09-21T03:33:05.321378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.325029+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:33:05.325029+0000","last_peered":"2024-09-21T03:33:05.325029+0000","last_clean":"2024-09-21T03:33:05.325029+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:33:05.325029+0000","last_undegraded":"2024-09-21T03:33:05.325029+0000","last_fullsized":"2024-09-21T03:33:05.325029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321617+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:33:05.321617+0000","last_peered":"2024-09-21T03:33:05.321617+0000","last_clean":"2024-09-21T03:33:05.321617+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:33:05.321617+0000","last_undegraded":"2024-09-21T03:33:05.321617+0000","last_fullsized":"2024-09-21T03:33:05.321617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321464+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:33:05.321464+0000","last_peered":"2024-09-21T03:33:05.321464+0000","last_clean":"2024-09-21T03:33:05.321464+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:33:05.321464+0000","last_undegraded":"2024-09-21T03:33:05.321464+0000","last_fullsized":"2024-09-21T03:33:05.321464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444622+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:33:05.444622+0000","last_peered":"2024-09-21T03:33:05.444622+0000","last_clean":"2024-09-21T03:33:05.444622+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:33:05.444622+0000","last_undegraded":"2024-09-21T03:33:05.444622+0000","last_fullsized":"2024-09-21T03:33:05.444622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317046+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:33:05.317046+0000","last_peered":"2024-09-21T03:33:05.317046+0000","last_clean":"2024-09-21T03:33:05.317046+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:33:05.317046+0000","last_undegraded":"2024-09-21T03:33:05.317046+0000","last_fullsized":"2024-09-21T03:33:05.317046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321348+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:33:05.321348+0000","last_peered":"2024-09-21T03:33:05.321348+0000","last_clean":"2024-09-21T03:33:05.321348+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:33:05.321348+0000","last_undegraded":"2024-09-21T03:33:05.321348+0000","last_fullsized":"2024-09-21T03:33:05.321348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441177+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:33:05.441177+0000","last_peered":"2024-09-21T03:33:05.441177+0000","last_clean":"2024-09-21T03:33:05.441177+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:33:05.441177+0000","last_undegraded":"2024-09-21T03:33:05.441177+0000","last_fullsized":"2024-09-21T03:33:05.441177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:34.504961+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:33:34.504961+0000","last_peered":"2024-09-21T03:33:34.504961+0000","last_clean":"2024-09-21T03:33:34.504961+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:33:34.504961+0000","last_undegraded":"2024-09-21T03:33:34.504961+0000","last_fullsized":"2024-09-21T03:33:34.504961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318116+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:33:05.318116+0000","last_peered":"2024-09-21T03:33:05.318116+0000","last_clean":"2024-09-21T03:33:05.318116+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:33:05.318116+0000","last_undegraded":"2024-09-21T03:33:05.318116+0000","last_fullsized":"2024-09-21T03:33:05.318116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321755+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:33:05.321755+0000","last_peered":"2024-09-21T03:33:05.321755+0000","last_clean":"2024-09-21T03:33:05.321755+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:33:05.321755+0000","last_undegraded":"2024-09-21T03:33:05.321755+0000","last_fullsized":"2024-09-21T03:33:05.321755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440795+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:33:05.440795+0000","last_peered":"2024-09-21T03:33:05.440795+0000","last_clean":"2024-09-21T03:33:05.440795+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:33:05.440795+0000","last_undegraded":"2024-09-21T03:33:05.440795+0000","last_fullsized":"2024-09-21T03:33:05.440795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466828+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:33:05.466828+0000","last_peered":"2024-09-21T03:33:05.466828+0000","last_clean":"2024-09-21T03:33:05.466828+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:33:05.466828+0000","last_undegraded":"2024-09-21T03:33:05.466828+0000","last_fullsized":"2024-09-21T03:33:05.466828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440761+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:33:05.440761+0000","last_peered":"2024-09-21T03:33:05.440761+0000","last_clean":"2024-09-21T03:33:05.440761+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:33:05.440761+0000","last_undegraded":"2024-09-21T03:33:05.440761+0000","last_fullsized":"2024-09-21T03:33:05.440761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319381+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:33:05.319381+0000","last_peered":"2024-09-21T03:33:05.319381+0000","last_clean":"2024-09-21T03:33:05.319381+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:33:05.319381+0000","last_undegraded":"2024-09-21T03:33:05.319381+0000","last_fullsized":"2024-09-21T03:33:05.319381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441554+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:33:05.441554+0000","last_peered":"2024-09-21T03:33:05.441554+0000","last_clean":"2024-09-21T03:33:05.441554+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:33:05.441554+0000","last_undegraded":"2024-09-21T03:33:05.441554+0000","last_fullsized":"2024-09-21T03:33:05.441554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'11","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.467005+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:33:05.467005+0000","last_peered":"2024-09-21T03:33:05.467005+0000","last_clean":"2024-09-21T03:33:05.467005+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:33:05.467005+0000","last_undegraded":"2024-09-21T03:33:05.467005+0000","last_fullsized":"2024-09-21T03:33:05.467005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317394+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:33:05.317394+0000","last_peered":"2024-09-21T03:33:05.317394+0000","last_clean":"2024-09-21T03:33:05.317394+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:33:05.317394+0000","last_undegraded":"2024-09-21T03:33:05.317394+0000","last_fullsized":"2024-09-21T03:33:05.317394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444578+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:33:05.444578+0000","last_peered":"2024-09-21T03:33:05.444578+0000","last_clean":"2024-09-21T03:33:05.444578+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:33:05.444578+0000","last_undegraded":"2024-09-21T03:33:05.444578+0000","last_fullsized":"2024-09-21T03:33:05.444578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466341+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:33:05.466341+0000","last_peered":"2024-09-21T03:33:05.466341+0000","last_clean":"2024-09-21T03:33:05.466341+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:33:05.466341+0000","last_undegraded":"2024-09-21T03:33:05.466341+0000","last_fullsized":"2024-09-21T03:33:05.466341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318441+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:33:05.318441+0000","last_peered":"2024-09-21T03:33:05.318441+0000","last_clean":"2024-09-21T03:33:05.318441+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:33:05.318441+0000","last_undegraded":"2024-09-21T03:33:05.318441+0000","last_fullsized":"2024-09-21T03:33:05.318441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321881+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:33:05.321881+0000","last_peered":"2024-09-21T03:33:05.321881+0000","last_clean":"2024-09-21T03:33:05.321881+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:33:05.321881+0000","last_undegraded":"2024-09-21T03:33:05.321881+0000","last_fullsized":"2024-09-21T03:33:05.321881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317034+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:33:05.317034+0000","last_peered":"2024-09-21T03:33:05.317034+0000","last_clean":"2024-09-21T03:33:05.317034+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:33:05.317034+0000","last_undegraded":"2024-09-21T03:33:05.317034+0000","last_fullsized":"2024-09-21T03:33:05.317034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319135+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:33:05.319135+0000","last_peered":"2024-09-21T03:33:05.319135+0000","last_clean":"2024-09-21T03:33:05.319135+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:33:05.319135+0000","last_undegraded":"2024-09-21T03:33:05.319135+0000","last_fullsized":"2024-09-21T03:33:05.319135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324613+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:33:05.324613+0000","last_peered":"2024-09-21T03:33:05.324613+0000","last_clean":"2024-09-21T03:33:05.324613+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:33:05.324613+0000","last_undegraded":"2024-09-21T03:33:05.324613+0000","last_fullsized":"2024-09-21T03:33:05.324613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317009+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:33:05.317009+0000","last_peered":"2024-09-21T03:33:05.317009+0000","last_clean":"2024-09-21T03:33:05.317009+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:33:05.317009+0000","last_undegraded":"2024-09-21T03:33:05.317009+0000","last_fullsized":"2024-09-21T03:33:05.317009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.450356+0000","last_change":"2024-09-21T03:33:05.450237+0000","last_active":"2024-09-21T03:33:05.450356+0000","last_peered":"2024-09-21T03:33:05.450356+0000","last_clean":"2024-09-21T03:33:05.450356+0000","last_became_active":"2024-09-21T03:33:05.445378+0000","last_became_peered":"2024-09-21T03:33:05.445378+0000","last_unstale":"2024-09-21T03:33:05.450356+0000","last_undegraded":"2024-09-21T03:33:05.450356+0000","last_fullsized":"2024-09-21T03:33:05.450356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:54.926407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321563+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:33:05.321563+0000","last_peered":"2024-09-21T03:33:05.321563+0000","last_clean":"2024-09-21T03:33:05.321563+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:33:05.321563+0000","last_undegraded":"2024-09-21T03:33:05.321563+0000","last_fullsized":"2024-09-21T03:33:05.321563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318427+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:33:05.318427+0000","last_peered":"2024-09-21T03:33:05.318427+0000","last_clean":"2024-09-21T03:33:05.318427+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:33:05.318427+0000","last_undegraded":"2024-09-21T03:33:05.318427+0000","last_fullsized":"2024-09-21T03:33:05.318427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322293+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:33:05.322293+0000","last_peered":"2024-09-21T03:33:05.322293+0000","last_clean":"2024-09-21T03:33:05.322293+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:33:05.322293+0000","last_undegraded":"2024-09-21T03:33:05.322293+0000","last_fullsized":"2024-09-21T03:33:05.322293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318518+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:33:05.318518+0000","last_peered":"2024-09-21T03:33:05.318518+0000","last_clean":"2024-09-21T03:33:05.318518+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:33:05.318518+0000","last_undegraded":"2024-09-21T03:33:05.318518+0000","last_fullsized":"2024-09-21T03:33:05.318518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322363+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:33:05.322363+0000","last_peered":"2024-09-21T03:33:05.322363+0000","last_clean":"2024-09-21T03:33:05.322363+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:33:05.322363+0000","last_undegraded":"2024-09-21T03:33:05.322363+0000","last_fullsized":"2024-09-21T03:33:05.322363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466524+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:33:05.466524+0000","last_peered":"2024-09-21T03:33:05.466524+0000","last_clean":"2024-09-21T03:33:05.466524+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:33:05.466524+0000","last_undegraded":"2024-09-21T03:33:05.466524+0000","last_fullsized":"2024-09-21T03:33:05.466524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317477+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:33:05.317477+0000","last_peered":"2024-09-21T03:33:05.317477+0000","last_clean":"2024-09-21T03:33:05.317477+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:33:05.317477+0000","last_undegraded":"2024-09-21T03:33:05.317477+0000","last_fullsized":"2024-09-21T03:33:05.317477+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317308+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:33:05.317308+0000","last_peered":"2024-09-21T03:33:05.317308+0000","last_clean":"2024-09-21T03:33:05.317308+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:33:05.317308+0000","last_undegraded":"2024-09-21T03:33:05.317308+0000","last_fullsized":"2024-09-21T03:33:05.317308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466960+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:33:05.466960+0000","last_peered":"2024-09-21T03:33:05.466960+0000","last_clean":"2024-09-21T03:33:05.466960+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:33:05.466960+0000","last_undegraded":"2024-09-21T03:33:05.466960+0000","last_fullsized":"2024-09-21T03:33:05.466960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68825,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":661,"num_read_kb":402,"num_write":171,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206475,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678054,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":441581,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1097723,"data_compressed":49335,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037807,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":441795,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":441693,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":1034318,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":441184,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":954368,"data_stored":1033470,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":442265,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117070,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":441495,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":506898,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":505128,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":442455,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64151,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65921,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66261,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:33:41.782 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:33:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:41 smithi121 ceph-mon[34316]: pgmap v327: 97 pgs: 97 active+clean; 644 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:33:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:41 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3313669426' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:41.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 -- 172.21.15.102:0/1019908510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 msgr2=0x7fbe1c1086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/1019908510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c1086d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009900 tx=0x7fbe1802a410 comp rx=0 tx=0).stop 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 -- 172.21.15.102:0/1019908510 shutdown_connections 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/1019908510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c1086d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/1019908510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c10f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/1019908510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 0x7fbe1c102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 -- 172.21.15.102:0/1019908510 >> 172.21.15.102:0/1019908510 conn(0x7fbe1c0fe350 msgr2=0x7fbe1c1007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 -- 172.21.15.102:0/1019908510 shutdown_connections 2024-09-21T03:33:41.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.925+0000 7fbe23c1f640 1 -- 172.21.15.102:0/1019908510 wait complete. 2024-09-21T03:33:41.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 Processor -- start 2024-09-21T03:33:41.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 -- start start 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 0x7fbe1c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c112ab0 con 0x7fbe1c1082c0 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c112930 con 0x7fbe1c102990 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe23c1f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1c112c30 con 0x7fbe1c108c10 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe211ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe211ba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58710/0 (socket says 172.21.15.102:58710) 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.926+0000 7fbe211ba640 1 -- 172.21.15.102:0/2091491098 learned_addr learned my addr 172.21.15.102:0/2091491098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe219bb640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 0x7fbe1c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 -- 172.21.15.102:0/2091491098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 msgr2=0x7fbe1c19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe221bc640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 -- 172.21.15.102:0/2091491098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 msgr2=0x7fbe1c19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 0x7fbe1c19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 -- 172.21.15.102:0/2091491098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1c1a66d0 con 0x7fbe1c1082c0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe221bc640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe211ba640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005940 tx=0x7fbe18004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1803f030 con 0x7fbe1c1082c0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbe18003cd0 con 0x7fbe1c1082c0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1c1a6960 con 0x7fbe1c1082c0 2024-09-21T03:33:41.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe18035070 con 0x7fbe1c1082c0 2024-09-21T03:33:41.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.927+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe1c1a6ed0 con 0x7fbe1c1082c0 2024-09-21T03:33:41.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.928+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1c102e20 con 0x7fbe1c1082c0 2024-09-21T03:33:41.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.930+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fbe18042030 con 0x7fbe1c1082c0 2024-09-21T03:33:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.930+0000 7fbe12ffd640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 0x7fbe080b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.931+0000 7fbe219bb640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 0x7fbe080b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.931+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbe18107ea0 con 0x7fbe1c1082c0 2024-09-21T03:33:41.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.931+0000 7fbe219bb640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 0x7fbe080b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c06c490 tx=0x7fbe0c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:41.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:41.934+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe180ce600 con 0x7fbe1c1082c0 2024-09-21T03:33:42.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.107+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe1c1071a0 con 0x7fbe080b6560 2024-09-21T03:33:42.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.112+0000 7fbe12ffd640 1 -- 172.21.15.102:0/2091491098 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259136 (secure 0 0 0) 0x7fbe1c1071a0 con 0x7fbe080b6560 2024-09-21T03:33:42.116 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:42.117 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:33:42.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 msgr2=0x7fbe080b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 0x7fbe080b8a70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c06c490 tx=0x7fbe0c008040 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 msgr2=0x7fbe1c19b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbe18005940 tx=0x7fbe18004360 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 shutdown_connections 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbe080b6560 0x7fbe080b8a70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbe1c1082c0 0x7fbe1c19b980 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbe1c108c10 0x7fbe1c19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 --2- 172.21.15.102:0/2091491098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbe1c102990 0x7fbe1c19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 >> 172.21.15.102:0/2091491098 conn(0x7fbe1c0fe350 msgr2=0x7fbe1c106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 shutdown_connections 2024-09-21T03:33:42.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.115+0000 7fbe23c1f640 1 -- 172.21.15.102:0/2091491098 wait complete. 2024-09-21T03:33:42.128 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-21T03:33:40.249625+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659427,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":742,"num_read_kb":471,"num_write":296,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":740,"ondisk_log_size":740,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360104,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581720,"statfs":{"total":1151940427776,"available":1151571681280,"internally_reserved":0,"allocated":11059200,"data_stored":7270005,"data_compressed":251955,"data_compressed_allocated":344064,"data_compressed_original":2187264,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003377"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319714+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:33:05.319714+0000","last_peered":"2024-09-21T03:33:05.319714+0000","last_clean":"2024-09-21T03:33:05.319714+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:33:05.319714+0000","last_undegraded":"2024-09-21T03:33:05.319714+0000","last_fullsized":"2024-09-21T03:33:05.319714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466400+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:33:05.466400+0000","last_peered":"2024-09-21T03:33:05.466400+0000","last_clean":"2024-09-21T03:33:05.466400+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:33:05.466400+0000","last_undegraded":"2024-09-21T03:33:05.466400+0000","last_fullsized":"2024-09-21T03:33:05.466400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466309+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:33:05.466309+0000","last_peered":"2024-09-21T03:33:05.466309+0000","last_clean":"2024-09-21T03:33:05.466309+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:33:05.466309+0000","last_undegraded":"2024-09-21T03:33:05.466309+0000","last_fullsized":"2024-09-21T03:33:05.466309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444188+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:33:05.444188+0000","last_peered":"2024-09-21T03:33:05.444188+0000","last_clean":"2024-09-21T03:33:05.444188+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:33:05.444188+0000","last_undegraded":"2024-09-21T03:33:05.444188+0000","last_fullsized":"2024-09-21T03:33:05.444188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321904+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:33:05.321904+0000","last_peered":"2024-09-21T03:33:05.321904+0000","last_clean":"2024-09-21T03:33:05.321904+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:33:05.321904+0000","last_undegraded":"2024-09-21T03:33:05.321904+0000","last_fullsized":"2024-09-21T03:33:05.321904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440600+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:33:05.440600+0000","last_peered":"2024-09-21T03:33:05.440600+0000","last_clean":"2024-09-21T03:33:05.440600+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:33:05.440600+0000","last_undegraded":"2024-09-21T03:33:05.440600+0000","last_fullsized":"2024-09-21T03:33:05.440600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321242+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:33:05.321242+0000","last_peered":"2024-09-21T03:33:05.321242+0000","last_clean":"2024-09-21T03:33:05.321242+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:33:05.321242+0000","last_undegraded":"2024-09-21T03:33:05.321242+0000","last_fullsized":"2024-09-21T03:33:05.321242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316842+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:33:05.316842+0000","last_peered":"2024-09-21T03:33:05.316842+0000","last_clean":"2024-09-21T03:33:05.316842+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:33:05.316842+0000","last_undegraded":"2024-09-21T03:33:05.316842+0000","last_fullsized":"2024-09-21T03:33:05.316842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318973+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:33:05.318973+0000","last_peered":"2024-09-21T03:33:05.318973+0000","last_clean":"2024-09-21T03:33:05.318973+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:33:05.318973+0000","last_undegraded":"2024-09-21T03:33:05.318973+0000","last_fullsized":"2024-09-21T03:33:05.318973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441068+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:33:05.441068+0000","last_peered":"2024-09-21T03:33:05.441068+0000","last_clean":"2024-09-21T03:33:05.441068+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:33:05.441068+0000","last_undegraded":"2024-09-21T03:33:05.441068+0000","last_fullsized":"2024-09-21T03:33:05.441068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321625+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:33:05.321625+0000","last_peered":"2024-09-21T03:33:05.321625+0000","last_clean":"2024-09-21T03:33:05.321625+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:33:05.321625+0000","last_undegraded":"2024-09-21T03:33:05.321625+0000","last_fullsized":"2024-09-21T03:33:05.321625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444310+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:33:05.444310+0000","last_peered":"2024-09-21T03:33:05.444310+0000","last_clean":"2024-09-21T03:33:05.444310+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:33:05.444310+0000","last_undegraded":"2024-09-21T03:33:05.444310+0000","last_fullsized":"2024-09-21T03:33:05.444310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441669+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:33:05.441669+0000","last_peered":"2024-09-21T03:33:05.441669+0000","last_clean":"2024-09-21T03:33:05.441669+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:33:05.441669+0000","last_undegraded":"2024-09-21T03:33:05.441669+0000","last_fullsized":"2024-09-21T03:33:05.441669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466052+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:33:05.466052+0000","last_peered":"2024-09-21T03:33:05.466052+0000","last_clean":"2024-09-21T03:33:05.466052+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:33:05.466052+0000","last_undegraded":"2024-09-21T03:33:05.466052+0000","last_fullsized":"2024-09-21T03:33:05.466052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466009+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:33:05.466009+0000","last_peered":"2024-09-21T03:33:05.466009+0000","last_clean":"2024-09-21T03:33:05.466009+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:33:05.466009+0000","last_undegraded":"2024-09-21T03:33:05.466009+0000","last_fullsized":"2024-09-21T03:33:05.466009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318295+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:33:05.318295+0000","last_peered":"2024-09-21T03:33:05.318295+0000","last_clean":"2024-09-21T03:33:05.318295+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:33:05.318295+0000","last_undegraded":"2024-09-21T03:33:05.318295+0000","last_fullsized":"2024-09-21T03:33:05.318295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319762+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:33:05.319762+0000","last_peered":"2024-09-21T03:33:05.319762+0000","last_clean":"2024-09-21T03:33:05.319762+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:33:05.319762+0000","last_undegraded":"2024-09-21T03:33:05.319762+0000","last_fullsized":"2024-09-21T03:33:05.319762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466934+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:33:05.466934+0000","last_peered":"2024-09-21T03:33:05.466934+0000","last_clean":"2024-09-21T03:33:05.466934+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:33:05.466934+0000","last_undegraded":"2024-09-21T03:33:05.466934+0000","last_fullsized":"2024-09-21T03:33:05.466934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324849+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:33:05.324849+0000","last_peered":"2024-09-21T03:33:05.324849+0000","last_clean":"2024-09-21T03:33:05.324849+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:33:05.324849+0000","last_undegraded":"2024-09-21T03:33:05.324849+0000","last_fullsized":"2024-09-21T03:33:05.324849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319379+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:33:05.319379+0000","last_peered":"2024-09-21T03:33:05.319379+0000","last_clean":"2024-09-21T03:33:05.319379+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:33:05.319379+0000","last_undegraded":"2024-09-21T03:33:05.319379+0000","last_fullsized":"2024-09-21T03:33:05.319379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441719+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:33:05.441719+0000","last_peered":"2024-09-21T03:33:05.441719+0000","last_clean":"2024-09-21T03:33:05.441719+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:33:05.441719+0000","last_undegraded":"2024-09-21T03:33:05.441719+0000","last_fullsized":"2024-09-21T03:33:05.441719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318623+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:33:05.318623+0000","last_peered":"2024-09-21T03:33:05.318623+0000","last_clean":"2024-09-21T03:33:05.318623+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:33:05.318623+0000","last_undegraded":"2024-09-21T03:33:05.318623+0000","last_fullsized":"2024-09-21T03:33:05.318623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316902+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:33:05.316902+0000","last_peered":"2024-09-21T03:33:05.316902+0000","last_clean":"2024-09-21T03:33:05.316902+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:33:05.316902+0000","last_undegraded":"2024-09-21T03:33:05.316902+0000","last_fullsized":"2024-09-21T03:33:05.316902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318049+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:33:05.318049+0000","last_peered":"2024-09-21T03:33:05.318049+0000","last_clean":"2024-09-21T03:33:05.318049+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:33:05.318049+0000","last_undegraded":"2024-09-21T03:33:05.318049+0000","last_fullsized":"2024-09-21T03:33:05.318049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317363+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:33:05.317363+0000","last_peered":"2024-09-21T03:33:05.317363+0000","last_clean":"2024-09-21T03:33:05.317363+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:33:05.317363+0000","last_undegraded":"2024-09-21T03:33:05.317363+0000","last_fullsized":"2024-09-21T03:33:05.317363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324848+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:33:05.324848+0000","last_peered":"2024-09-21T03:33:05.324848+0000","last_clean":"2024-09-21T03:33:05.324848+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:33:05.324848+0000","last_undegraded":"2024-09-21T03:33:05.324848+0000","last_fullsized":"2024-09-21T03:33:05.324848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319770+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:33:05.319770+0000","last_peered":"2024-09-21T03:33:05.319770+0000","last_clean":"2024-09-21T03:33:05.319770+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:33:05.319770+0000","last_undegraded":"2024-09-21T03:33:05.319770+0000","last_fullsized":"2024-09-21T03:33:05.319770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441391+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:33:05.441391+0000","last_peered":"2024-09-21T03:33:05.441391+0000","last_clean":"2024-09-21T03:33:05.441391+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:33:05.441391+0000","last_undegraded":"2024-09-21T03:33:05.441391+0000","last_fullsized":"2024-09-21T03:33:05.441391+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466288+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:33:05.466288+0000","last_peered":"2024-09-21T03:33:05.466288+0000","last_clean":"2024-09-21T03:33:05.466288+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:33:05.466288+0000","last_undegraded":"2024-09-21T03:33:05.466288+0000","last_fullsized":"2024-09-21T03:33:05.466288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324490+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:33:05.324490+0000","last_peered":"2024-09-21T03:33:05.324490+0000","last_clean":"2024-09-21T03:33:05.324490+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:33:05.324490+0000","last_undegraded":"2024-09-21T03:33:05.324490+0000","last_fullsized":"2024-09-21T03:33:05.324490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324635+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:33:05.324635+0000","last_peered":"2024-09-21T03:33:05.324635+0000","last_clean":"2024-09-21T03:33:05.324635+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:33:05.324635+0000","last_undegraded":"2024-09-21T03:33:05.324635+0000","last_fullsized":"2024-09-21T03:33:05.324635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319007+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:33:05.319007+0000","last_peered":"2024-09-21T03:33:05.319007+0000","last_clean":"2024-09-21T03:33:05.319007+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:33:05.319007+0000","last_undegraded":"2024-09-21T03:33:05.319007+0000","last_fullsized":"2024-09-21T03:33:05.319007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321896+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:33:05.321896+0000","last_peered":"2024-09-21T03:33:05.321896+0000","last_clean":"2024-09-21T03:33:05.321896+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:33:05.321896+0000","last_undegraded":"2024-09-21T03:33:05.321896+0000","last_fullsized":"2024-09-21T03:33:05.321896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:37.511065+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:33:37.511065+0000","last_peered":"2024-09-21T03:33:37.511065+0000","last_clean":"2024-09-21T03:33:37.511065+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:33:37.511065+0000","last_undegraded":"2024-09-21T03:33:37.511065+0000","last_fullsized":"2024-09-21T03:33:37.511065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318361+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:33:05.318361+0000","last_peered":"2024-09-21T03:33:05.318361+0000","last_clean":"2024-09-21T03:33:05.318361+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:33:05.318361+0000","last_undegraded":"2024-09-21T03:33:05.318361+0000","last_fullsized":"2024-09-21T03:33:05.318361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440660+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:33:05.440660+0000","last_peered":"2024-09-21T03:33:05.440660+0000","last_clean":"2024-09-21T03:33:05.440660+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:33:05.440660+0000","last_undegraded":"2024-09-21T03:33:05.440660+0000","last_fullsized":"2024-09-21T03:33:05.440660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441192+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:33:05.441192+0000","last_peered":"2024-09-21T03:33:05.441192+0000","last_clean":"2024-09-21T03:33:05.441192+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:33:05.441192+0000","last_undegraded":"2024-09-21T03:33:05.441192+0000","last_fullsized":"2024-09-21T03:33:05.441192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316911+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:33:05.316911+0000","last_peered":"2024-09-21T03:33:05.316911+0000","last_clean":"2024-09-21T03:33:05.316911+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:33:05.316911+0000","last_undegraded":"2024-09-21T03:33:05.316911+0000","last_fullsized":"2024-09-21T03:33:05.316911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318374+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:33:05.318374+0000","last_peered":"2024-09-21T03:33:05.318374+0000","last_clean":"2024-09-21T03:33:05.318374+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:33:05.318374+0000","last_undegraded":"2024-09-21T03:33:05.318374+0000","last_fullsized":"2024-09-21T03:33:05.318374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466638+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:33:05.466638+0000","last_peered":"2024-09-21T03:33:05.466638+0000","last_clean":"2024-09-21T03:33:05.466638+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:33:05.466638+0000","last_undegraded":"2024-09-21T03:33:05.466638+0000","last_fullsized":"2024-09-21T03:33:05.466638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":135,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:33.503783+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:33:33.503783+0000","last_peered":"2024-09-21T03:33:33.503783+0000","last_clean":"2024-09-21T03:33:33.503783+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:33:33.503783+0000","last_undegraded":"2024-09-21T03:33:33.503783+0000","last_fullsized":"2024-09-21T03:33:33.503783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318748+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:33:05.318748+0000","last_peered":"2024-09-21T03:33:05.318748+0000","last_clean":"2024-09-21T03:33:05.318748+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:33:05.318748+0000","last_undegraded":"2024-09-21T03:33:05.318748+0000","last_fullsized":"2024-09-21T03:33:05.318748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321501+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:33:05.321501+0000","last_peered":"2024-09-21T03:33:05.321501+0000","last_clean":"2024-09-21T03:33:05.321501+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:33:05.321501+0000","last_undegraded":"2024-09-21T03:33:05.321501+0000","last_fullsized":"2024-09-21T03:33:05.321501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466540+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:33:05.466540+0000","last_peered":"2024-09-21T03:33:05.466540+0000","last_clean":"2024-09-21T03:33:05.466540+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:33:05.466540+0000","last_undegraded":"2024-09-21T03:33:05.466540+0000","last_fullsized":"2024-09-21T03:33:05.466540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318577+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:33:05.318577+0000","last_peered":"2024-09-21T03:33:05.318577+0000","last_clean":"2024-09-21T03:33:05.318577+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:33:05.318577+0000","last_undegraded":"2024-09-21T03:33:05.318577+0000","last_fullsized":"2024-09-21T03:33:05.318577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318529+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:33:05.318529+0000","last_peered":"2024-09-21T03:33:05.318529+0000","last_clean":"2024-09-21T03:33:05.318529+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:33:05.318529+0000","last_undegraded":"2024-09-21T03:33:05.318529+0000","last_fullsized":"2024-09-21T03:33:05.318529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'31","reported_seq":277,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:34.487026+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:33:34.487026+0000","last_peered":"2024-09-21T03:33:34.487026+0000","last_clean":"2024-09-21T03:33:34.487026+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:33:34.487026+0000","last_undegraded":"2024-09-21T03:33:34.487026+0000","last_fullsized":"2024-09-21T03:33:34.487026+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64151,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":172,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322221+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:33:05.322221+0000","last_peered":"2024-09-21T03:33:05.322221+0000","last_clean":"2024-09-21T03:33:05.322221+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:33:05.322221+0000","last_undegraded":"2024-09-21T03:33:05.322221+0000","last_fullsized":"2024-09-21T03:33:05.322221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324823+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:33:05.324823+0000","last_peered":"2024-09-21T03:33:05.324823+0000","last_clean":"2024-09-21T03:33:05.324823+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:33:05.324823+0000","last_undegraded":"2024-09-21T03:33:05.324823+0000","last_fullsized":"2024-09-21T03:33:05.324823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441237+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:33:05.441237+0000","last_peered":"2024-09-21T03:33:05.441237+0000","last_clean":"2024-09-21T03:33:05.441237+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:33:05.441237+0000","last_undegraded":"2024-09-21T03:33:05.441237+0000","last_fullsized":"2024-09-21T03:33:05.441237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.326329+0000","last_change":"2024-09-21T03:33:05.326218+0000","last_active":"2024-09-21T03:33:05.326329+0000","last_peered":"2024-09-21T03:33:05.326329+0000","last_clean":"2024-09-21T03:33:05.326329+0000","last_became_active":"2024-09-21T03:33:05.322733+0000","last_became_peered":"2024-09-21T03:33:05.322733+0000","last_unstale":"2024-09-21T03:33:05.326329+0000","last_undegraded":"2024-09-21T03:33:05.326329+0000","last_fullsized":"2024-09-21T03:33:05.326329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:13.114223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,7],"acting":[11,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321626+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:33:05.321626+0000","last_peered":"2024-09-21T03:33:05.321626+0000","last_clean":"2024-09-21T03:33:05.321626+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:33:05.321626+0000","last_undegraded":"2024-09-21T03:33:05.321626+0000","last_fullsized":"2024-09-21T03:33:05.321626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:33.503772+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:33:33.503772+0000","last_peered":"2024-09-21T03:33:33.503772+0000","last_clean":"2024-09-21T03:33:33.503772+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:33:33.503772+0000","last_undegraded":"2024-09-21T03:33:33.503772+0000","last_fullsized":"2024-09-21T03:33:33.503772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321173+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:33:05.321173+0000","last_peered":"2024-09-21T03:33:05.321173+0000","last_clean":"2024-09-21T03:33:05.321173+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:33:05.321173+0000","last_undegraded":"2024-09-21T03:33:05.321173+0000","last_fullsized":"2024-09-21T03:33:05.321173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321890+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:33:05.321890+0000","last_peered":"2024-09-21T03:33:05.321890+0000","last_clean":"2024-09-21T03:33:05.321890+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:33:05.321890+0000","last_undegraded":"2024-09-21T03:33:05.321890+0000","last_fullsized":"2024-09-21T03:33:05.321890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318114+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:33:05.318114+0000","last_peered":"2024-09-21T03:33:05.318114+0000","last_clean":"2024-09-21T03:33:05.318114+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:33:05.318114+0000","last_undegraded":"2024-09-21T03:33:05.318114+0000","last_fullsized":"2024-09-21T03:33:05.318114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322700+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:33:05.322700+0000","last_peered":"2024-09-21T03:33:05.322700+0000","last_clean":"2024-09-21T03:33:05.322700+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:33:05.322700+0000","last_undegraded":"2024-09-21T03:33:05.322700+0000","last_fullsized":"2024-09-21T03:33:05.322700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319694+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:33:05.319694+0000","last_peered":"2024-09-21T03:33:05.319694+0000","last_clean":"2024-09-21T03:33:05.319694+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:33:05.319694+0000","last_undegraded":"2024-09-21T03:33:05.319694+0000","last_fullsized":"2024-09-21T03:33:05.319694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441421+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:33:05.441421+0000","last_peered":"2024-09-21T03:33:05.441421+0000","last_clean":"2024-09-21T03:33:05.441421+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:33:05.441421+0000","last_undegraded":"2024-09-21T03:33:05.441421+0000","last_fullsized":"2024-09-21T03:33:05.441421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321593+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:33:05.321593+0000","last_peered":"2024-09-21T03:33:05.321593+0000","last_clean":"2024-09-21T03:33:05.321593+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:33:05.321593+0000","last_undegraded":"2024-09-21T03:33:05.321593+0000","last_fullsized":"2024-09-21T03:33:05.321593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318630+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:33:05.318630+0000","last_peered":"2024-09-21T03:33:05.318630+0000","last_clean":"2024-09-21T03:33:05.318630+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:33:05.318630+0000","last_undegraded":"2024-09-21T03:33:05.318630+0000","last_fullsized":"2024-09-21T03:33:05.318630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321378+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:33:05.321378+0000","last_peered":"2024-09-21T03:33:05.321378+0000","last_clean":"2024-09-21T03:33:05.321378+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:33:05.321378+0000","last_undegraded":"2024-09-21T03:33:05.321378+0000","last_fullsized":"2024-09-21T03:33:05.321378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.325029+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:33:05.325029+0000","last_peered":"2024-09-21T03:33:05.325029+0000","last_clean":"2024-09-21T03:33:05.325029+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:33:05.325029+0000","last_undegraded":"2024-09-21T03:33:05.325029+0000","last_fullsized":"2024-09-21T03:33:05.325029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321617+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:33:05.321617+0000","last_peered":"2024-09-21T03:33:05.321617+0000","last_clean":"2024-09-21T03:33:05.321617+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:33:05.321617+0000","last_undegraded":"2024-09-21T03:33:05.321617+0000","last_fullsized":"2024-09-21T03:33:05.321617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321464+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:33:05.321464+0000","last_peered":"2024-09-21T03:33:05.321464+0000","last_clean":"2024-09-21T03:33:05.321464+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:33:05.321464+0000","last_undegraded":"2024-09-21T03:33:05.321464+0000","last_fullsized":"2024-09-21T03:33:05.321464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444622+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:33:05.444622+0000","last_peered":"2024-09-21T03:33:05.444622+0000","last_clean":"2024-09-21T03:33:05.444622+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:33:05.444622+0000","last_undegraded":"2024-09-21T03:33:05.444622+0000","last_fullsized":"2024-09-21T03:33:05.444622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317046+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:33:05.317046+0000","last_peered":"2024-09-21T03:33:05.317046+0000","last_clean":"2024-09-21T03:33:05.317046+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:33:05.317046+0000","last_undegraded":"2024-09-21T03:33:05.317046+0000","last_fullsized":"2024-09-21T03:33:05.317046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321348+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:33:05.321348+0000","last_peered":"2024-09-21T03:33:05.321348+0000","last_clean":"2024-09-21T03:33:05.321348+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:33:05.321348+0000","last_undegraded":"2024-09-21T03:33:05.321348+0000","last_fullsized":"2024-09-21T03:33:05.321348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441177+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:33:05.441177+0000","last_peered":"2024-09-21T03:33:05.441177+0000","last_clean":"2024-09-21T03:33:05.441177+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:33:05.441177+0000","last_undegraded":"2024-09-21T03:33:05.441177+0000","last_fullsized":"2024-09-21T03:33:05.441177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":137,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:34.504961+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:33:34.504961+0000","last_peered":"2024-09-21T03:33:34.504961+0000","last_clean":"2024-09-21T03:33:34.504961+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:33:34.504961+0000","last_undegraded":"2024-09-21T03:33:34.504961+0000","last_fullsized":"2024-09-21T03:33:34.504961+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318116+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:33:05.318116+0000","last_peered":"2024-09-21T03:33:05.318116+0000","last_clean":"2024-09-21T03:33:05.318116+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:33:05.318116+0000","last_undegraded":"2024-09-21T03:33:05.318116+0000","last_fullsized":"2024-09-21T03:33:05.318116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321755+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:33:05.321755+0000","last_peered":"2024-09-21T03:33:05.321755+0000","last_clean":"2024-09-21T03:33:05.321755+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:33:05.321755+0000","last_undegraded":"2024-09-21T03:33:05.321755+0000","last_fullsized":"2024-09-21T03:33:05.321755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440795+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:33:05.440795+0000","last_peered":"2024-09-21T03:33:05.440795+0000","last_clean":"2024-09-21T03:33:05.440795+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:33:05.440795+0000","last_undegraded":"2024-09-21T03:33:05.440795+0000","last_fullsized":"2024-09-21T03:33:05.440795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466828+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:33:05.466828+0000","last_peered":"2024-09-21T03:33:05.466828+0000","last_clean":"2024-09-21T03:33:05.466828+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:33:05.466828+0000","last_undegraded":"2024-09-21T03:33:05.466828+0000","last_fullsized":"2024-09-21T03:33:05.466828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440761+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:33:05.440761+0000","last_peered":"2024-09-21T03:33:05.440761+0000","last_clean":"2024-09-21T03:33:05.440761+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:33:05.440761+0000","last_undegraded":"2024-09-21T03:33:05.440761+0000","last_fullsized":"2024-09-21T03:33:05.440761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319381+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:33:05.319381+0000","last_peered":"2024-09-21T03:33:05.319381+0000","last_clean":"2024-09-21T03:33:05.319381+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:33:05.319381+0000","last_undegraded":"2024-09-21T03:33:05.319381+0000","last_fullsized":"2024-09-21T03:33:05.319381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441554+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:33:05.441554+0000","last_peered":"2024-09-21T03:33:05.441554+0000","last_clean":"2024-09-21T03:33:05.441554+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:33:05.441554+0000","last_undegraded":"2024-09-21T03:33:05.441554+0000","last_fullsized":"2024-09-21T03:33:05.441554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'11","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.467005+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:33:05.467005+0000","last_peered":"2024-09-21T03:33:05.467005+0000","last_clean":"2024-09-21T03:33:05.467005+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:33:05.467005+0000","last_undegraded":"2024-09-21T03:33:05.467005+0000","last_fullsized":"2024-09-21T03:33:05.467005+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317394+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:33:05.317394+0000","last_peered":"2024-09-21T03:33:05.317394+0000","last_clean":"2024-09-21T03:33:05.317394+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:33:05.317394+0000","last_undegraded":"2024-09-21T03:33:05.317394+0000","last_fullsized":"2024-09-21T03:33:05.317394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444578+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:33:05.444578+0000","last_peered":"2024-09-21T03:33:05.444578+0000","last_clean":"2024-09-21T03:33:05.444578+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:33:05.444578+0000","last_undegraded":"2024-09-21T03:33:05.444578+0000","last_fullsized":"2024-09-21T03:33:05.444578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466341+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:33:05.466341+0000","last_peered":"2024-09-21T03:33:05.466341+0000","last_clean":"2024-09-21T03:33:05.466341+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:33:05.466341+0000","last_undegraded":"2024-09-21T03:33:05.466341+0000","last_fullsized":"2024-09-21T03:33:05.466341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318441+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:33:05.318441+0000","last_peered":"2024-09-21T03:33:05.318441+0000","last_clean":"2024-09-21T03:33:05.318441+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:33:05.318441+0000","last_undegraded":"2024-09-21T03:33:05.318441+0000","last_fullsized":"2024-09-21T03:33:05.318441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321881+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:33:05.321881+0000","last_peered":"2024-09-21T03:33:05.321881+0000","last_clean":"2024-09-21T03:33:05.321881+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:33:05.321881+0000","last_undegraded":"2024-09-21T03:33:05.321881+0000","last_fullsized":"2024-09-21T03:33:05.321881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317034+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:33:05.317034+0000","last_peered":"2024-09-21T03:33:05.317034+0000","last_clean":"2024-09-21T03:33:05.317034+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:33:05.317034+0000","last_undegraded":"2024-09-21T03:33:05.317034+0000","last_fullsized":"2024-09-21T03:33:05.317034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319135+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:33:05.319135+0000","last_peered":"2024-09-21T03:33:05.319135+0000","last_clean":"2024-09-21T03:33:05.319135+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:33:05.319135+0000","last_undegraded":"2024-09-21T03:33:05.319135+0000","last_fullsized":"2024-09-21T03:33:05.319135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324613+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:33:05.324613+0000","last_peered":"2024-09-21T03:33:05.324613+0000","last_clean":"2024-09-21T03:33:05.324613+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:33:05.324613+0000","last_undegraded":"2024-09-21T03:33:05.324613+0000","last_fullsized":"2024-09-21T03:33:05.324613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317009+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:33:05.317009+0000","last_peered":"2024-09-21T03:33:05.317009+0000","last_clean":"2024-09-21T03:33:05.317009+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:33:05.317009+0000","last_undegraded":"2024-09-21T03:33:05.317009+0000","last_fullsized":"2024-09-21T03:33:05.317009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.450356+0000","last_change":"2024-09-21T03:33:05.450237+0000","last_active":"2024-09-21T03:33:05.450356+0000","last_peered":"2024-09-21T03:33:05.450356+0000","last_clean":"2024-09-21T03:33:05.450356+0000","last_became_active":"2024-09-21T03:33:05.445378+0000","last_became_peered":"2024-09-21T03:33:05.445378+0000","last_unstale":"2024-09-21T03:33:05.450356+0000","last_undegraded":"2024-09-21T03:33:05.450356+0000","last_fullsized":"2024-09-21T03:33:05.450356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:54.926407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321563+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:33:05.321563+0000","last_peered":"2024-09-21T03:33:05.321563+0000","last_clean":"2024-09-21T03:33:05.321563+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:33:05.321563+0000","last_undegraded":"2024-09-21T03:33:05.321563+0000","last_fullsized":"2024-09-21T03:33:05.321563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318427+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:33:05.318427+0000","last_peered":"2024-09-21T03:33:05.318427+0000","last_clean":"2024-09-21T03:33:05.318427+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:33:05.318427+0000","last_undegraded":"2024-09-21T03:33:05.318427+0000","last_fullsized":"2024-09-21T03:33:05.318427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322293+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:33:05.322293+0000","last_peered":"2024-09-21T03:33:05.322293+0000","last_clean":"2024-09-21T03:33:05.322293+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:33:05.322293+0000","last_undegraded":"2024-09-21T03:33:05.322293+0000","last_fullsized":"2024-09-21T03:33:05.322293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318518+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:33:05.318518+0000","last_peered":"2024-09-21T03:33:05.318518+0000","last_clean":"2024-09-21T03:33:05.318518+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:33:05.318518+0000","last_undegraded":"2024-09-21T03:33:05.318518+0000","last_fullsized":"2024-09-21T03:33:05.318518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322363+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:33:05.322363+0000","last_peered":"2024-09-21T03:33:05.322363+0000","last_clean":"2024-09-21T03:33:05.322363+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:33:05.322363+0000","last_undegraded":"2024-09-21T03:33:05.322363+0000","last_fullsized":"2024-09-21T03:33:05.322363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466524+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:33:05.466524+0000","last_peered":"2024-09-21T03:33:05.466524+0000","last_clean":"2024-09-21T03:33:05.466524+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:33:05.466524+0000","last_undegraded":"2024-09-21T03:33:05.466524+0000","last_fullsized":"2024-09-21T03:33:05.466524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317477+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:33:05.317477+0000","last_peered":"2024-09-21T03:33:05.317477+0000","last_clean":"2024-09-21T03:33:05.317477+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:33:05.317477+0000","last_undegraded":"2024-09-21T03:33:05.317477+0000","last_fullsized":"2024-09-21T03:33:05.317477+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317308+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:33:05.317308+0000","last_peered":"2024-09-21T03:33:05.317308+0000","last_clean":"2024-09-21T03:33:05.317308+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:33:05.317308+0000","last_undegraded":"2024-09-21T03:33:05.317308+0000","last_fullsized":"2024-09-21T03:33:05.317308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466960+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:33:05.466960+0000","last_peered":"2024-09-21T03:33:05.466960+0000","last_clean":"2024-09-21T03:33:05.466960+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:33:05.466960+0000","last_undegraded":"2024-09-21T03:33:05.466960+0000","last_fullsized":"2024-09-21T03:33:05.466960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68825,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":661,"num_read_kb":402,"num_write":171,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":206475,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":146,"ondisk_log_size":146,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678054,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":441581,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874281,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1028096,"data_stored":1097723,"data_compressed":49335,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037807,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":441795,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":441693,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397560,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":1034318,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561086,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":441184,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":954368,"data_stored":1033470,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920839,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":442265,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117070,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":441495,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32124,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713028,"statfs":{"total":95995035648,"available":95962140672,"internally_reserved":0,"allocated":958464,"data_stored":506898,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":505128,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":442455,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64151,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65921,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66261,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:33:42.132 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T03:33:42.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 -- 172.21.15.102:0/2966444031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc102980 msgr2=0x7f43dc102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 --2- 172.21.15.102:0/2966444031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc102980 0x7f43dc102d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009900 tx=0x7f43cc02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 -- 172.21.15.102:0/2966444031 shutdown_connections 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 --2- 172.21.15.102:0/2966444031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc108c00 0x7f43dc10f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 --2- 172.21.15.102:0/2966444031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc1082b0 0x7f43dc1086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 --2- 172.21.15.102:0/2966444031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc102980 0x7f43dc102d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 -- 172.21.15.102:0/2966444031 >> 172.21.15.102:0/2966444031 conn(0x7f43dc0fe380 msgr2=0x7f43dc1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:42.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 -- 172.21.15.102:0/2966444031 shutdown_connections 2024-09-21T03:33:42.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.276+0000 7f43e22ec640 1 -- 172.21.15.102:0/2966444031 wait complete. 2024-09-21T03:33:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 Processor -- start 2024-09-21T03:33:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 -- start start 2024-09-21T03:33:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 0x7f43dc19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc108c00 0x7f43dc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112a00 con 0x7f43dc1082b0 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112880 con 0x7f43dc102980 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e22ec640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f43dc112b80 con 0x7f43dc108c00 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58732/0 (socket says 172.21.15.102:58732) 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 -- 172.21.15.102:0/1037681928 learned_addr learned my addr 172.21.15.102:0/1037681928 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43e0889640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc108c00 0x7f43dc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43dbfff640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 0x7f43dc19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:42.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 -- 172.21.15.102:0/1037681928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc108c00 msgr2=0x7f43dc19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc108c00 0x7f43dc19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 -- 172.21.15.102:0/1037681928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 msgr2=0x7f43dc19b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 0x7f43dc19b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.277+0000 7f43db7fe640 1 -- 172.21.15.102:0/1037681928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43dc1a65b0 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43dbfff640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 0x7f43dc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43db7fe640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f43c400e9c0 tx=0x7f43c400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c400ccc0 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43dc1a68a0 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f43c40054f0 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4010430 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.278+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43dc1a6da0 con 0x7f43dc1082b0 2024-09-21T03:33:42.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.279+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43dc103bf0 con 0x7f43dc1082b0 2024-09-21T03:33:42.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.282+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f43c40046c0 con 0x7f43dc1082b0 2024-09-21T03:33:42.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.282+0000 7f43d97fa640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 0x7f43c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:42.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.282+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f43c40e7b50 con 0x7f43dc1082b0 2024-09-21T03:33:42.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.282+0000 7f43dbfff640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 0x7f43c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:42.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.283+0000 7f43dbfff640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 0x7f43c80b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43cc000c00 tx=0x7f43cc009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:42.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.285+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43c4056710 con 0x7f43dc1082b0 2024-09-21T03:33:42.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:42 smithi102 ceph-mon[31392]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:42 smithi102 ceph-mon[31392]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:42 smithi102 ceph-mon[31392]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:42.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.463+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43dc063800 con 0x7f43c80b6560 2024-09-21T03:33:42.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.467+0000 7f43d97fa640 1 -- 172.21.15.102:0/1037681928 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259138 (secure 0 0 0) 0x7f43dc063800 con 0x7f43c80b6560 2024-09-21T03:33:42.472 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:42.473 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-21T03:33:42.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 msgr2=0x7f43c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 0x7f43c80b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f43cc000c00 tx=0x7f43cc009680 comp rx=0 tx=0).stop 2024-09-21T03:33:42.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 msgr2=0x7f43dc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:42.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f43c400e9c0 tx=0x7f43c400ee80 comp rx=0 tx=0).stop 2024-09-21T03:33:42.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 shutdown_connections 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f43c80b6560 0x7f43c80b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f43dc1082b0 0x7f43dc19b830 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f43dc108c00 0x7f43dc19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 --2- 172.21.15.102:0/1037681928 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f43dc102980 0x7f43dc19b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 >> 172.21.15.102:0/1037681928 conn(0x7f43dc0fe380 msgr2=0x7f43dc1078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 shutdown_connections 2024-09-21T03:33:42.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:42.470+0000 7f43e22ec640 1 -- 172.21.15.102:0/1037681928 wait complete. 2024-09-21T03:33:42.484 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-21T03:33:42.250285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660043,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":769,"num_read_kb":488,"num_write":302,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":2951974,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":745,"ondisk_log_size":745,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":360092,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124581732,"statfs":{"total":1151940427776,"available":1151571693568,"internally_reserved":0,"allocated":11059200,"data_stored":7271853,"data_compressed":251955,"data_compressed_allocated":344064,"data_compressed_original":2187264,"omap_allocated":19142,"internal_metadata":357414202},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":47,"num_write":6,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003530"},"pg_stats":[{"pgid":"3.3f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319714+0000","last_change":"2024-09-21T03:31:40.492480+0000","last_active":"2024-09-21T03:33:05.319714+0000","last_peered":"2024-09-21T03:33:05.319714+0000","last_clean":"2024-09-21T03:33:05.319714+0000","last_became_active":"2024-09-21T03:31:40.491784+0000","last_became_peered":"2024-09-21T03:31:40.491784+0000","last_unstale":"2024-09-21T03:33:05.319714+0000","last_undegraded":"2024-09-21T03:33:05.319714+0000","last_fullsized":"2024-09-21T03:33:05.319714+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:19.110340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466400+0000","last_change":"2024-09-21T03:31:40.485229+0000","last_active":"2024-09-21T03:33:05.466400+0000","last_peered":"2024-09-21T03:33:05.466400+0000","last_clean":"2024-09-21T03:33:05.466400+0000","last_became_active":"2024-09-21T03:31:40.484851+0000","last_became_peered":"2024-09-21T03:31:40.484851+0000","last_unstale":"2024-09-21T03:33:05.466400+0000","last_undegraded":"2024-09-21T03:33:05.466400+0000","last_fullsized":"2024-09-21T03:33:05.466400+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:00.741371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466309+0000","last_change":"2024-09-21T03:31:40.481473+0000","last_active":"2024-09-21T03:33:05.466309+0000","last_peered":"2024-09-21T03:33:05.466309+0000","last_clean":"2024-09-21T03:33:05.466309+0000","last_became_active":"2024-09-21T03:31:40.481185+0000","last_became_peered":"2024-09-21T03:31:40.481185+0000","last_unstale":"2024-09-21T03:33:05.466309+0000","last_undegraded":"2024-09-21T03:33:05.466309+0000","last_fullsized":"2024-09-21T03:33:05.466309+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:59.802933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"80'8","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444278+0000","last_change":"2024-09-21T03:31:40.487984+0000","last_active":"2024-09-21T03:33:05.444278+0000","last_peered":"2024-09-21T03:33:05.444278+0000","last_clean":"2024-09-21T03:33:05.444278+0000","last_became_active":"2024-09-21T03:31:40.487565+0000","last_became_peered":"2024-09-21T03:31:40.487565+0000","last_unstale":"2024-09-21T03:33:05.444278+0000","last_undegraded":"2024-09-21T03:33:05.444278+0000","last_fullsized":"2024-09-21T03:33:05.444278+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:09:35.160965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321904+0000","last_change":"2024-09-21T03:31:40.483140+0000","last_active":"2024-09-21T03:33:05.321904+0000","last_peered":"2024-09-21T03:33:05.321904+0000","last_clean":"2024-09-21T03:33:05.321904+0000","last_became_active":"2024-09-21T03:31:40.482746+0000","last_became_peered":"2024-09-21T03:31:40.482746+0000","last_unstale":"2024-09-21T03:33:05.321904+0000","last_undegraded":"2024-09-21T03:33:05.321904+0000","last_fullsized":"2024-09-21T03:33:05.321904+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:47.947346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440600+0000","last_change":"2024-09-21T03:31:40.488566+0000","last_active":"2024-09-21T03:33:05.440600+0000","last_peered":"2024-09-21T03:33:05.440600+0000","last_clean":"2024-09-21T03:33:05.440600+0000","last_became_active":"2024-09-21T03:31:40.488175+0000","last_became_peered":"2024-09-21T03:31:40.488175+0000","last_unstale":"2024-09-21T03:33:05.440600+0000","last_undegraded":"2024-09-21T03:33:05.440600+0000","last_fullsized":"2024-09-21T03:33:05.440600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:20:16.966007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321242+0000","last_change":"2024-09-21T03:31:40.489909+0000","last_active":"2024-09-21T03:33:05.321242+0000","last_peered":"2024-09-21T03:33:05.321242+0000","last_clean":"2024-09-21T03:33:05.321242+0000","last_became_active":"2024-09-21T03:31:40.488928+0000","last_became_peered":"2024-09-21T03:31:40.488928+0000","last_unstale":"2024-09-21T03:33:05.321242+0000","last_undegraded":"2024-09-21T03:33:05.321242+0000","last_fullsized":"2024-09-21T03:33:05.321242+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:58:30.017252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316842+0000","last_change":"2024-09-21T03:31:40.487465+0000","last_active":"2024-09-21T03:33:05.316842+0000","last_peered":"2024-09-21T03:33:05.316842+0000","last_clean":"2024-09-21T03:33:05.316842+0000","last_became_active":"2024-09-21T03:31:40.487126+0000","last_became_peered":"2024-09-21T03:31:40.487126+0000","last_unstale":"2024-09-21T03:33:05.316842+0000","last_undegraded":"2024-09-21T03:33:05.316842+0000","last_fullsized":"2024-09-21T03:33:05.316842+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:08:26.345328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"80'11","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318973+0000","last_change":"2024-09-21T03:32:05.296979+0000","last_active":"2024-09-21T03:33:05.318973+0000","last_peered":"2024-09-21T03:33:05.318973+0000","last_clean":"2024-09-21T03:33:05.318973+0000","last_became_active":"2024-09-21T03:32:05.296486+0000","last_became_peered":"2024-09-21T03:32:05.296486+0000","last_unstale":"2024-09-21T03:33:05.318973+0000","last_undegraded":"2024-09-21T03:33:05.318973+0000","last_fullsized":"2024-09-21T03:33:05.318973+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:09.014717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,11],"acting":[1,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"80'16","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441068+0000","last_change":"2024-09-21T03:31:40.490933+0000","last_active":"2024-09-21T03:33:05.441068+0000","last_peered":"2024-09-21T03:33:05.441068+0000","last_clean":"2024-09-21T03:33:05.441068+0000","last_became_active":"2024-09-21T03:31:40.490438+0000","last_became_peered":"2024-09-21T03:31:40.490438+0000","last_unstale":"2024-09-21T03:33:05.441068+0000","last_undegraded":"2024-09-21T03:33:05.441068+0000","last_fullsized":"2024-09-21T03:33:05.441068+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:38.241244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321625+0000","last_change":"2024-09-21T03:31:40.485616+0000","last_active":"2024-09-21T03:33:05.321625+0000","last_peered":"2024-09-21T03:33:05.321625+0000","last_clean":"2024-09-21T03:33:05.321625+0000","last_became_active":"2024-09-21T03:31:40.485164+0000","last_became_peered":"2024-09-21T03:31:40.485164+0000","last_unstale":"2024-09-21T03:33:05.321625+0000","last_undegraded":"2024-09-21T03:33:05.321625+0000","last_fullsized":"2024-09-21T03:33:05.321625+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:57.427524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444310+0000","last_change":"2024-09-21T03:31:40.487696+0000","last_active":"2024-09-21T03:33:05.444310+0000","last_peered":"2024-09-21T03:33:05.444310+0000","last_clean":"2024-09-21T03:33:05.444310+0000","last_became_active":"2024-09-21T03:31:40.487308+0000","last_became_peered":"2024-09-21T03:31:40.487308+0000","last_unstale":"2024-09-21T03:33:05.444310+0000","last_undegraded":"2024-09-21T03:33:05.444310+0000","last_fullsized":"2024-09-21T03:33:05.444310+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:52:53.836806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441669+0000","last_change":"2024-09-21T03:31:40.486382+0000","last_active":"2024-09-21T03:33:05.441669+0000","last_peered":"2024-09-21T03:33:05.441669+0000","last_clean":"2024-09-21T03:33:05.441669+0000","last_became_active":"2024-09-21T03:31:40.486033+0000","last_became_peered":"2024-09-21T03:31:40.486033+0000","last_unstale":"2024-09-21T03:33:05.441669+0000","last_undegraded":"2024-09-21T03:33:05.441669+0000","last_fullsized":"2024-09-21T03:33:05.441669+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:44:47.717380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466052+0000","last_change":"2024-09-21T03:31:40.481601+0000","last_active":"2024-09-21T03:33:05.466052+0000","last_peered":"2024-09-21T03:33:05.466052+0000","last_clean":"2024-09-21T03:33:05.466052+0000","last_became_active":"2024-09-21T03:31:40.481262+0000","last_became_peered":"2024-09-21T03:31:40.481262+0000","last_unstale":"2024-09-21T03:33:05.466052+0000","last_undegraded":"2024-09-21T03:33:05.466052+0000","last_fullsized":"2024-09-21T03:33:05.466052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:25:19.604101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466009+0000","last_change":"2024-09-21T03:31:40.483028+0000","last_active":"2024-09-21T03:33:05.466009+0000","last_peered":"2024-09-21T03:33:05.466009+0000","last_clean":"2024-09-21T03:33:05.466009+0000","last_became_active":"2024-09-21T03:31:40.482681+0000","last_became_peered":"2024-09-21T03:31:40.482681+0000","last_unstale":"2024-09-21T03:33:05.466009+0000","last_undegraded":"2024-09-21T03:33:05.466009+0000","last_fullsized":"2024-09-21T03:33:05.466009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:04:17.084477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318295+0000","last_change":"2024-09-21T03:31:40.489823+0000","last_active":"2024-09-21T03:33:05.318295+0000","last_peered":"2024-09-21T03:33:05.318295+0000","last_clean":"2024-09-21T03:33:05.318295+0000","last_became_active":"2024-09-21T03:31:40.485523+0000","last_became_peered":"2024-09-21T03:31:40.485523+0000","last_unstale":"2024-09-21T03:33:05.318295+0000","last_undegraded":"2024-09-21T03:33:05.318295+0000","last_fullsized":"2024-09-21T03:33:05.318295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:10:05.184490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319762+0000","last_change":"2024-09-21T03:31:40.490121+0000","last_active":"2024-09-21T03:33:05.319762+0000","last_peered":"2024-09-21T03:33:05.319762+0000","last_clean":"2024-09-21T03:33:05.319762+0000","last_became_active":"2024-09-21T03:31:40.489488+0000","last_became_peered":"2024-09-21T03:31:40.489488+0000","last_unstale":"2024-09-21T03:33:05.319762+0000","last_undegraded":"2024-09-21T03:33:05.319762+0000","last_fullsized":"2024-09-21T03:33:05.319762+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:03:31.802472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466934+0000","last_change":"2024-09-21T03:31:40.478608+0000","last_active":"2024-09-21T03:33:05.466934+0000","last_peered":"2024-09-21T03:33:05.466934+0000","last_clean":"2024-09-21T03:33:05.466934+0000","last_became_active":"2024-09-21T03:31:40.478227+0000","last_became_peered":"2024-09-21T03:31:40.478227+0000","last_unstale":"2024-09-21T03:33:05.466934+0000","last_undegraded":"2024-09-21T03:33:05.466934+0000","last_fullsized":"2024-09-21T03:33:05.466934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:59.875600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324849+0000","last_change":"2024-09-21T03:31:40.489950+0000","last_active":"2024-09-21T03:33:05.324849+0000","last_peered":"2024-09-21T03:33:05.324849+0000","last_clean":"2024-09-21T03:33:05.324849+0000","last_became_active":"2024-09-21T03:31:40.489549+0000","last_became_peered":"2024-09-21T03:31:40.489549+0000","last_unstale":"2024-09-21T03:33:05.324849+0000","last_undegraded":"2024-09-21T03:33:05.324849+0000","last_fullsized":"2024-09-21T03:33:05.324849+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:24:58.578543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"80'8","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319379+0000","last_change":"2024-09-21T03:32:05.295113+0000","last_active":"2024-09-21T03:33:05.319379+0000","last_peered":"2024-09-21T03:33:05.319379+0000","last_clean":"2024-09-21T03:33:05.319379+0000","last_became_active":"2024-09-21T03:32:05.294604+0000","last_became_peered":"2024-09-21T03:32:05.294604+0000","last_unstale":"2024-09-21T03:33:05.319379+0000","last_undegraded":"2024-09-21T03:33:05.319379+0000","last_fullsized":"2024-09-21T03:33:05.319379+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:10.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441719+0000","last_change":"2024-09-21T03:31:40.482200+0000","last_active":"2024-09-21T03:33:05.441719+0000","last_peered":"2024-09-21T03:33:05.441719+0000","last_clean":"2024-09-21T03:33:05.441719+0000","last_became_active":"2024-09-21T03:31:40.481766+0000","last_became_peered":"2024-09-21T03:31:40.481766+0000","last_unstale":"2024-09-21T03:33:05.441719+0000","last_undegraded":"2024-09-21T03:33:05.441719+0000","last_fullsized":"2024-09-21T03:33:05.441719+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:09:48.513612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318623+0000","last_change":"2024-09-21T03:31:40.489146+0000","last_active":"2024-09-21T03:33:05.318623+0000","last_peered":"2024-09-21T03:33:05.318623+0000","last_clean":"2024-09-21T03:33:05.318623+0000","last_became_active":"2024-09-21T03:31:40.488712+0000","last_became_peered":"2024-09-21T03:31:40.488712+0000","last_unstale":"2024-09-21T03:33:05.318623+0000","last_undegraded":"2024-09-21T03:33:05.318623+0000","last_fullsized":"2024-09-21T03:33:05.318623+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:54.217704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316902+0000","last_change":"2024-09-21T03:31:40.482990+0000","last_active":"2024-09-21T03:33:05.316902+0000","last_peered":"2024-09-21T03:33:05.316902+0000","last_clean":"2024-09-21T03:33:05.316902+0000","last_became_active":"2024-09-21T03:31:40.482636+0000","last_became_peered":"2024-09-21T03:31:40.482636+0000","last_unstale":"2024-09-21T03:33:05.316902+0000","last_undegraded":"2024-09-21T03:33:05.316902+0000","last_fullsized":"2024-09-21T03:33:05.316902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:31:21.253558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318049+0000","last_change":"2024-09-21T03:31:40.486226+0000","last_active":"2024-09-21T03:33:05.318049+0000","last_peered":"2024-09-21T03:33:05.318049+0000","last_clean":"2024-09-21T03:33:05.318049+0000","last_became_active":"2024-09-21T03:31:40.485845+0000","last_became_peered":"2024-09-21T03:31:40.485845+0000","last_unstale":"2024-09-21T03:33:05.318049+0000","last_undegraded":"2024-09-21T03:33:05.318049+0000","last_fullsized":"2024-09-21T03:33:05.318049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:16:21.256161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317363+0000","last_change":"2024-09-21T03:31:40.489419+0000","last_active":"2024-09-21T03:33:05.317363+0000","last_peered":"2024-09-21T03:33:05.317363+0000","last_clean":"2024-09-21T03:33:05.317363+0000","last_became_active":"2024-09-21T03:31:40.489079+0000","last_became_peered":"2024-09-21T03:31:40.489079+0000","last_unstale":"2024-09-21T03:33:05.317363+0000","last_undegraded":"2024-09-21T03:33:05.317363+0000","last_fullsized":"2024-09-21T03:33:05.317363+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:14:44.605611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"80'15","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324848+0000","last_change":"2024-09-21T03:31:40.489616+0000","last_active":"2024-09-21T03:33:05.324848+0000","last_peered":"2024-09-21T03:33:05.324848+0000","last_clean":"2024-09-21T03:33:05.324848+0000","last_became_active":"2024-09-21T03:31:40.488350+0000","last_became_peered":"2024-09-21T03:31:40.488350+0000","last_unstale":"2024-09-21T03:33:05.324848+0000","last_undegraded":"2024-09-21T03:33:05.324848+0000","last_fullsized":"2024-09-21T03:33:05.324848+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:32.102209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319770+0000","last_change":"2024-09-21T03:31:40.488375+0000","last_active":"2024-09-21T03:33:05.319770+0000","last_peered":"2024-09-21T03:33:05.319770+0000","last_clean":"2024-09-21T03:33:05.319770+0000","last_became_active":"2024-09-21T03:31:40.487975+0000","last_became_peered":"2024-09-21T03:31:40.487975+0000","last_unstale":"2024-09-21T03:33:05.319770+0000","last_undegraded":"2024-09-21T03:33:05.319770+0000","last_fullsized":"2024-09-21T03:33:05.319770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:19.486711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"80'4","reported_seq":26,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441391+0000","last_change":"2024-09-21T03:31:40.488756+0000","last_active":"2024-09-21T03:33:05.441391+0000","last_peered":"2024-09-21T03:33:05.441391+0000","last_clean":"2024-09-21T03:33:05.441391+0000","last_became_active":"2024-09-21T03:31:40.488406+0000","last_became_peered":"2024-09-21T03:31:40.488406+0000","last_unstale":"2024-09-21T03:33:05.441391+0000","last_undegraded":"2024-09-21T03:33:05.441391+0000","last_fullsized":"2024-09-21T03:33:05.441391+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:40:37.085758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466288+0000","last_change":"2024-09-21T03:31:40.488170+0000","last_active":"2024-09-21T03:33:05.466288+0000","last_peered":"2024-09-21T03:33:05.466288+0000","last_clean":"2024-09-21T03:33:05.466288+0000","last_became_active":"2024-09-21T03:31:40.487830+0000","last_became_peered":"2024-09-21T03:31:40.487830+0000","last_unstale":"2024-09-21T03:33:05.466288+0000","last_undegraded":"2024-09-21T03:33:05.466288+0000","last_fullsized":"2024-09-21T03:33:05.466288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:07.207393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324490+0000","last_change":"2024-09-21T03:31:40.488942+0000","last_active":"2024-09-21T03:33:05.324490+0000","last_peered":"2024-09-21T03:33:05.324490+0000","last_clean":"2024-09-21T03:33:05.324490+0000","last_became_active":"2024-09-21T03:31:40.488592+0000","last_became_peered":"2024-09-21T03:31:40.488592+0000","last_unstale":"2024-09-21T03:33:05.324490+0000","last_undegraded":"2024-09-21T03:33:05.324490+0000","last_fullsized":"2024-09-21T03:33:05.324490+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:50.039741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"80'12","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324635+0000","last_change":"2024-09-21T03:31:40.494234+0000","last_active":"2024-09-21T03:33:05.324635+0000","last_peered":"2024-09-21T03:33:05.324635+0000","last_clean":"2024-09-21T03:33:05.324635+0000","last_became_active":"2024-09-21T03:31:40.493888+0000","last_became_peered":"2024-09-21T03:31:40.493888+0000","last_unstale":"2024-09-21T03:33:05.324635+0000","last_undegraded":"2024-09-21T03:33:05.324635+0000","last_fullsized":"2024-09-21T03:33:05.324635+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:33.946522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319007+0000","last_change":"2024-09-21T03:31:40.488037+0000","last_active":"2024-09-21T03:33:05.319007+0000","last_peered":"2024-09-21T03:33:05.319007+0000","last_clean":"2024-09-21T03:33:05.319007+0000","last_became_active":"2024-09-21T03:31:40.487639+0000","last_became_peered":"2024-09-21T03:31:40.487639+0000","last_unstale":"2024-09-21T03:33:05.319007+0000","last_undegraded":"2024-09-21T03:33:05.319007+0000","last_fullsized":"2024-09-21T03:33:05.319007+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:55:16.482718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321896+0000","last_change":"2024-09-21T03:31:40.486177+0000","last_active":"2024-09-21T03:33:05.321896+0000","last_peered":"2024-09-21T03:33:05.321896+0000","last_clean":"2024-09-21T03:33:05.321896+0000","last_became_active":"2024-09-21T03:31:40.485806+0000","last_became_peered":"2024-09-21T03:31:40.485806+0000","last_unstale":"2024-09-21T03:33:05.321896+0000","last_undegraded":"2024-09-21T03:33:05.321896+0000","last_fullsized":"2024-09-21T03:33:05.321896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:36.469929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'7","reported_seq":146,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:37.511065+0000","last_change":"2024-09-21T03:31:38.477406+0000","last_active":"2024-09-21T03:33:37.511065+0000","last_peered":"2024-09-21T03:33:37.511065+0000","last_clean":"2024-09-21T03:33:37.511065+0000","last_became_active":"2024-09-21T03:31:38.476365+0000","last_became_peered":"2024-09-21T03:31:38.476365+0000","last_unstale":"2024-09-21T03:33:37.511065+0000","last_undegraded":"2024-09-21T03:33:37.511065+0000","last_fullsized":"2024-09-21T03:33:37.511065+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:21.779769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318361+0000","last_change":"2024-09-21T03:31:40.496291+0000","last_active":"2024-09-21T03:33:05.318361+0000","last_peered":"2024-09-21T03:33:05.318361+0000","last_clean":"2024-09-21T03:33:05.318361+0000","last_became_active":"2024-09-21T03:31:40.495892+0000","last_became_peered":"2024-09-21T03:31:40.495892+0000","last_unstale":"2024-09-21T03:33:05.318361+0000","last_undegraded":"2024-09-21T03:33:05.318361+0000","last_fullsized":"2024-09-21T03:33:05.318361+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:06.217735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"77'3","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440660+0000","last_change":"2024-09-21T03:32:05.304649+0000","last_active":"2024-09-21T03:33:05.440660+0000","last_peered":"2024-09-21T03:33:05.440660+0000","last_clean":"2024-09-21T03:33:05.440660+0000","last_became_active":"2024-09-21T03:32:05.294445+0000","last_became_peered":"2024-09-21T03:32:05.294445+0000","last_unstale":"2024-09-21T03:33:05.440660+0000","last_undegraded":"2024-09-21T03:33:05.440660+0000","last_fullsized":"2024-09-21T03:33:05.440660+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:54:19.460965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441192+0000","last_change":"2024-09-21T03:31:38.468053+0000","last_active":"2024-09-21T03:33:05.441192+0000","last_peered":"2024-09-21T03:33:05.441192+0000","last_clean":"2024-09-21T03:33:05.441192+0000","last_became_active":"2024-09-21T03:31:38.467616+0000","last_became_peered":"2024-09-21T03:31:38.467616+0000","last_unstale":"2024-09-21T03:33:05.441192+0000","last_undegraded":"2024-09-21T03:33:05.441192+0000","last_fullsized":"2024-09-21T03:33:05.441192+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:32:17.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.316911+0000","last_change":"2024-09-21T03:31:40.480072+0000","last_active":"2024-09-21T03:33:05.316911+0000","last_peered":"2024-09-21T03:33:05.316911+0000","last_clean":"2024-09-21T03:33:05.316911+0000","last_became_active":"2024-09-21T03:31:40.479745+0000","last_became_peered":"2024-09-21T03:31:40.479745+0000","last_unstale":"2024-09-21T03:33:05.316911+0000","last_undegraded":"2024-09-21T03:33:05.316911+0000","last_fullsized":"2024-09-21T03:33:05.316911+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:48.974474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318374+0000","last_change":"2024-09-21T03:31:38.478990+0000","last_active":"2024-09-21T03:33:05.318374+0000","last_peered":"2024-09-21T03:33:05.318374+0000","last_clean":"2024-09-21T03:33:05.318374+0000","last_became_active":"2024-09-21T03:31:38.478588+0000","last_became_peered":"2024-09-21T03:31:38.478588+0000","last_unstale":"2024-09-21T03:33:05.318374+0000","last_undegraded":"2024-09-21T03:33:05.318374+0000","last_fullsized":"2024-09-21T03:33:05.318374+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:54.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466638+0000","last_change":"2024-09-21T03:31:40.481867+0000","last_active":"2024-09-21T03:33:05.466638+0000","last_peered":"2024-09-21T03:33:05.466638+0000","last_clean":"2024-09-21T03:33:05.466638+0000","last_became_active":"2024-09-21T03:31:40.481523+0000","last_became_peered":"2024-09-21T03:31:40.481523+0000","last_unstale":"2024-09-21T03:33:05.466638+0000","last_undegraded":"2024-09-21T03:33:05.466638+0000","last_fullsized":"2024-09-21T03:33:05.466638+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:17.331552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":140,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:38.512003+0000","last_change":"2024-09-21T03:31:38.479961+0000","last_active":"2024-09-21T03:33:38.512003+0000","last_peered":"2024-09-21T03:33:38.512003+0000","last_clean":"2024-09-21T03:33:38.512003+0000","last_became_active":"2024-09-21T03:31:38.479596+0000","last_became_peered":"2024-09-21T03:31:38.479596+0000","last_unstale":"2024-09-21T03:33:38.512003+0000","last_undegraded":"2024-09-21T03:33:38.512003+0000","last_fullsized":"2024-09-21T03:33:38.512003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:02.941403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"80'10","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318748+0000","last_change":"2024-09-21T03:31:40.490704+0000","last_active":"2024-09-21T03:33:05.318748+0000","last_peered":"2024-09-21T03:33:05.318748+0000","last_clean":"2024-09-21T03:33:05.318748+0000","last_became_active":"2024-09-21T03:31:40.485853+0000","last_became_peered":"2024-09-21T03:31:40.485853+0000","last_unstale":"2024-09-21T03:33:05.318748+0000","last_undegraded":"2024-09-21T03:33:05.318748+0000","last_fullsized":"2024-09-21T03:33:05.318748+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:59.124136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"77'2","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321501+0000","last_change":"2024-09-21T03:32:05.299480+0000","last_active":"2024-09-21T03:33:05.321501+0000","last_peered":"2024-09-21T03:33:05.321501+0000","last_clean":"2024-09-21T03:33:05.321501+0000","last_became_active":"2024-09-21T03:32:05.293855+0000","last_became_peered":"2024-09-21T03:32:05.293855+0000","last_unstale":"2024-09-21T03:33:05.321501+0000","last_undegraded":"2024-09-21T03:33:05.321501+0000","last_fullsized":"2024-09-21T03:33:05.321501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:13:43.336248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466540+0000","last_change":"2024-09-21T03:31:40.488089+0000","last_active":"2024-09-21T03:33:05.466540+0000","last_peered":"2024-09-21T03:33:05.466540+0000","last_clean":"2024-09-21T03:33:05.466540+0000","last_became_active":"2024-09-21T03:31:40.487732+0000","last_became_peered":"2024-09-21T03:31:40.487732+0000","last_unstale":"2024-09-21T03:33:05.466540+0000","last_undegraded":"2024-09-21T03:33:05.466540+0000","last_fullsized":"2024-09-21T03:33:05.466540+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:01.251967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"77'4","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318577+0000","last_change":"2024-09-21T03:31:39.128165+0000","last_active":"2024-09-21T03:33:05.318577+0000","last_peered":"2024-09-21T03:33:05.318577+0000","last_clean":"2024-09-21T03:33:05.318577+0000","last_became_active":"2024-09-21T03:31:39.127720+0000","last_became_peered":"2024-09-21T03:31:39.127720+0000","last_unstale":"2024-09-21T03:33:05.318577+0000","last_undegraded":"2024-09-21T03:33:05.318577+0000","last_fullsized":"2024-09-21T03:33:05.318577+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:55:38.549130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"80'11","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318529+0000","last_change":"2024-09-21T03:31:40.496213+0000","last_active":"2024-09-21T03:33:05.318529+0000","last_peered":"2024-09-21T03:33:05.318529+0000","last_clean":"2024-09-21T03:33:05.318529+0000","last_became_active":"2024-09-21T03:31:40.495797+0000","last_became_peered":"2024-09-21T03:31:40.495797+0000","last_unstale":"2024-09-21T03:33:05.318529+0000","last_undegraded":"2024-09-21T03:33:05.318529+0000","last_fullsized":"2024-09-21T03:33:05.318529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:48:07.597034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'33","reported_seq":290,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:39.496043+0000","last_change":"2024-09-21T03:31:38.481090+0000","last_active":"2024-09-21T03:33:39.496043+0000","last_peered":"2024-09-21T03:33:39.496043+0000","last_clean":"2024-09-21T03:33:39.496043+0000","last_became_active":"2024-09-21T03:31:38.480792+0000","last_became_peered":"2024-09-21T03:31:38.480792+0000","last_unstale":"2024-09-21T03:33:39.496043+0000","last_undegraded":"2024-09-21T03:33:39.496043+0000","last_fullsized":"2024-09-21T03:33:39.496043+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:57.917089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64459,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":230,"num_read_kb":178,"num_write":34,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322221+0000","last_change":"2024-09-21T03:31:40.487811+0000","last_active":"2024-09-21T03:33:05.322221+0000","last_peered":"2024-09-21T03:33:05.322221+0000","last_clean":"2024-09-21T03:33:05.322221+0000","last_became_active":"2024-09-21T03:31:40.487331+0000","last_became_peered":"2024-09-21T03:31:40.487331+0000","last_unstale":"2024-09-21T03:33:05.322221+0000","last_undegraded":"2024-09-21T03:33:05.322221+0000","last_fullsized":"2024-09-21T03:33:05.322221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:57:59.083434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"77'6","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324823+0000","last_change":"2024-09-21T03:31:38.476706+0000","last_active":"2024-09-21T03:33:05.324823+0000","last_peered":"2024-09-21T03:33:05.324823+0000","last_clean":"2024-09-21T03:33:05.324823+0000","last_became_active":"2024-09-21T03:31:38.476171+0000","last_became_peered":"2024-09-21T03:31:38.476171+0000","last_unstale":"2024-09-21T03:33:05.324823+0000","last_undegraded":"2024-09-21T03:33:05.324823+0000","last_fullsized":"2024-09-21T03:33:05.324823+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:29.243157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"80'9","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441237+0000","last_change":"2024-09-21T03:32:05.295785+0000","last_active":"2024-09-21T03:33:05.441237+0000","last_peered":"2024-09-21T03:33:05.441237+0000","last_clean":"2024-09-21T03:33:05.441237+0000","last_became_active":"2024-09-21T03:32:05.295413+0000","last_became_peered":"2024-09-21T03:32:05.295413+0000","last_unstale":"2024-09-21T03:33:05.441237+0000","last_undegraded":"2024-09-21T03:33:05.441237+0000","last_fullsized":"2024-09-21T03:33:05.441237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:58.264785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"77'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.326329+0000","last_change":"2024-09-21T03:33:05.326218+0000","last_active":"2024-09-21T03:33:05.326329+0000","last_peered":"2024-09-21T03:33:05.326329+0000","last_clean":"2024-09-21T03:33:05.326329+0000","last_became_active":"2024-09-21T03:33:05.322733+0000","last_became_peered":"2024-09-21T03:33:05.322733+0000","last_unstale":"2024-09-21T03:33:05.326329+0000","last_undegraded":"2024-09-21T03:33:05.326329+0000","last_fullsized":"2024-09-21T03:33:05.326329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:36:13.114223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,7],"acting":[11,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.13","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321626+0000","last_change":"2024-09-21T03:32:05.294613+0000","last_active":"2024-09-21T03:33:05.321626+0000","last_peered":"2024-09-21T03:33:05.321626+0000","last_clean":"2024-09-21T03:33:05.321626+0000","last_became_active":"2024-09-21T03:32:05.294101+0000","last_became_peered":"2024-09-21T03:32:05.294101+0000","last_unstale":"2024-09-21T03:33:05.321626+0000","last_undegraded":"2024-09-21T03:33:05.321626+0000","last_fullsized":"2024-09-21T03:33:05.321626+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:55.332651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'6","reported_seq":147,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:38.512272+0000","last_change":"2024-09-21T03:31:38.474436+0000","last_active":"2024-09-21T03:33:38.512272+0000","last_peered":"2024-09-21T03:33:38.512272+0000","last_clean":"2024-09-21T03:33:38.512272+0000","last_became_active":"2024-09-21T03:31:38.474054+0000","last_became_peered":"2024-09-21T03:31:38.474054+0000","last_unstale":"2024-09-21T03:33:38.512272+0000","last_undegraded":"2024-09-21T03:33:38.512272+0000","last_fullsized":"2024-09-21T03:33:38.512272+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:39:24.395396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321173+0000","last_change":"2024-09-21T03:31:40.489464+0000","last_active":"2024-09-21T03:33:05.321173+0000","last_peered":"2024-09-21T03:33:05.321173+0000","last_clean":"2024-09-21T03:33:05.321173+0000","last_became_active":"2024-09-21T03:31:40.489077+0000","last_became_peered":"2024-09-21T03:31:40.489077+0000","last_unstale":"2024-09-21T03:33:05.321173+0000","last_undegraded":"2024-09-21T03:33:05.321173+0000","last_fullsized":"2024-09-21T03:33:05.321173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:48:56.287045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"77'15","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321890+0000","last_change":"2024-09-21T03:32:05.315134+0000","last_active":"2024-09-21T03:33:05.321890+0000","last_peered":"2024-09-21T03:33:05.321890+0000","last_clean":"2024-09-21T03:33:05.321890+0000","last_became_active":"2024-09-21T03:32:05.296725+0000","last_became_peered":"2024-09-21T03:32:05.296725+0000","last_unstale":"2024-09-21T03:33:05.321890+0000","last_undegraded":"2024-09-21T03:33:05.321890+0000","last_fullsized":"2024-09-21T03:33:05.321890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:24:52.288785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,4],"acting":[8,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318114+0000","last_change":"2024-09-21T03:31:40.489491+0000","last_active":"2024-09-21T03:33:05.318114+0000","last_peered":"2024-09-21T03:33:05.318114+0000","last_clean":"2024-09-21T03:33:05.318114+0000","last_became_active":"2024-09-21T03:31:40.489115+0000","last_became_peered":"2024-09-21T03:31:40.489115+0000","last_unstale":"2024-09-21T03:33:05.318114+0000","last_undegraded":"2024-09-21T03:33:05.318114+0000","last_fullsized":"2024-09-21T03:33:05.318114+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:16:46.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322700+0000","last_change":"2024-09-21T03:31:38.470970+0000","last_active":"2024-09-21T03:33:05.322700+0000","last_peered":"2024-09-21T03:33:05.322700+0000","last_clean":"2024-09-21T03:33:05.322700+0000","last_became_active":"2024-09-21T03:31:38.470557+0000","last_became_peered":"2024-09-21T03:31:38.470557+0000","last_unstale":"2024-09-21T03:33:05.322700+0000","last_undegraded":"2024-09-21T03:33:05.322700+0000","last_fullsized":"2024-09-21T03:33:05.322700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T03:44:11.765030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319694+0000","last_change":"2024-09-21T03:31:40.493377+0000","last_active":"2024-09-21T03:33:05.319694+0000","last_peered":"2024-09-21T03:33:05.319694+0000","last_clean":"2024-09-21T03:33:05.319694+0000","last_became_active":"2024-09-21T03:31:40.492755+0000","last_became_peered":"2024-09-21T03:31:40.492755+0000","last_unstale":"2024-09-21T03:33:05.319694+0000","last_undegraded":"2024-09-21T03:33:05.319694+0000","last_fullsized":"2024-09-21T03:33:05.319694+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:40:25.337372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441421+0000","last_change":"2024-09-21T03:31:38.473442+0000","last_active":"2024-09-21T03:33:05.441421+0000","last_peered":"2024-09-21T03:33:05.441421+0000","last_clean":"2024-09-21T03:33:05.441421+0000","last_became_active":"2024-09-21T03:31:38.473084+0000","last_became_peered":"2024-09-21T03:31:38.473084+0000","last_unstale":"2024-09-21T03:33:05.441421+0000","last_undegraded":"2024-09-21T03:33:05.441421+0000","last_fullsized":"2024-09-21T03:33:05.441421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:39:03.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321593+0000","last_change":"2024-09-21T03:31:40.487718+0000","last_active":"2024-09-21T03:33:05.321593+0000","last_peered":"2024-09-21T03:33:05.321593+0000","last_clean":"2024-09-21T03:33:05.321593+0000","last_became_active":"2024-09-21T03:31:40.487336+0000","last_became_peered":"2024-09-21T03:31:40.487336+0000","last_unstale":"2024-09-21T03:33:05.321593+0000","last_undegraded":"2024-09-21T03:33:05.321593+0000","last_fullsized":"2024-09-21T03:33:05.321593+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:56:56.313928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"77'1","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318630+0000","last_change":"2024-09-21T03:31:38.474260+0000","last_active":"2024-09-21T03:33:05.318630+0000","last_peered":"2024-09-21T03:33:05.318630+0000","last_clean":"2024-09-21T03:33:05.318630+0000","last_became_active":"2024-09-21T03:31:38.473878+0000","last_became_peered":"2024-09-21T03:31:38.473878+0000","last_unstale":"2024-09-21T03:33:05.318630+0000","last_undegraded":"2024-09-21T03:33:05.318630+0000","last_fullsized":"2024-09-21T03:33:05.318630+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:43.870656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321378+0000","last_change":"2024-09-21T03:31:40.489289+0000","last_active":"2024-09-21T03:33:05.321378+0000","last_peered":"2024-09-21T03:33:05.321378+0000","last_clean":"2024-09-21T03:33:05.321378+0000","last_became_active":"2024-09-21T03:31:40.488887+0000","last_became_peered":"2024-09-21T03:31:40.488887+0000","last_unstale":"2024-09-21T03:33:05.321378+0000","last_undegraded":"2024-09-21T03:33:05.321378+0000","last_fullsized":"2024-09-21T03:33:05.321378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:50:21.437412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.325029+0000","last_change":"2024-09-21T03:31:39.127350+0000","last_active":"2024-09-21T03:33:05.325029+0000","last_peered":"2024-09-21T03:33:05.325029+0000","last_clean":"2024-09-21T03:33:05.325029+0000","last_became_active":"2024-09-21T03:31:39.126842+0000","last_became_peered":"2024-09-21T03:31:39.126842+0000","last_unstale":"2024-09-21T03:33:05.325029+0000","last_undegraded":"2024-09-21T03:33:05.325029+0000","last_fullsized":"2024-09-21T03:33:05.325029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:42.363127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321617+0000","last_change":"2024-09-21T03:31:40.481552+0000","last_active":"2024-09-21T03:33:05.321617+0000","last_peered":"2024-09-21T03:33:05.321617+0000","last_clean":"2024-09-21T03:33:05.321617+0000","last_became_active":"2024-09-21T03:31:40.481146+0000","last_became_peered":"2024-09-21T03:31:40.481146+0000","last_unstale":"2024-09-21T03:33:05.321617+0000","last_undegraded":"2024-09-21T03:33:05.321617+0000","last_fullsized":"2024-09-21T03:33:05.321617+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:36:49.497084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"23'92","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321464+0000","last_change":"2024-09-21T03:30:27.946339+0000","last_active":"2024-09-21T03:33:05.321464+0000","last_peered":"2024-09-21T03:33:05.321464+0000","last_clean":"2024-09-21T03:33:05.321464+0000","last_became_active":"2024-09-21T03:30:27.940774+0000","last_became_peered":"2024-09-21T03:30:27.940774+0000","last_unstale":"2024-09-21T03:33:05.321464+0000","last_undegraded":"2024-09-21T03:33:05.321464+0000","last_fullsized":"2024-09-21T03:33:05.321464+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:27:07.302876+0000","last_clean_scrub_stamp":"2024-09-21T03:27:07.302876+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:25:56.067061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"77'3","reported_seq":32,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444622+0000","last_change":"2024-09-21T03:31:38.477942+0000","last_active":"2024-09-21T03:33:05.444622+0000","last_peered":"2024-09-21T03:33:05.444622+0000","last_clean":"2024-09-21T03:33:05.444622+0000","last_became_active":"2024-09-21T03:31:38.476963+0000","last_became_peered":"2024-09-21T03:31:38.476963+0000","last_unstale":"2024-09-21T03:33:05.444622+0000","last_undegraded":"2024-09-21T03:33:05.444622+0000","last_fullsized":"2024-09-21T03:33:05.444622+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:33:17.226783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317046+0000","last_change":"2024-09-21T03:31:40.485921+0000","last_active":"2024-09-21T03:33:05.317046+0000","last_peered":"2024-09-21T03:33:05.317046+0000","last_clean":"2024-09-21T03:33:05.317046+0000","last_became_active":"2024-09-21T03:31:40.485581+0000","last_became_peered":"2024-09-21T03:31:40.485581+0000","last_unstale":"2024-09-21T03:33:05.317046+0000","last_undegraded":"2024-09-21T03:33:05.317046+0000","last_fullsized":"2024-09-21T03:33:05.317046+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:26:52.451865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"77'3","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321419+0000","last_change":"2024-09-21T03:31:38.476633+0000","last_active":"2024-09-21T03:33:05.321419+0000","last_peered":"2024-09-21T03:33:05.321419+0000","last_clean":"2024-09-21T03:33:05.321419+0000","last_became_active":"2024-09-21T03:31:38.476168+0000","last_became_peered":"2024-09-21T03:31:38.476168+0000","last_unstale":"2024-09-21T03:33:05.321419+0000","last_undegraded":"2024-09-21T03:33:05.321419+0000","last_fullsized":"2024-09-21T03:33:05.321419+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:58:32.569146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441177+0000","last_change":"2024-09-21T03:31:40.487846+0000","last_active":"2024-09-21T03:33:05.441177+0000","last_peered":"2024-09-21T03:33:05.441177+0000","last_clean":"2024-09-21T03:33:05.441177+0000","last_became_active":"2024-09-21T03:31:40.487499+0000","last_became_peered":"2024-09-21T03:31:40.487499+0000","last_unstale":"2024-09-21T03:33:05.441177+0000","last_undegraded":"2024-09-21T03:33:05.441177+0000","last_fullsized":"2024-09-21T03:33:05.441177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:22:22.673081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'6","reported_seq":143,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:39.513124+0000","last_change":"2024-09-21T03:31:39.127070+0000","last_active":"2024-09-21T03:33:39.513124+0000","last_peered":"2024-09-21T03:33:39.513124+0000","last_clean":"2024-09-21T03:33:39.513124+0000","last_became_active":"2024-09-21T03:31:39.126696+0000","last_became_peered":"2024-09-21T03:31:39.126696+0000","last_unstale":"2024-09-21T03:33:39.513124+0000","last_undegraded":"2024-09-21T03:33:39.513124+0000","last_fullsized":"2024-09-21T03:33:39.513124+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:47:05.834097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318116+0000","last_change":"2024-09-21T03:31:40.496140+0000","last_active":"2024-09-21T03:33:05.318116+0000","last_peered":"2024-09-21T03:33:05.318116+0000","last_clean":"2024-09-21T03:33:05.318116+0000","last_became_active":"2024-09-21T03:31:40.495709+0000","last_became_peered":"2024-09-21T03:31:40.495709+0000","last_unstale":"2024-09-21T03:33:05.318116+0000","last_undegraded":"2024-09-21T03:33:05.318116+0000","last_fullsized":"2024-09-21T03:33:05.318116+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:49:47.910681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321755+0000","last_change":"2024-09-21T03:31:38.475823+0000","last_active":"2024-09-21T03:33:05.321755+0000","last_peered":"2024-09-21T03:33:05.321755+0000","last_clean":"2024-09-21T03:33:05.321755+0000","last_became_active":"2024-09-21T03:31:38.475371+0000","last_became_peered":"2024-09-21T03:31:38.475371+0000","last_unstale":"2024-09-21T03:33:05.321755+0000","last_undegraded":"2024-09-21T03:33:05.321755+0000","last_fullsized":"2024-09-21T03:33:05.321755+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:11:51.505509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440795+0000","last_change":"2024-09-21T03:31:40.492319+0000","last_active":"2024-09-21T03:33:05.440795+0000","last_peered":"2024-09-21T03:33:05.440795+0000","last_clean":"2024-09-21T03:33:05.440795+0000","last_became_active":"2024-09-21T03:31:40.491969+0000","last_became_peered":"2024-09-21T03:31:40.491969+0000","last_unstale":"2024-09-21T03:33:05.440795+0000","last_undegraded":"2024-09-21T03:33:05.440795+0000","last_fullsized":"2024-09-21T03:33:05.440795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:20:24.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466828+0000","last_change":"2024-09-21T03:31:39.128296+0000","last_active":"2024-09-21T03:33:05.466828+0000","last_peered":"2024-09-21T03:33:05.466828+0000","last_clean":"2024-09-21T03:33:05.466828+0000","last_became_active":"2024-09-21T03:31:39.127870+0000","last_became_peered":"2024-09-21T03:31:39.127870+0000","last_unstale":"2024-09-21T03:33:05.466828+0000","last_undegraded":"2024-09-21T03:33:05.466828+0000","last_fullsized":"2024-09-21T03:33:05.466828+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:07:30.897095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.440761+0000","last_change":"2024-09-21T03:31:40.485783+0000","last_active":"2024-09-21T03:33:05.440761+0000","last_peered":"2024-09-21T03:33:05.440761+0000","last_clean":"2024-09-21T03:33:05.440761+0000","last_became_active":"2024-09-21T03:31:40.485331+0000","last_became_peered":"2024-09-21T03:31:40.485331+0000","last_unstale":"2024-09-21T03:33:05.440761+0000","last_undegraded":"2024-09-21T03:33:05.440761+0000","last_fullsized":"2024-09-21T03:33:05.440761+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:43.875013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"77'1","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319381+0000","last_change":"2024-09-21T03:32:05.300430+0000","last_active":"2024-09-21T03:33:05.319381+0000","last_peered":"2024-09-21T03:33:05.319381+0000","last_clean":"2024-09-21T03:33:05.319381+0000","last_became_active":"2024-09-21T03:32:05.296164+0000","last_became_peered":"2024-09-21T03:32:05.296164+0000","last_unstale":"2024-09-21T03:33:05.319381+0000","last_undegraded":"2024-09-21T03:33:05.319381+0000","last_fullsized":"2024-09-21T03:33:05.319381+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:14:28.365971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.441554+0000","last_change":"2024-09-21T03:31:40.480759+0000","last_active":"2024-09-21T03:33:05.441554+0000","last_peered":"2024-09-21T03:33:05.441554+0000","last_clean":"2024-09-21T03:33:05.441554+0000","last_became_active":"2024-09-21T03:31:40.480445+0000","last_became_peered":"2024-09-21T03:31:40.480445+0000","last_unstale":"2024-09-21T03:33:05.441554+0000","last_undegraded":"2024-09-21T03:33:05.441554+0000","last_fullsized":"2024-09-21T03:33:05.441554+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:31:21.205823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'12","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.467045+0000","last_change":"2024-09-21T03:31:38.471556+0000","last_active":"2024-09-21T03:33:05.467045+0000","last_peered":"2024-09-21T03:33:05.467045+0000","last_clean":"2024-09-21T03:33:05.467045+0000","last_became_active":"2024-09-21T03:31:38.471206+0000","last_became_peered":"2024-09-21T03:31:38.471206+0000","last_unstale":"2024-09-21T03:33:05.467045+0000","last_undegraded":"2024-09-21T03:33:05.467045+0000","last_fullsized":"2024-09-21T03:33:05.467045+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:35:52.453994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317394+0000","last_change":"2024-09-21T03:31:40.483032+0000","last_active":"2024-09-21T03:33:05.317394+0000","last_peered":"2024-09-21T03:33:05.317394+0000","last_clean":"2024-09-21T03:33:05.317394+0000","last_became_active":"2024-09-21T03:31:40.482712+0000","last_became_peered":"2024-09-21T03:31:40.482712+0000","last_unstale":"2024-09-21T03:33:05.317394+0000","last_undegraded":"2024-09-21T03:33:05.317394+0000","last_fullsized":"2024-09-21T03:33:05.317394+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:27:38.380471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"77'4","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.444578+0000","last_change":"2024-09-21T03:31:39.013737+0000","last_active":"2024-09-21T03:33:05.444578+0000","last_peered":"2024-09-21T03:33:05.444578+0000","last_clean":"2024-09-21T03:33:05.444578+0000","last_became_active":"2024-09-21T03:31:39.013279+0000","last_became_peered":"2024-09-21T03:31:39.013279+0000","last_unstale":"2024-09-21T03:33:05.444578+0000","last_undegraded":"2024-09-21T03:33:05.444578+0000","last_fullsized":"2024-09-21T03:33:05.444578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:34:12.649187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"80'7","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466341+0000","last_change":"2024-09-21T03:31:40.487720+0000","last_active":"2024-09-21T03:33:05.466341+0000","last_peered":"2024-09-21T03:33:05.466341+0000","last_clean":"2024-09-21T03:33:05.466341+0000","last_became_active":"2024-09-21T03:31:40.487360+0000","last_became_peered":"2024-09-21T03:31:40.487360+0000","last_unstale":"2024-09-21T03:33:05.466341+0000","last_undegraded":"2024-09-21T03:33:05.466341+0000","last_fullsized":"2024-09-21T03:33:05.466341+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:41.618797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318441+0000","last_change":"2024-09-21T03:31:39.128159+0000","last_active":"2024-09-21T03:33:05.318441+0000","last_peered":"2024-09-21T03:33:05.318441+0000","last_clean":"2024-09-21T03:33:05.318441+0000","last_became_active":"2024-09-21T03:31:39.127728+0000","last_became_peered":"2024-09-21T03:31:39.127728+0000","last_unstale":"2024-09-21T03:33:05.318441+0000","last_undegraded":"2024-09-21T03:33:05.318441+0000","last_fullsized":"2024-09-21T03:33:05.318441+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:39:46.163279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"80'2","reported_seq":24,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321881+0000","last_change":"2024-09-21T03:31:40.484928+0000","last_active":"2024-09-21T03:33:05.321881+0000","last_peered":"2024-09-21T03:33:05.321881+0000","last_clean":"2024-09-21T03:33:05.321881+0000","last_became_active":"2024-09-21T03:31:40.484497+0000","last_became_peered":"2024-09-21T03:31:40.484497+0000","last_unstale":"2024-09-21T03:33:05.321881+0000","last_undegraded":"2024-09-21T03:33:05.321881+0000","last_fullsized":"2024-09-21T03:33:05.321881+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:28.388851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"77'3","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317034+0000","last_change":"2024-09-21T03:31:38.477168+0000","last_active":"2024-09-21T03:33:05.317034+0000","last_peered":"2024-09-21T03:33:05.317034+0000","last_clean":"2024-09-21T03:33:05.317034+0000","last_became_active":"2024-09-21T03:31:38.476790+0000","last_became_peered":"2024-09-21T03:31:38.476790+0000","last_unstale":"2024-09-21T03:33:05.317034+0000","last_undegraded":"2024-09-21T03:33:05.317034+0000","last_fullsized":"2024-09-21T03:33:05.317034+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:21.616942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.319135+0000","last_change":"2024-09-21T03:31:40.479547+0000","last_active":"2024-09-21T03:33:05.319135+0000","last_peered":"2024-09-21T03:33:05.319135+0000","last_clean":"2024-09-21T03:33:05.319135+0000","last_became_active":"2024-09-21T03:31:40.479158+0000","last_became_peered":"2024-09-21T03:31:40.479158+0000","last_unstale":"2024-09-21T03:33:05.319135+0000","last_undegraded":"2024-09-21T03:33:05.319135+0000","last_fullsized":"2024-09-21T03:33:05.319135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:25:22.572202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"77'1","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.324613+0000","last_change":"2024-09-21T03:31:38.476150+0000","last_active":"2024-09-21T03:33:05.324613+0000","last_peered":"2024-09-21T03:33:05.324613+0000","last_clean":"2024-09-21T03:33:05.324613+0000","last_became_active":"2024-09-21T03:31:38.474897+0000","last_became_peered":"2024-09-21T03:31:38.474897+0000","last_unstale":"2024-09-21T03:33:05.324613+0000","last_undegraded":"2024-09-21T03:33:05.324613+0000","last_fullsized":"2024-09-21T03:33:05.324613+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:27.497191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317009+0000","last_change":"2024-09-21T03:31:40.481230+0000","last_active":"2024-09-21T03:33:05.317009+0000","last_peered":"2024-09-21T03:33:05.317009+0000","last_clean":"2024-09-21T03:33:05.317009+0000","last_became_active":"2024-09-21T03:31:40.480900+0000","last_became_peered":"2024-09-21T03:31:40.480900+0000","last_unstale":"2024-09-21T03:33:05.317009+0000","last_undegraded":"2024-09-21T03:33:05.317009+0000","last_fullsized":"2024-09-21T03:33:05.317009+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:38.718838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"77'4","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.450356+0000","last_change":"2024-09-21T03:33:05.450237+0000","last_active":"2024-09-21T03:33:05.450356+0000","last_peered":"2024-09-21T03:33:05.450356+0000","last_clean":"2024-09-21T03:33:05.450356+0000","last_became_active":"2024-09-21T03:33:05.445378+0000","last_became_peered":"2024-09-21T03:33:05.445378+0000","last_unstale":"2024-09-21T03:33:05.450356+0000","last_undegraded":"2024-09-21T03:33:05.450356+0000","last_fullsized":"2024-09-21T03:33:05.450356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:19:54.926407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,4],"acting":[8,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.321563+0000","last_change":"2024-09-21T03:31:40.483223+0000","last_active":"2024-09-21T03:33:05.321563+0000","last_peered":"2024-09-21T03:33:05.321563+0000","last_clean":"2024-09-21T03:33:05.321563+0000","last_became_active":"2024-09-21T03:31:40.482105+0000","last_became_peered":"2024-09-21T03:31:40.482105+0000","last_unstale":"2024-09-21T03:33:05.321563+0000","last_undegraded":"2024-09-21T03:33:05.321563+0000","last_fullsized":"2024-09-21T03:33:05.321563+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:51:35.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"80'15","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318427+0000","last_change":"2024-09-21T03:32:05.294890+0000","last_active":"2024-09-21T03:33:05.318427+0000","last_peered":"2024-09-21T03:33:05.318427+0000","last_clean":"2024-09-21T03:33:05.318427+0000","last_became_active":"2024-09-21T03:32:05.294188+0000","last_became_peered":"2024-09-21T03:32:05.294188+0000","last_unstale":"2024-09-21T03:33:05.318427+0000","last_undegraded":"2024-09-21T03:33:05.318427+0000","last_fullsized":"2024-09-21T03:33:05.318427+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:46.379375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,1],"acting":[5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"77'2","reported_seq":29,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322293+0000","last_change":"2024-09-21T03:31:38.476560+0000","last_active":"2024-09-21T03:33:05.322293+0000","last_peered":"2024-09-21T03:33:05.322293+0000","last_clean":"2024-09-21T03:33:05.322293+0000","last_became_active":"2024-09-21T03:31:38.475698+0000","last_became_peered":"2024-09-21T03:31:38.475698+0000","last_unstale":"2024-09-21T03:33:05.322293+0000","last_undegraded":"2024-09-21T03:33:05.322293+0000","last_fullsized":"2024-09-21T03:33:05.322293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:13.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"80'9","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.318518+0000","last_change":"2024-09-21T03:31:40.483471+0000","last_active":"2024-09-21T03:33:05.318518+0000","last_peered":"2024-09-21T03:33:05.318518+0000","last_clean":"2024-09-21T03:33:05.318518+0000","last_became_active":"2024-09-21T03:31:40.483057+0000","last_became_peered":"2024-09-21T03:31:40.483057+0000","last_unstale":"2024-09-21T03:33:05.318518+0000","last_undegraded":"2024-09-21T03:33:05.318518+0000","last_fullsized":"2024-09-21T03:33:05.318518+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:08.978064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"77'4","reported_seq":44,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.322363+0000","last_change":"2024-09-21T03:32:05.302683+0000","last_active":"2024-09-21T03:33:05.322363+0000","last_peered":"2024-09-21T03:33:05.322363+0000","last_clean":"2024-09-21T03:33:05.322363+0000","last_became_active":"2024-09-21T03:32:05.296526+0000","last_became_peered":"2024-09-21T03:32:05.296526+0000","last_unstale":"2024-09-21T03:33:05.322363+0000","last_undegraded":"2024-09-21T03:33:05.322363+0000","last_fullsized":"2024-09-21T03:33:05.322363+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:30.532248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6,7],"acting":[8,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"80'6","reported_seq":28,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466524+0000","last_change":"2024-09-21T03:31:40.481453+0000","last_active":"2024-09-21T03:33:05.466524+0000","last_peered":"2024-09-21T03:33:05.466524+0000","last_clean":"2024-09-21T03:33:05.466524+0000","last_became_active":"2024-09-21T03:31:40.481130+0000","last_became_peered":"2024-09-21T03:31:40.481130+0000","last_unstale":"2024-09-21T03:33:05.466524+0000","last_undegraded":"2024-09-21T03:33:05.466524+0000","last_fullsized":"2024-09-21T03:33:05.466524+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:09.798489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"77'2","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317477+0000","last_change":"2024-09-21T03:31:39.127045+0000","last_active":"2024-09-21T03:33:05.317477+0000","last_peered":"2024-09-21T03:33:05.317477+0000","last_clean":"2024-09-21T03:33:05.317477+0000","last_became_active":"2024-09-21T03:31:39.126539+0000","last_became_peered":"2024-09-21T03:31:39.126539+0000","last_unstale":"2024-09-21T03:33:05.317477+0000","last_undegraded":"2024-09-21T03:33:05.317477+0000","last_fullsized":"2024-09-21T03:33:05.317477+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:39:15.430335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"80'5","reported_seq":27,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.317308+0000","last_change":"2024-09-21T03:31:40.489951+0000","last_active":"2024-09-21T03:33:05.317308+0000","last_peered":"2024-09-21T03:33:05.317308+0000","last_clean":"2024-09-21T03:33:05.317308+0000","last_became_active":"2024-09-21T03:31:40.489635+0000","last_became_peered":"2024-09-21T03:31:40.489635+0000","last_unstale":"2024-09-21T03:33:05.317308+0000","last_undegraded":"2024-09-21T03:33:05.317308+0000","last_fullsized":"2024-09-21T03:33:05.317308+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:39.459947+0000","last_clean_scrub_stamp":"2024-09-21T03:31:39.459947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:31.714272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"77'9","reported_seq":37,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-21T03:33:05.466960+0000","last_change":"2024-09-21T03:31:38.473234+0000","last_active":"2024-09-21T03:33:05.466960+0000","last_peered":"2024-09-21T03:33:05.466960+0000","last_clean":"2024-09-21T03:33:05.466960+0000","last_became_active":"2024-09-21T03:31:38.472796+0000","last_became_peered":"2024-09-21T03:31:38.472796+0000","last_unstale":"2024-09-21T03:33:05.466960+0000","last_undegraded":"2024-09-21T03:33:05.466960+0000","last_fullsized":"2024-09-21T03:33:05.466960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:31:37.445666+0000","last_clean_scrub_stamp":"2024-09-21T03:31:37.445666+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:12.095459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69441,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":688,"num_read_kb":419,"num_write":177,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":134,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":208323,"data_compressed":5703,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282209,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678054,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":880640,"data_stored":441581,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":65,"seq":279172874282,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":1098339,"data_compressed":49335,"data_compressed_allocated":65536,"data_compressed_original":630784,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037808,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":892928,"data_stored":441795,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":888832,"data_stored":441693,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397561,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":942080,"data_stored":1034626,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561087,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":441184,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":954368,"data_stored":1033470,"data_compressed":47434,"data_compressed_allocated":61440,"data_compressed_original":622592,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":892928,"data_stored":442573,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117070,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":441495,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378707,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":507206,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":505436,"data_compressed":13451,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705757,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":901120,"data_stored":442455,"data_compressed":11550,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34263,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35884,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":64459,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66229,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":66877,"data_compressed":1901,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T03:33:42.526 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:33:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:42 smithi148 ceph-mon[34651]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:42 smithi148 ceph-mon[34651]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:42 smithi148 ceph-mon[34651]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:42.769 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:42 smithi121 ceph-mon[34316]: from='client.15441 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:42 smithi121 ceph-mon[34316]: from='client.15447 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:42 smithi121 ceph-mon[34316]: pgmap v328: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-21T03:33:43.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 -- 172.21.15.102:0/1159949151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a301083a0 msgr2=0x7f6a301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 --2- 172.21.15.102:0/1159949151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a301083a0 0x7f6a301087b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009900 tx=0x7f6a1802a410 comp rx=0 tx=0).stop 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 -- 172.21.15.102:0/1159949151 shutdown_connections 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 --2- 172.21.15.102:0/1159949151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a301083a0 0x7f6a301087b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 --2- 172.21.15.102:0/1159949151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a30108cf0 0x7f6a3010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 --2- 172.21.15.102:0/1159949151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30102a60 0x7f6a30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 -- 172.21.15.102:0/1159949151 >> 172.21.15.102:0/1159949151 conn(0x7f6a30079730 msgr2=0x7f6a30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 -- 172.21.15.102:0/1159949151 shutdown_connections 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.256+0000 7f6a354b4640 1 -- 172.21.15.102:0/1159949151 wait complete. 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.257+0000 7f6a354b4640 1 Processor -- start 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.257+0000 7f6a354b4640 1 -- start start 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.257+0000 7f6a354b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:43.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a301083a0 0x7f6a301999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30108cf0 0x7f6a3019ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112a80 con 0x7f6a30102a60 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112900 con 0x7f6a30108cf0 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a30112c00 con 0x7f6a301083a0 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:58746/0 (socket says 172.21.15.102:58746) 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 -- 172.21.15.102:0/366709366 learned_addr learned my addr 172.21.15.102:0/366709366 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 -- 172.21.15.102:0/366709366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a301083a0 msgr2=0x7f6a301999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a301083a0 0x7f6a301999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 -- 172.21.15.102:0/366709366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30108cf0 msgr2=0x7f6a3019ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2f7fe640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30108cf0 0x7f6a3019ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30108cf0 0x7f6a3019ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 -- 172.21.15.102:0/366709366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a3019f2e0 con 0x7f6a30102a60 2024-09-21T03:33:43.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2effd640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c920 tx=0x7f6a2000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20007c70 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a20007e10 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a3019f5d0 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a200188c0 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.258+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a301a5df0 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.259+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a30102e70 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.261+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f6a20018a60 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.262+0000 7f6a2cff9640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 0x7f6a1c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.262+0000 7f6a267fc640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 0x7f6a1c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.262+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6a200e7930 con 0x7f6a30102a60 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.262+0000 7f6a267fc640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 0x7f6a1c0b8aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a180096c0 tx=0x7f6a18000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:43.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.265+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a20014030 con 0x7f6a30102a60 2024-09-21T03:33:43.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:43 smithi102 ceph-mon[31392]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:43.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.480+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a3019a560 con 0x7f6a30102a60 2024-09-21T03:33:43.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.481+0000 7f6a2cff9640 1 -- 172.21.15.102:0/366709366 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f6a200ae120 con 0x7f6a30102a60 2024-09-21T03:33:43.483 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:43.483 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"btime":"2024-09-21T03:33:38:357326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:33:37.868919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:33:43.484 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 24 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 msgr2=0x7f6a1c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 0x7f6a1c0b8aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6a180096c0 tx=0x7f6a18000bc0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 msgr2=0x7f6a30199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000c920 tx=0x7f6a2000cde0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 shutdown_connections 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a1c0b6590 0x7f6a1c0b8aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a30108cf0 0x7f6a3019ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a301083a0 0x7f6a301999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 --2- 172.21.15.102:0/366709366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a30102a60 0x7f6a30199430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 >> 172.21.15.102:0/366709366 conn(0x7f6a30079730 msgr2=0x7f6a301043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 shutdown_connections 2024-09-21T03:33:43.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:43.484+0000 7f6a354b4640 1 -- 172.21.15.102:0/366709366 wait complete. 2024-09-21T03:33:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:43 smithi148 ceph-mon[34651]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:43 smithi121 ceph-mon[34316]: from='client.15453 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:33:44.254 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:33:44.503 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:44.623 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/366709366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:44.623 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:44 smithi102 ceph-mon[31392]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:33:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/366709366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:44 smithi148 ceph-mon[34651]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:33:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/366709366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:33:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:44 smithi121 ceph-mon[34316]: pgmap v329: 97 pgs: 97 active+clean; 645 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-21T03:33:44.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 -- 172.21.15.102:0/879509043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700108cf0 msgr2=0x7f370010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 --2- 172.21.15.102:0/879509043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700108cf0 0x7f370010f520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009ca0 tx=0x7f36f802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 -- 172.21.15.102:0/879509043 shutdown_connections 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 --2- 172.21.15.102:0/879509043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700108cf0 0x7f370010f520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 --2- 172.21.15.102:0/879509043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f37001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 --2- 172.21.15.102:0/879509043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700102a60 0x7f3700102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 -- 172.21.15.102:0/879509043 >> 172.21.15.102:0/879509043 conn(0x7f3700079730 msgr2=0x7f3700079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 -- 172.21.15.102:0/879509043 shutdown_connections 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.973+0000 7f3707570640 1 -- 172.21.15.102:0/879509043 wait complete. 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 Processor -- start 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 -- start start 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f370019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:44.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700108cf0 0x7f370019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3700112aa0 con 0x7f3700102a60 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3700112920 con 0x7f3700108cf0 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3707570640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3700112c20 con 0x7f37001083a0 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f370530c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f370530c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40056/0 (socket says 172.21.15.102:40056) 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f370530c640 1 -- 172.21.15.102:0/725979102 learned_addr learned my addr 172.21.15.102:0/725979102 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.974+0000 7f3704b0b640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f370019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f3705b0d640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700108cf0 0x7f370019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 -- 172.21.15.102:0/725979102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 msgr2=0x7f370019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f370019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 -- 172.21.15.102:0/725979102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700108cf0 msgr2=0x7f370019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700108cf0 0x7f370019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:44.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 -- 172.21.15.102:0/725979102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37001a0450 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f3704b0b640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f370019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f370530c640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e9f0 tx=0x7f36fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc00cd80 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37001a0740 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f36fc010900 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc0188d0 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.975+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37001a6ea0 con 0x7f3700102a60 2024-09-21T03:33:44.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.976+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3700102e70 con 0x7f3700102a60 2024-09-21T03:33:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.978+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7f36fc010ab0 con 0x7f3700102a60 2024-09-21T03:33:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.979+0000 7f36f67fc640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 0x7f36ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.979+0000 7f3704b0b640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 0x7f36ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.979+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f36fc0e7e10 con 0x7f3700102a60 2024-09-21T03:33:44.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.979+0000 7f3704b0b640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 0x7f36ec0b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36f00058c0 tx=0x7f36f0005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:44.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:44.982+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36fc0ae570 con 0x7f3700102a60 2024-09-21T03:33:45.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.159+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f370019b610 con 0x7f3700102a60 2024-09-21T03:33:45.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.160+0000 7f36f67fc640 1 -- 172.21.15.102:0/725979102 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+23292 (secure 0 0 0) 0x7f36fc0b2950 con 0x7f3700102a60 2024-09-21T03:33:45.163 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:33:45.163 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":81,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:33:05.309127+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 msgr2=0x7f36ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 0x7f36ec0b8a70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f36f00058c0 tx=0x7f36f0005850 comp rx=0 tx=0).stop 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 msgr2=0x7f370019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00e9f0 tx=0x7f36fc00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 shutdown_connections 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f36ec0b6560 0x7f36ec0b8a70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3700108cf0 0x7f370019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:45.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37001083a0 0x7f370019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 --2- 172.21.15.102:0/725979102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3700102a60 0x7f370019a4e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 >> 172.21.15.102:0/725979102 conn(0x7f3700079730 msgr2=0x7f370006b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 shutdown_connections 2024-09-21T03:33:45.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:45.163+0000 7f3707570640 1 -- 172.21.15.102:0/725979102 wait complete. 2024-09-21T03:33:45.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/725979102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/725979102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:45 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/725979102' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:33:45.880 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T03:33:45.880 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T03:33:45.889 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:33:45.889 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:33:45.889 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T03:33:45.890 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T03:33:45.890 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:33:45.890 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.005+0000 7fe1dfe71640 1 -- 172.21.15.102:0/1663232228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d810dd80 msgr2=0x7fe1d8110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.005+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/1663232228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d810dd80 0x7fe1d8110260 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009ca0 tx=0x7fe1d002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 -- 172.21.15.102:0/1663232228 shutdown_connections 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/1663232228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d810dd80 0x7fe1d8110260 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/1663232228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 0x7fe1d810d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/1663232228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d8104960 0x7fe1d8104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 -- 172.21.15.102:0/1663232228 >> 172.21.15.102:0/1663232228 conn(0x7fe1d807a740 msgr2=0x7fe1d807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 -- 172.21.15.102:0/1663232228 shutdown_connections 2024-09-21T03:33:46.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 -- 172.21.15.102:0/1663232228 wait complete. 2024-09-21T03:33:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 Processor -- start 2024-09-21T03:33:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.006+0000 7fe1dfe71640 1 -- start start 2024-09-21T03:33:46.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 0x7fe1d819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d810dd80 0x7fe1d819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8113b80 con 0x7fe1d8104960 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8113a00 con 0x7fe1d810dd80 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dfe71640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8113d00 con 0x7fe1d81052b0 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40076/0 (socket says 172.21.15.102:40076) 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 -- 172.21.15.102:0/4272356519 learned_addr learned my addr 172.21.15.102:0/4272356519 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1dd40c640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 0x7fe1d819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 -- 172.21.15.102:0/4272356519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 msgr2=0x7fe1d819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 0x7fe1d819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 -- 172.21.15.102:0/4272356519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d810dd80 msgr2=0x7fe1d819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1de40e640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d810dd80 0x7fe1d819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d810dd80 0x7fe1d819fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 -- 172.21.15.102:0/4272356519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81a0420 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ddc0d640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c920 tx=0x7fe1d400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.007+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4007c70 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.008+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d81a0710 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.008+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d4007e10 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.008+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40188c0 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.008+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d81a6f30 con 0x7fe1d8104960 2024-09-21T03:33:46.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.009+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d8104d70 con 0x7fe1d8104960 2024-09-21T03:33:46.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.011+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 22) ==== 154530+0+0 (secure 0 0 0) 0x7fe1d4018a60 con 0x7fe1d8104960 2024-09-21T03:33:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.012+0000 7fe1ceffd640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 0x7fe1c40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.012+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe1d40e7960 con 0x7fe1d8104960 2024-09-21T03:33:46.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.012+0000 7fe1dd40c640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 0x7fe1c40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.013+0000 7fe1dd40c640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 0x7fe1c40b8a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8005fd0 tx=0x7fe1c800b510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.015+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1d4014030 con 0x7fe1d8104960 2024-09-21T03:33:46.163 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:46.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.240+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe1d8106eb0 con 0x7fe1c40b6560 2024-09-21T03:33:46.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.407+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7fe1d40a9cc0 con 0x7fe1d8104960 2024-09-21T03:33:46.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.421+0000 7fe1ceffd640 1 -- 172.21.15.102:0/4272356519 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe1d8106eb0 con 0x7fe1c40b6560 2024-09-21T03:33:46.424 INFO:teuthology.orchestra.run.smithi102.stdout:Schedule set for path / 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 msgr2=0x7fe1c40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 0x7fe1c40b8a70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8005fd0 tx=0x7fe1c800b510 comp rx=0 tx=0).stop 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 msgr2=0x7fe1d819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c920 tx=0x7fe1d400cde0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 shutdown_connections 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6560 0x7fe1c40b8a70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d810dd80 0x7fe1d819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81052b0 0x7fe1d819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 --2- 172.21.15.102:0/4272356519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8104960 0x7fe1d819a580 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 >> 172.21.15.102:0/4272356519 conn(0x7fe1d807a740 msgr2=0x7fe1d8105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 shutdown_connections 2024-09-21T03:33:46.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.424+0000 7fe1dfe71640 1 -- 172.21.15.102:0/4272356519 wait complete. 2024-09-21T03:33:46.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T03:33:46.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 -- 172.21.15.102:0/2741186630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 msgr2=0x7f5fdc109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/2741186630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc109840 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009900 tx=0x7f5fd002a410 comp rx=0 tx=0).stop 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 -- 172.21.15.102:0/2741186630 shutdown_connections 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/2741186630 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc109840 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/2741186630 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc1105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/2741186630 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 -- 172.21.15.102:0/2741186630 >> 172.21.15.102:0/2741186630 conn(0x7f5fdc0ff500 msgr2=0x7f5fdc101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.552+0000 7f5fe29b0640 1 -- 172.21.15.102:0/2741186630 shutdown_connections 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.553+0000 7f5fe29b0640 1 -- 172.21.15.102:0/2741186630 wait complete. 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.553+0000 7f5fe29b0640 1 Processor -- start 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.553+0000 7f5fe29b0640 1 -- start start 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc113b60 con 0x7f5fdc109430 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc1139e0 con 0x7f5fdc103b00 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5fdc113ce0 con 0x7f5fdc109d80 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40116/0 (socket says 172.21.15.102:40116) 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 -- 172.21.15.102:0/3938777441 learned_addr learned my addr 172.21.15.102:0/3938777441 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe0f4d640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 -- 172.21.15.102:0/3938777441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 msgr2=0x7f5fdc19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdbfff640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 -- 172.21.15.102:0/3938777441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 msgr2=0x7f5fdc19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 -- 172.21.15.102:0/3938777441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fdc1a0530 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe0f4d640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdbfff640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fdb7fe640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0005940 tx=0x7f5fd00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd003f030 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5fd0031910 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fdc1a07c0 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0035070 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.554+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fdc1a6fb0 con 0x7f5fdc109430 2024-09-21T03:33:46.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.555+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fdc104d70 con 0x7f5fdc109430 2024-09-21T03:33:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.557+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7f5fd0042030 con 0x7f5fdc109430 2024-09-21T03:33:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.558+0000 7f5fd97fa640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 0x7f5fc40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.558+0000 7f5fdbfff640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 0x7f5fc40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.558+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5fd0107e30 con 0x7f5fdc109430 2024-09-21T03:33:46.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.558+0000 7f5fdbfff640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 0x7f5fc40b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0058c0 tx=0x7f5fcc005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.561+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fd00ce430 con 0x7f5fdc109430 2024-09-21T03:33:46.694 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:46 smithi102 ceph-mon[31392]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:46.694 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:46 smithi102 ceph-mon[31392]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:33:46.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.691+0000 7f5282e63640 1 -- 172.21.15.102:0/668878011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c108cf0 msgr2=0x7f527c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.691+0000 7f5282e63640 1 --2- 172.21.15.102:0/668878011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c108cf0 0x7f527c10f520 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5274009ca0 tx=0x7f527402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 -- 172.21.15.102:0/668878011 shutdown_connections 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 --2- 172.21.15.102:0/668878011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c108cf0 0x7f527c10f520 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 --2- 172.21.15.102:0/668878011 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c1083a0 0x7f527c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 --2- 172.21.15.102:0/668878011 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c102a60 0x7f527c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 -- 172.21.15.102:0/668878011 >> 172.21.15.102:0/668878011 conn(0x7f527c079730 msgr2=0x7f527c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 -- 172.21.15.102:0/668878011 shutdown_connections 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.692+0000 7f5282e63640 1 -- 172.21.15.102:0/668878011 wait complete. 2024-09-21T03:33:46.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 Processor -- start 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 -- start start 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 0x7f527c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 0x7f527c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c112aa0 con 0x7f527c1083a0 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f527c112920 con 0x7f527c102a60 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5282e63640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f527c112c20 con 0x7f527c108cf0 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40130/0 (socket says 172.21.15.102:40130) 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f527bfff640 1 -- 172.21.15.102:0/1072920057 learned_addr learned my addr 172.21.15.102:0/1072920057 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5280bff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 0x7f527c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.693+0000 7f5281400640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 0x7f527c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 -- 172.21.15.102:0/1072920057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 msgr2=0x7f527c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 0x7f527c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 -- 172.21.15.102:0/1072920057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 msgr2=0x7f527c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 0x7f527c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 -- 172.21.15.102:0/1072920057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c1a04d0 con 0x7f527c1083a0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5281400640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 0x7f527c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5280bff640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 0x7f527c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f527bfff640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f526800e9a0 tx=0x7f526800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5279ffb640 1 -- 172.21.15.102:0/1072920057 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526800cd80 con 0x7f527c1083a0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527c1a07c0 con 0x7f527c1083a0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5279ffb640 1 -- 172.21.15.102:0/1072920057 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52680035f0 con 0x7f527c1083a0 2024-09-21T03:33:46.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5279ffb640 1 -- 172.21.15.102:0/1072920057 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268010690 con 0x7f527c1083a0 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.694+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527c1a6f20 con 0x7f527c1083a0 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.697+0000 7f5279ffb640 1 -- 172.21.15.102:0/1072920057 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7f52680037a0 con 0x7f527c1083a0 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.697+0000 7f52893d7740 1 Processor -- start 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 -- start start 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f5279ffb640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 0x7f526c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882d6350 0x55c48867d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c48867deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c4885f3e60 con 0x55c4882ad490 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c4885e3290 con 0x55c4882d6350 2024-09-21T03:33:46.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f52893d7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c4885e70a0 con 0x55c4882b5670 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f5281400640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 0x7f526c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f5279ffb640 1 -- 172.21.15.102:0/1072920057 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f52680e7900 con 0x7f527c1083a0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40144/0 (socket says 172.21.15.102:40144) 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 -- 172.21.15.102:0/2877419265 learned_addr learned my addr 172.21.15.102:0/2877419265 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f5281400640 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c48867deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 -- 172.21.15.102:0/2877419265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 msgr2=0x55c48867deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c48867deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 -- 172.21.15.102:0/2877419265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882d6350 msgr2=0x55c48867d430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882d6350 0x55c48867d430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f527bfff640 1 -- 172.21.15.102:0/2877419265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c488341930 con 0x55c4882ad490 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.698+0000 7f5281400640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 0x7f526c0b8b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5274006010 tx=0x7f5274009460 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.699+0000 7f527bfff640 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f52680e5700 tx=0x7f52680a9f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1007226cc8ae0c9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.699+0000 7f5266ffd640 1 -- 172.21.15.102:0/2877419265 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680acf70 con 0x55c4882ad490 2024-09-21T03:33:46.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.699+0000 7f5266ffd640 1 -- 172.21.15.102:0/2877419265 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5268016ea0 con 0x55c4882ad490 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.699+0000 7f5266ffd640 1 -- 172.21.15.102:0/2877419265 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268012d90 con 0x55c4882ad490 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- 172.21.15.102:0/2877419265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 msgr2=0x55c48867d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f52680e5700 tx=0x7f52680a9f80 comp rx=0 tx=0).stop 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- 172.21.15.102:0/2877419265 shutdown_connections 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882ad490 0x55c48867d970 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c48867deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 --2- 172.21.15.102:0/2877419265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882d6350 0x55c48867d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- 172.21.15.102:0/2877419265 >> 172.21.15.102:0/2877419265 conn(0x55c4882ca740 msgr2=0x55c48867b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- 172.21.15.102:0/2877419265 shutdown_connections 2024-09-21T03:33:46.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- 172.21.15.102:0/2877419265 wait complete. 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 -- start start 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.700+0000 7f52893d7740 1 Processor -- start 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488688fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c488694f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c488444890 con 0x55c4882b5670 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c48857dd40 con 0x55c4882ad490 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c48868bc10 con 0x55c4882d6350 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f52893d7740 10 client.0 _ll_register_callbacks cb 0x55c4885e1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40148/0 (socket says 172.21.15.102:40148) 2024-09-21T03:33:46.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 -- 172.21.15.102:0/2811721934 learned_addr learned my addr 172.21.15.102:0/2811721934 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f5280bff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488688fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f5281400640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c488694f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 -- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 msgr2=0x55c488694f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c488694f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 -- 172.21.15.102:0/2811721934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 msgr2=0x55c488688fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488688fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 -- 172.21.15.102:0/2811721934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4886954c0 con 0x55c4882b5670 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f527bfff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f526800e970 tx=0x7f52680e5160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f78fc7de26632a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.701+0000 7f525bfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52680acf70 con 0x55c4882b5670 2024-09-21T03:33:46.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f52680120f0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5268016ea0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f52680122f0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 10 client.15495 fetch_fsmap learned FSMap version 24 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c488697df0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5268016ea0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f526801e2b0 con 0x55c4882b5670 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 10 client.15495 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 20 client.15495 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:46.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c488294cd0 0x55c48869b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 4 client.15495 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4885f5db0 con 0x55c488294cd0 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.702+0000 7f5280bff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c488294cd0 0x55c48869b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.703+0000 7f525bfff640 10 client.15495 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.703+0000 7f5280bff640 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c488294cd0 0x55c48869b150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29a24cf9964e9aa0 server_cookie=b63a7e081b694e6c in_seq=0 out_seq=0 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f525bfff640 1 -- 172.21.15.102:0/2811721934 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4885f5db0 con 0x55c488294cd0 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f525bfff640 10 client.15495 handle_command_reply: tid=0 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 client.15495 shutdown 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 msgr2=0x55c488689510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f526800e970 tx=0x7f52680e5160 comp rx=0 tx=0).stop 2024-09-21T03:33:46.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 shutdown_connections 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c488294cd0 0x55c48869b150 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c488689510 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c488694f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 --2- 172.21.15.102:0/2811721934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488688fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 >> 172.21.15.102:0/2811721934 conn(0x55c4882ca740 msgr2=0x55c48867e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f525bfff640 0 client.15495 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 shutdown_connections 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 1 -- 172.21.15.102:0/2811721934 wait complete. 2024-09-21T03:33:46.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.704+0000 7f52893d7740 20 client.15495 trim_cache size 0 max 16384 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 Processor -- start 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 -- start start 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488682540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c488682a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1b2290 con 0x55c4882d6350 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1afb60 con 0x55c4882ad490 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f52893d7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1ad9b0 con 0x55c4882b5670 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f5281400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f5281400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40160/0 (socket says 172.21.15.102:40160) 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f5281400640 1 -- 172.21.15.102:0/1183807679 learned_addr learned my addr 172.21.15.102:0/1183807679 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f527bfff640 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c488682a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.741+0000 7f5280bff640 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488682540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 -- 172.21.15.102:0/1183807679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 msgr2=0x55c488682a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c488682a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 -- 172.21.15.102:0/1183807679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 msgr2=0x55c488682540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488682540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 -- 172.21.15.102:0/1183807679 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c488687d30 con 0x55c4882d6350 2024-09-21T03:33:46.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f5281400640 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5274031eb0 tx=0x7f5274046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b2a69c48e90234 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f52667fc640 1 -- 172.21.15.102:0/1183807679 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5274056070 con 0x55c4882d6350 2024-09-21T03:33:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f52667fc640 1 -- 172.21.15.102:0/1183807679 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5274036040 con 0x55c4882d6350 2024-09-21T03:33:46.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.742+0000 7f52667fc640 1 -- 172.21.15.102:0/1183807679 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527402fc50 con 0x55c4882d6350 2024-09-21T03:33:46.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:46 smithi148 ceph-mon[34651]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:46.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:46 smithi148 ceph-mon[34651]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:33:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 -- 172.21.15.102:0/1183807679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 msgr2=0x55c48867ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5274031eb0 tx=0x7f5274046000 comp rx=0 tx=0).stop 2024-09-21T03:33:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 -- 172.21.15.102:0/1183807679 shutdown_connections 2024-09-21T03:33:46.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882d6350 0x55c48867ac80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882b5670 0x55c488682a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 --2- 172.21.15.102:0/1183807679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c488682540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.743+0000 7f52893d7740 1 -- 172.21.15.102:0/1183807679 >> 172.21.15.102:0/1183807679 conn(0x55c4882ca740 msgr2=0x55c488688fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 -- 172.21.15.102:0/1183807679 shutdown_connections 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 -- 172.21.15.102:0/1183807679 wait complete. 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 -- start start 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 Processor -- start 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c48869e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.744+0000 7f52893d7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c48869d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f52893d7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1ae020 con 0x55c4882b5670 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f52893d7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1af490 con 0x55c4882ad490 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f52893d7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f527c1ae6f0 con 0x55c4882d6350 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f52893d7740 10 client.0 _ll_register_callbacks cb 0x7f52680a9e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f527bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40164/0 (socket says 172.21.15.102:40164) 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f527bfff640 1 -- 172.21.15.102:0/3094381138 learned_addr learned my addr 172.21.15.102:0/3094381138 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c48869e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5281400640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c48869d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 -- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 msgr2=0x55c48869d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c48869d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 -- 172.21.15.102:0/3094381138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 msgr2=0x55c48869cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 -- 172.21.15.102:0/3094381138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c48869da60 con 0x55c4882ad490 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f527bfff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f5280bff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c48869e900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c4885e33e0 tx=0x7f5270013920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c4e3aff96de843 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f525bfff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.745+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527002a060 con 0x55c4882ad490 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5274036040 con 0x55c4882ad490 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5270004250 con 0x55c4882ad490 2024-09-21T03:33:46.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5270021040 con 0x55c4882ad490 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 10 client.25049 fetch_fsmap learned FSMap version 24 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c488706850 con 0x55c4882ad490 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5274036040 con 0x55c4882ad490 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f5270010690 con 0x55c4882ad490 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 10 client.25049 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 10 client.25049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 20 client.25049 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c48826a080 0x55c488708fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 4 client.25049 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.746+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c4885f1860 con 0x55c48826a080 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.747+0000 7f527bfff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c48826a080 0x55c488708fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.747+0000 7f527bfff640 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c48826a080 0x55c488708fc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d3b8e3d2d015863 server_cookie=288a446878f9ec97 in_seq=0 out_seq=0 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.747+0000 7f525bfff640 10 client.25049 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.748+0000 7f525bfff640 1 -- 172.21.15.102:0/3094381138 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c4885f1860 con 0x55c48826a080 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.748+0000 7f525bfff640 10 client.25049 handle_command_reply: tid=0 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.748+0000 7f52893d7740 1 client.25049 shutdown 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.748+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 msgr2=0x55c48869e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c48869e900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x55c4885e33e0 tx=0x7f5270013920 comp rx=0 tx=0).stop 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 shutdown_connections 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c48826a080 0x55c488708fc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c4882b5670 0x55c48869cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c4882d6350 0x55c48869d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f525bfff640 0 client.25049 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 --2- 172.21.15.102:0/3094381138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c4882ad490 0x55c48869e900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 >> 172.21.15.102:0/3094381138 conn(0x55c4882ca740 msgr2=0x55c488688fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 shutdown_connections 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 1 -- 172.21.15.102:0/3094381138 wait complete. 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.749+0000 7f52893d7740 20 client.25049 trim_cache size 0 max 16384 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "89613b17-b55e-4dcd-af5e-178e21733a6f", 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:33:46.757 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 msgr2=0x7f526c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 0x7f526c0b8b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5274006010 tx=0x7f5274009460 comp rx=0 tx=0).stop 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 msgr2=0x7f527c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f526800e9a0 tx=0x7f526800ee60 comp rx=0 tx=0).stop 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 shutdown_connections 2024-09-21T03:33:46.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f526c0b65f0 0x7f526c0b8b00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f527c1083a0 0x7f527c19ab00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f527c108cf0 0x7f527c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 --2- 172.21.15.102:0/1072920057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f527c102a60 0x7f527c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 >> 172.21.15.102:0/1072920057 conn(0x7f527c079730 msgr2=0x7f527c1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 shutdown_connections 2024-09-21T03:33:46.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.750+0000 7f5282e63640 1 -- 172.21.15.102:0/1072920057 wait complete. 2024-09-21T03:33:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:46 smithi121 ceph-mon[34316]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:46.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:46 smithi121 ceph-mon[34316]: pgmap v330: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:33:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.796+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f5fdc0638a0 con 0x7f5fc40b65f0 2024-09-21T03:33:46.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.859+0000 7f5fd97fa640 1 -- 172.21.15.102:0/3938777441 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f5fdc0638a0 con 0x7f5fc40b65f0 2024-09-21T03:33:46.861 INFO:teuthology.orchestra.run.smithi102.stdout:Retention added to path / 2024-09-21T03:33:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 msgr2=0x7f5fc40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 0x7f5fc40b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc0058c0 tx=0x7f5fcc005d30 comp rx=0 tx=0).stop 2024-09-21T03:33:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 msgr2=0x7f5fdc19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0005940 tx=0x7f5fd00042f0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 shutdown_connections 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5fc40b65f0 0x7f5fc40b8b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5fdc109430 0x7f5fdc19aba0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5fdc109d80 0x7f5fdc19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 --2- 172.21.15.102:0/3938777441 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5fdc103b00 0x7f5fdc19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 >> 172.21.15.102:0/3938777441 conn(0x7f5fdc0ff500 msgr2=0x7f5fdc108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 shutdown_connections 2024-09-21T03:33:46.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.861+0000 7f5fe29b0640 1 -- 172.21.15.102:0/3938777441 wait complete. 2024-09-21T03:33:46.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 -- 172.21.15.102:0/4044465260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 msgr2=0x7f397810f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 --2- 172.21.15.102:0/4044465260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397810f4b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3970009ca0 tx=0x7f397002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 -- 172.21.15.102:0/4044465260 shutdown_connections 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 --2- 172.21.15.102:0/4044465260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397810f4b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 --2- 172.21.15.102:0/4044465260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3978108330 0x7f3978108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.989+0000 7f3980520640 1 --2- 172.21.15.102:0/4044465260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f39781030d0 0x7f39781034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 -- 172.21.15.102:0/4044465260 >> 172.21.15.102:0/4044465260 conn(0x7f3978077ad0 msgr2=0x7f3978077f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:46.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 -- 172.21.15.102:0/4044465260 shutdown_connections 2024-09-21T03:33:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 -- 172.21.15.102:0/4044465260 wait complete. 2024-09-21T03:33:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 Processor -- start 2024-09-21T03:33:46.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 -- start start 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 0x7f397819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.990+0000 7f3980520640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 0x7f397819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3978112a60 con 0x7f3978108c80 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f39781128e0 con 0x7f39781030d0 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3978112be0 con 0x7f3978108330 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40176/0 (socket says 172.21.15.102:40176) 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 -- 172.21.15.102:0/1764490613 learned_addr learned my addr 172.21.15.102:0/1764490613 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397dabb640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 0x7f397819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397e2bc640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 0x7f397819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 -- 172.21.15.102:0/1764490613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 msgr2=0x7f397819b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 0x7f397819b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 -- 172.21.15.102:0/1764490613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 msgr2=0x7f397819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 0x7f397819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 -- 172.21.15.102:0/1764490613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781a6530 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397dabb640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 0x7f397819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397e2bc640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 0x7f397819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f397eabd640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3970005e30 tx=0x7f3970003d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970031650 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f39700317f0 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39781a67c0 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397002fac0 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.991+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39781a6d10 con 0x7f3978108c80 2024-09-21T03:33:46.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.992+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39781034e0 con 0x7f3978108c80 2024-09-21T03:33:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.994+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7f397002fc60 con 0x7f3978108c80 2024-09-21T03:33:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.995+0000 7f396f7fe640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 0x7f39640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.995+0000 7f397e2bc640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 0x7f39640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.995+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3970108b40 con 0x7f3978108c80 2024-09-21T03:33:46.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.995+0000 7f397e2bc640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 0x7f39640b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3978102880 tx=0x7f3974005db0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:47.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:46.998+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f397003b410 con 0x7f3978108c80 2024-09-21T03:33:47.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.201+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f3978063800 con 0x7f39640b65f0 2024-09-21T03:33:47.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.208+0000 7f396f7fe640 1 -- 172.21.15.102:0/1764490613 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f3978063800 con 0x7f39640b65f0 2024-09-21T03:33:47.210 INFO:teuthology.orchestra.run.smithi102.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:33:46", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 msgr2=0x7f39640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 0x7f39640b8b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3978102880 tx=0x7f3974005db0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 msgr2=0x7f397819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3970005e30 tx=0x7f3970003d80 comp rx=0 tx=0).stop 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 shutdown_connections 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f39640b65f0 0x7f39640b8b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3978108c80 0x7f397819bdb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3978108330 0x7f397819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 --2- 172.21.15.102:0/1764490613 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f39781030d0 0x7f397819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 >> 172.21.15.102:0/1764490613 conn(0x7f3978077ad0 msgr2=0x7f3978106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 shutdown_connections 2024-09-21T03:33:47.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.210+0000 7f3980520640 1 -- 172.21.15.102:0/1764490613 wait complete. 2024-09-21T03:33:47.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T03:33:47.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 -- 172.21.15.102:0/3394814243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 msgr2=0x7fe72010f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 --2- 172.21.15.102:0/3394814243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72010f2d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe718009ca0 tx=0x7fe71802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 -- 172.21.15.102:0/3394814243 shutdown_connections 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 --2- 172.21.15.102:0/3394814243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72010f2d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 --2- 172.21.15.102:0/3394814243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720108150 0x7fe720108560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 --2- 172.21.15.102:0/3394814243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720102820 0x7fe720102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 -- 172.21.15.102:0/3394814243 >> 172.21.15.102:0/3394814243 conn(0x7fe7200fe260 msgr2=0x7fe7201006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 -- 172.21.15.102:0/3394814243 shutdown_connections 2024-09-21T03:33:47.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.334+0000 7fe72699d640 1 -- 172.21.15.102:0/3394814243 wait complete. 2024-09-21T03:33:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 Processor -- start 2024-09-21T03:33:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 -- start start 2024-09-21T03:33:47.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 0x7fe72019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720108150 0x7fe72019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7201139a0 con 0x7fe720108aa0 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe720113820 con 0x7fe720102820 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72699d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe720113b20 con 0x7fe720108150 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.335+0000 7fe72619c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40198/0 (socket says 172.21.15.102:40198) 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 -- 172.21.15.102:0/3976885315 learned_addr learned my addr 172.21.15.102:0/3976885315 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72599b640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 0x7fe72019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72519a640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720108150 0x7fe72019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 -- 172.21.15.102:0/3976885315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720108150 msgr2=0x7fe72019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720108150 0x7fe72019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 -- 172.21.15.102:0/3976885315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 msgr2=0x7fe72019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 0x7fe72019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 -- 172.21.15.102:0/3976885315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7201a0240 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72599b640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 0x7fe72019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72619c640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe718005e30 tx=0x7fe718003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718031650 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe7180317f0 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7201a04d0 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71802fb70 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.336+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7201a6d50 con 0x7fe720108aa0 2024-09-21T03:33:47.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.337+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe720103a90 con 0x7fe720108aa0 2024-09-21T03:33:47.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.339+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7fe71802fd10 con 0x7fe720108aa0 2024-09-21T03:33:47.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.340+0000 7fe716ffd640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 0x7fe70c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:47.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.340+0000 7fe72599b640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 0x7fe70c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:47.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.340+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe718108bc0 con 0x7fe720108aa0 2024-09-21T03:33:47.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.341+0000 7fe72599b640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 0x7fe70c0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe710009b40 tx=0x7fe710005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:47.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.345+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7180cf1c0 con 0x7fe720108aa0 2024-09-21T03:33:47.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:33:47.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.554+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fe72010a8f0 con 0x7fe70c0b65f0 2024-09-21T03:33:47.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.561+0000 7fe716ffd640 1 -- 172.21.15.102:0/3976885315 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fe72010a8f0 con 0x7fe70c0b65f0 2024-09-21T03:33:47.565 INFO:teuthology.orchestra.run.smithi102.stdout:/ 1m 6m3h 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 msgr2=0x7fe70c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 0x7fe70c0b8b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe710009b40 tx=0x7fe710005e50 comp rx=0 tx=0).stop 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 msgr2=0x7fe72019fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe718005e30 tx=0x7fe718003f90 comp rx=0 tx=0).stop 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 shutdown_connections 2024-09-21T03:33:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe70c0b65f0 0x7fe70c0b8b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe720108aa0 0x7fe72019fbd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe720108150 0x7fe72019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 --2- 172.21.15.102:0/3976885315 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe720102820 0x7fe72019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 >> 172.21.15.102:0/3976885315 conn(0x7fe7200fe260 msgr2=0x7fe720105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 shutdown_connections 2024-09-21T03:33:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:47.563+0000 7fe72699d640 1 -- 172.21.15.102:0/3976885315 wait complete. 2024-09-21T03:33:47.577 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T03:33:47.601 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:47 smithi102 ceph-mon[31392]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:33:47.602 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:47 smithi102 ceph-mon[31392]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.602 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:47 smithi102 ceph-mon[31392]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.607 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T03:33:47.619 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T03:33:47.648 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:33:47.648 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T03:33:47.649 INFO:tasks.workunit:timeout=3h 2024-09-21T03:33:47.649 INFO:tasks.workunit:cleanup=True 2024-09-21T03:33:47.649 DEBUG:teuthology.orchestra.run.smithi102:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:47.650 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-21 03:32:00.023774535 +0000 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-21 03:32:00.023774535 +0000 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-21 03:33:37.186440509 +0000 2024-09-21T03:33:47.665 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-21 03:32:00.023774535 +0000 2024-09-21T03:33:47.666 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T03:33:47.666 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T03:33:47.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:47 smithi121 ceph-mon[34316]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:33:47.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:47 smithi121 ceph-mon[34316]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:47 smithi121 ceph-mon[34316]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.736 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:33:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:47 smithi148 ceph-mon[34651]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T03:33:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:47 smithi148 ceph-mon[34651]: from='client.15483 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:47 smithi148 ceph-mon[34651]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:47.791 INFO:tasks.workunit.client.0.smithi102.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.128+0000 7f9d6aac1640 1 -- 172.21.15.102:0/3862617313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d641083b0 msgr2=0x7f9d641087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.128+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/3862617313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d641083b0 0x7f9d641087c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009900 tx=0x7f9d4c02a410 comp rx=0 tx=0).stop 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.128+0000 7f9d6aac1640 1 -- 172.21.15.102:0/3862617313 shutdown_connections 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/3862617313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d641083b0 0x7f9d641087c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/3862617313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64108d00 0x7f9d6410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/3862617313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d64102a70 0x7f9d64102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 -- 172.21.15.102:0/3862617313 >> 172.21.15.102:0/3862617313 conn(0x7f9d64079710 msgr2=0x7f9d64079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 -- 172.21.15.102:0/3862617313 shutdown_connections 2024-09-21T03:33:48.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 -- 172.21.15.102:0/3862617313 wait complete. 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 Processor -- start 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.129+0000 7f9d6aac1640 1 -- start start 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 0x7f9d6419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64108d00 0x7f9d6419fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64112ae0 con 0x7f9d64102a70 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64112960 con 0x7f9d64108d00 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64112c60 con 0x7f9d641083b0 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40208/0 (socket says 172.21.15.102:40208) 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 -- 172.21.15.102:0/2086062771 learned_addr learned my addr 172.21.15.102:0/2086062771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d63fff640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 0x7f9d6419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 -- 172.21.15.102:0/2086062771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 msgr2=0x7f9d6419abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 0x7f9d6419abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 -- 172.21.15.102:0/2086062771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64108d00 msgr2=0x7f9d6419fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64108d00 0x7f9d6419fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 -- 172.21.15.102:0/2086062771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d641a05b0 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d63fff640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 0x7f9d6419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6885d640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400d770 tx=0x7f9d5400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d61ffb640 1 -- 172.21.15.102:0/2086062771 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54017070 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d61ffb640 1 -- 172.21.15.102:0/2086062771 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d540054f0 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d641a08a0 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.130+0000 7f9d61ffb640 1 -- 172.21.15.102:0/2086062771 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54004de0 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.131+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d641a7000 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.133+0000 7f9d61ffb640 1 -- 172.21.15.102:0/2086062771 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 23) ==== 154587+0+0 (secure 0 0 0) 0x7f9d54004f80 con 0x7f9d64102a70 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.133+0000 7f9d71035740 1 Processor -- start 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.133+0000 7f9d71035740 1 -- start start 2024-09-21T03:33:48.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594d77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e55944de50 con 0x55e559130070 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e55943d280 con 0x55e5591071b0 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d71035740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e559441090 con 0x55e55910f390 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40218/0 (socket says 172.21.15.102:40218) 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 -- 172.21.15.102:0/3021421458 learned_addr learned my addr 172.21.15.102:0/3021421458 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d61ffb640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 0x7f9d440b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6885d640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594d77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d63fff640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 -- 172.21.15.102:0/3021421458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 msgr2=0x55e5594d7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594d7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 -- 172.21.15.102:0/3021421458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 msgr2=0x55e5594d77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594d77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 -- 172.21.15.102:0/3021421458 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e55919b650 con 0x55e559130070 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6885d640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594d77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d63fff640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d61ffb640 1 -- 172.21.15.102:0/2086062771 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9d540e70e0 con 0x7f9d64102a70 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 0x7f9d440b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.134+0000 7f9d6905e640 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009ef0 tx=0x7f9d5c00d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b98c1f2a569d464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d5affd640 1 -- 172.21.15.102:0/3021421458 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c018070 con 0x55e559130070 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d5affd640 1 -- 172.21.15.102:0/3021421458 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d5c012e30 con 0x55e559130070 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d5affd640 1 -- 172.21.15.102:0/3021421458 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0054d0 con 0x55e559130070 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d71035740 1 -- 172.21.15.102:0/3021421458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 msgr2=0x55e5594d7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d6905e640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 0x7f9d440b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c01e000 tx=0x7f9d5c01b000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.135+0000 7f9d71035740 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009ef0 tx=0x7f9d5c00d6b0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 -- 172.21.15.102:0/3021421458 shutdown_connections 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594d77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 --2- 172.21.15.102:0/3021421458 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e5594d7270 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 -- 172.21.15.102:0/3021421458 >> 172.21.15.102:0/3021421458 conn(0x55e559124460 msgr2=0x55e5594d5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 -- 172.21.15.102:0/3021421458 shutdown_connections 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 -- 172.21.15.102:0/3021421458 wait complete. 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 -- start start 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 Processor -- start 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.136+0000 7f9d71035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e55910f390 0x55e5594e2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 0x55e5594e3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e55929e700 con 0x55e5591071b0 2024-09-21T03:33:48.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e5593d8110 con 0x55e55910f390 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e5594e5a50 con 0x55e559130070 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 10 client.0 _ll_register_callbacks cb 0x55e5593f1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40234/0 (socket says 172.21.15.102:40234) 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 -- 172.21.15.102:0/3753514547 learned_addr learned my addr 172.21.15.102:0/3753514547 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6905e640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 0x55e5594e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d63fff640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e55910f390 0x55e5594e2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 -- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 msgr2=0x55e5594e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 0x55e5594e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 -- 172.21.15.102:0/3753514547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e55910f390 msgr2=0x55e5594e2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e55910f390 0x55e5594e2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 -- 172.21.15.102:0/3753514547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e559405c40 con 0x55e5591071b0 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6905e640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 0x55e5594e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:48.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d6885d640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d540acd80 tx=0x7f9d54078c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6f60c2a0b94568 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d53fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54020040 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9d540a92f0 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5c012e30 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d540ac7f0 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 10 client.15525 fetch_fsmap learned FSMap version 24 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.137+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e5594f15e0 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d5c012e30 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d54076b40 con 0x55e5591071b0 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 10 client.15525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 20 client.15525 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590ee9f0 0x55e5594f4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 4 client.15525 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:33:48.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e55944fda0 con 0x55e5590ee9f0 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.138+0000 7f9d63fff640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590ee9f0 0x55e5594f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.139+0000 7f9d53fff640 10 client.15525 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.139+0000 7f9d63fff640 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590ee9f0 0x55e5594f4960 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f02b04be6fe0a30e server_cookie=19373f288f4a56b9 in_seq=0 out_seq=0 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.139+0000 7f9d53fff640 1 -- 172.21.15.102:0/3753514547 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e55944fda0 con 0x55e5590ee9f0 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.139+0000 7f9d53fff640 10 client.15525 handle_command_reply: tid=0 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.139+0000 7f9d71035740 1 client.15525 shutdown 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 msgr2=0x55e5594e28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d540acd80 tx=0x7f9d54078c30 comp rx=0 tx=0).stop 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 shutdown_connections 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e559130070 0x55e5594e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e55910f390 0x55e5594e2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590ee9f0 0x55e5594f4960 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 --2- 172.21.15.102:0/3753514547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e28a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 >> 172.21.15.102:0/3753514547 conn(0x55e559124460 msgr2=0x55e5594da450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d53fff640 0 client.15525 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 shutdown_connections 2024-09-21T03:33:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 1 -- 172.21.15.102:0/3753514547 wait complete. 2024-09-21T03:33:48.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.140+0000 7f9d71035740 20 client.15525 trim_cache size 0 max 16384 2024-09-21T03:33:48.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 Processor -- start 2024-09-21T03:33:48.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 -- start start 2024-09-21T03:33:48.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594ee370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e559130070 0x55e5594ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641b2200 con 0x55e5591071b0 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641afad0 con 0x55e559130070 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d71035740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641ad920 con 0x55e55910f390 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40250/0 (socket says 172.21.15.102:40250) 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 -- 172.21.15.102:0/1202578040 learned_addr learned my addr 172.21.15.102:0/1202578040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d63fff640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594ee370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6905e640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e559130070 0x55e5594ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 -- 172.21.15.102:0/1202578040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 msgr2=0x55e5594ee370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594ee370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 -- 172.21.15.102:0/1202578040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e559130070 msgr2=0x55e5594ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e559130070 0x55e5594ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d6885d640 1 -- 172.21.15.102:0/1202578040 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5594d8080 con 0x55e5591071b0 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.164+0000 7f9d63fff640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.165+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9d540097f0 tx=0x7f9d540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701b0076390c3f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.165+0000 7f9d5a7fc640 1 -- 172.21.15.102:0/1202578040 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54014020 con 0x55e5591071b0 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.165+0000 7f9d5a7fc640 1 -- 172.21.15.102:0/1202578040 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d54092e50 con 0x55e5591071b0 2024-09-21T03:33:48.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.165+0000 7f9d5a7fc640 1 -- 172.21.15.102:0/1202578040 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54020030 con 0x55e5591071b0 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- 172.21.15.102:0/1202578040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 msgr2=0x55e5594e4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9d540097f0 tx=0x7f9d540057f0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- 172.21.15.102:0/1202578040 shutdown_connections 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e559130070 0x55e5594ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594ee370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 --2- 172.21.15.102:0/1202578040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e5591071b0 0x55e5594e4780 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- 172.21.15.102:0/1202578040 >> 172.21.15.102:0/1202578040 conn(0x55e559124460 msgr2=0x55e5594edc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- 172.21.15.102:0/1202578040 shutdown_connections 2024-09-21T03:33:48.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- 172.21.15.102:0/1202578040 wait complete. 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 -- start start 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.166+0000 7f9d71035740 1 Processor -- start 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641adf90 con 0x55e559130070 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641af400 con 0x55e5591071b0 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d641ae660 con 0x55e55910f390 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d71035740 10 client.0 _ll_register_callbacks cb 0x7f9d54009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40258/0 (socket says 172.21.15.102:40258) 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 -- 172.21.15.102:0/1242155353 learned_addr learned my addr 172.21.15.102:0/1242155353 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d63fff640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 -- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 msgr2=0x55e5594e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 -- 172.21.15.102:0/1242155353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 msgr2=0x55e5594e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594e6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 -- 172.21.15.102:0/1242155353 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5594e7da0 con 0x55e559130070 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d6905e640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c005b50 tx=0x7f9d5c005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d39666f3229714 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.167+0000 7f9d53fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c018040 con 0x55e559130070 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f9d5c005050 con 0x55e559130070 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d54092e50 con 0x55e559130070 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c00de80 con 0x55e559130070 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 10 client.15531 fetch_fsmap learned FSMap version 24 2024-09-21T03:33:48.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55e55955f8c0 con 0x55e559130070 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d54092e50 con 0x55e559130070 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f9d5c010570 con 0x55e559130070 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 10 client.15531 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 10 client.15531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 20 client.15531 populate_metadata read hostname 'smithi102' 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590c3da0 0x55e559561d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 4 client.15531 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e55944b850 con 0x55e5590c3da0 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.168+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590c3da0 0x55e559561d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d53fff640 10 client.15531 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d6885d640 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590c3da0 0x55e559561d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cdde41ce3e02d3d server_cookie=97a0b42490a52720 in_seq=0 out_seq=0 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d53fff640 1 -- 172.21.15.102:0/1242155353 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55e55944b850 con 0x55e5590c3da0 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d53fff640 10 client.15531 handle_command_reply: tid=0 2024-09-21T03:33:48.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 client.15531 shutdown 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 msgr2=0x55e55955e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c005b50 tx=0x7f9d5c005b80 comp rx=0 tx=0).stop 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 shutdown_connections 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e5590c3da0 0x55e559561d10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e559130070 0x55e55955e320 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e55910f390 0x55e5594e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 --2- 172.21.15.102:0/1242155353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e5591071b0 0x55e5594e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d53fff640 0 client.15531 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 >> 172.21.15.102:0/1242155353 conn(0x55e559124460 msgr2=0x55e5594ee620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 shutdown_connections 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.169+0000 7f9d71035740 1 -- 172.21.15.102:0/1242155353 wait complete. 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d71035740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T03:33:48.177 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "89613b17-b55e-4dcd-af5e-178e21733a6f", 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:33:48.178 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:33:48.179 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 msgr2=0x7f9d440b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 0x7f9d440b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c01e000 tx=0x7f9d5c01b000 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 msgr2=0x7f9d6419a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400d770 tx=0x7f9d5400dc30 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 shutdown_connections 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d440b6670 0x7f9d440b8b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64108d00 0x7f9d6419fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d641083b0 0x7f9d6419abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 --2- 172.21.15.102:0/2086062771 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d64102a70 0x7f9d6419a640 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 >> 172.21.15.102:0/2086062771 conn(0x7f9d64079710 msgr2=0x7f9d64101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:33:48.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 shutdown_connections 2024-09-21T03:33:48.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:33:48.170+0000 7f9d6aac1640 1 -- 172.21.15.102:0/2086062771 wait complete. 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:48 smithi102 ceph-mon[31392]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:48 smithi148 ceph-mon[34651]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:33:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:33:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:33:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:33:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:33:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:48 smithi121 ceph-mon[34316]: pgmap v331: 97 pgs: 97 active+clean; 650 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T03:33:48.798 INFO:tasks.cephfs.filesystem:scrub status for tag:89613b17-b55e-4dcd-af5e-178e21733a6f - {'path': '/', 'tag': '89613b17-b55e-4dcd-af5e-178e21733a6f', 'options': 'recursive,force'} 2024-09-21T03:33:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:51 smithi102 ceph-mon[31392]: pgmap v332: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:33:51.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:51 smithi148 ceph-mon[34651]: pgmap v332: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:33:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:51 smithi121 ceph-mon[34316]: pgmap v332: 97 pgs: 97 active+clean; 1.0 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 74 KiB/s wr, 14 op/s 2024-09-21T03:33:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:53 smithi102 ceph-mon[31392]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:53 smithi148 ceph-mon[34651]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:53 smithi121 ceph-mon[34316]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:55 smithi102 ceph-mon[31392]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:33:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:55 smithi148 ceph-mon[34651]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:33:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:55 smithi121 ceph-mon[34316]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:33:56.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:56 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:56 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:56.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:56 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:33:57.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:57 smithi102 ceph-mon[31392]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:57.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:57.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:57 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:57.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:57 smithi148 ceph-mon[34651]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:57 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:57 smithi121 ceph-mon[34316]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T03:33:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:57 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:33:58 smithi102 ceph-mon[31392]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:33:58 smithi148 ceph-mon[34651]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:33:59.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:33:59.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:33:58 smithi121 ceph-mon[34316]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:34:01.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:34:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:34:00.871+0000 7fbfdb3bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:34:01.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:34:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:34:00.871+0000 7fbfdb3bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:34:01.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:34:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:34:00.871+0000 7fbfdb3bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:34:01.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:34:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:34:00.871+0000 7fbfdb3bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:34:01.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:34:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:34:00.871+0000 7fbfdb3bc640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T03:34:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:01 smithi102 ceph-mon[31392]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:34:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:01 smithi148 ceph-mon[34651]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:34:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:01 smithi121 ceph-mon[34316]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T03:34:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:02 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:34:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:02 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:34:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:02 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:34:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:03 smithi102 ceph-mon[31392]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 113 KiB/s wr, 58 op/s 2024-09-21T03:34:03.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:03 smithi148 ceph-mon[34651]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 113 KiB/s wr, 58 op/s 2024-09-21T03:34:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:03 smithi121 ceph-mon[34316]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 113 KiB/s wr, 58 op/s 2024-09-21T03:34:04.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:04 smithi102 ceph-mon[31392]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:34:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:04 smithi148 ceph-mon[34651]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:34:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:04 smithi121 ceph-mon[34316]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T03:34:05.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:05 smithi102 ceph-mon[31392]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T03:34:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:05 smithi148 ceph-mon[34651]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T03:34:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:05 smithi121 ceph-mon[34316]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 18 op/s 2024-09-21T03:34:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:07 smithi102 ceph-mon[31392]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:07.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:07 smithi148 ceph-mon[34651]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:07 smithi121 ceph-mon[34316]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:09.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:09 smithi102 ceph-mon[31392]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:09 smithi148 ceph-mon[34651]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:09 smithi121 ceph-mon[34316]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:11.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:11 smithi102 ceph-mon[31392]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:11 smithi148 ceph-mon[34651]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:11 smithi121 ceph-mon[34316]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T03:34:13.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:13 smithi102 ceph-mon[31392]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:13.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:13 smithi148 ceph-mon[34651]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:13 smithi121 ceph-mon[34316]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-09-21T03:34:15.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:15 smithi102 ceph-mon[31392]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T03:34:15.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:15 smithi148 ceph-mon[34651]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T03:34:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:15 smithi121 ceph-mon[34316]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-09-21T03:34:17.361 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:17 smithi102 ceph-mon[31392]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:34:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:17 smithi148 ceph-mon[34651]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:34:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:17 smithi121 ceph-mon[34316]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:34:18.799 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:34:19.123 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:19.588 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:19 smithi102 ceph-mon[31392]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:19.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 -- 172.21.15.102:0/1275553414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4768105300 msgr2=0x7f476810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 --2- 172.21.15.102:0/1275553414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4768105300 0x7f476810d850 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f475c009900 tx=0x7f475c02a410 comp rx=0 tx=0).stop 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 -- 172.21.15.102:0/1275553414 shutdown_connections 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 --2- 172.21.15.102:0/1275553414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4768105300 0x7f476810d850 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 --2- 172.21.15.102:0/1275553414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f476810de10 0x7f4768110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 --2- 172.21.15.102:0/1275553414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f4768104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 -- 172.21.15.102:0/1275553414 >> 172.21.15.102:0/1275553414 conn(0x7f4768079730 msgr2=0x7f4768079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 -- 172.21.15.102:0/1275553414 shutdown_connections 2024-09-21T03:34:19.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.689+0000 7f476d4bd640 1 -- 172.21.15.102:0/1275553414 wait complete. 2024-09-21T03:34:19.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.690+0000 7f476d4bd640 1 Processor -- start 2024-09-21T03:34:19.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.690+0000 7f476d4bd640 1 -- start start 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.690+0000 7f476d4bd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f476819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f476d4bd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4768105300 0x7f476819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f476d4bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f476d4bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4768113b90 con 0x7f476810de10 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f476d4bd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4768113a10 con 0x7f47681049b0 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f476d4bd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4768113d10 con 0x7f4768105300 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47630/0 (socket says 172.21.15.102:47630) 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 -- 172.21.15.102:0/3184517469 learned_addr learned my addr 172.21.15.102:0/3184517469 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47667fc640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4768105300 0x7f476819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f4766ffd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f476819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 -- 172.21.15.102:0/3184517469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4768105300 msgr2=0x7f476819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4768105300 0x7f476819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 -- 172.21.15.102:0/3184517469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 msgr2=0x7f476819a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f476819a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f47677fe640 1 -- 172.21.15.102:0/3184517469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47681a0530 con 0x7f476810de10 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.691+0000 7f4766ffd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f476819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f47677fe640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f476000eaa0 tx=0x7f476000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f474ffff640 1 -- 172.21.15.102:0/3184517469 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476000cdb0 con 0x7f476810de10 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47681a0820 con 0x7f476810de10 2024-09-21T03:34:19.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f474ffff640 1 -- 172.21.15.102:0/3184517469 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4760005020 con 0x7f476810de10 2024-09-21T03:34:19.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47681a6f80 con 0x7f476810de10 2024-09-21T03:34:19.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.692+0000 7f474ffff640 1 -- 172.21.15.102:0/3184517469 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47600116d0 con 0x7f476810de10 2024-09-21T03:34:19.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.695+0000 7f4773a31740 1 Processor -- start 2024-09-21T03:34:19.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.695+0000 7f474ffff640 1 -- 172.21.15.102:0/3184517469 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f47600118d0 con 0x7f476810de10 2024-09-21T03:34:19.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.695+0000 7f4773a31740 1 -- start start 2024-09-21T03:34:19.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.695+0000 7f4773a31740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4773a31740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6244fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4773a31740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b624500d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47644/0 (socket says 172.21.15.102:47644) 2024-09-21T03:34:19.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561b623c5e50 con 0x561b620a8070 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b623b5280 con 0x561b6207f1b0 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 -- 172.21.15.102:0/3945212089 learned_addr learned my addr 172.21.15.102:0/3945212089 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b623b9090 con 0x561b62087390 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f474ffff640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 0x7f47500b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f4766ffd640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6244fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b624500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47677fe640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 0x7f47500b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f474ffff640 1 -- 172.21.15.102:0/3184517469 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f47600e7810 con 0x7f476810de10 2024-09-21T03:34:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 -- 172.21.15.102:0/3945212089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 msgr2=0x561b624500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b624500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 -- 172.21.15.102:0/3945212089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 msgr2=0x561b6244fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6244fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.696+0000 7f47667fc640 1 -- 172.21.15.102:0/3945212089 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b62113650 con 0x561b620a8070 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f4766ffd640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6244fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f47667fc640 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f475c009230 tx=0x7f475c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a557e555c5da879 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f47677fe640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 0x7f47500b8c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47600a9c20 tx=0x7f476006e820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f474d7fa640 1 -- 172.21.15.102:0/3945212089 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c035040 con 0x561b620a8070 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f474d7fa640 1 -- 172.21.15.102:0/3945212089 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f475c004030 con 0x561b620a8070 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.697+0000 7f474d7fa640 1 -- 172.21.15.102:0/3945212089 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c003a90 con 0x561b620a8070 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 msgr2=0x561b6244f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f475c009230 tx=0x7f475c000bc0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 shutdown_connections 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b624500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6244fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 --2- 172.21.15.102:0/3945212089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6244f650 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 >> 172.21.15.102:0/3945212089 conn(0x561b6209c460 msgr2=0x561b6244d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 shutdown_connections 2024-09-21T03:34:19.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.698+0000 7f4773a31740 1 -- 172.21.15.102:0/3945212089 wait complete. 2024-09-21T03:34:19.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 -- start start 2024-09-21T03:34:19.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 Processor -- start 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6245acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561b62216700 con 0x561b620a8070 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561b62350110 con 0x561b6207f1b0 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561b62462180 con 0x561b62087390 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f4773a31740 10 client.0 _ll_register_callbacks cb 0x561b62369990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.699+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47660/0 (socket says 172.21.15.102:47660) 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 -- 172.21.15.102:0/576419491 learned_addr learned my addr 172.21.15.102:0/576419491 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6245acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f4766ffd640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 -- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 msgr2=0x561b6245b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 -- 172.21.15.102:0/576419491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 msgr2=0x561b6245acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6245acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 -- 172.21.15.102:0/576419491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b6237dc40 con 0x561b620a8070 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f4766ffd640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f47667fc640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f475c0059d0 tx=0x7f475c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fdb1f14d646cee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f474aff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c053060 con 0x561b620a8070 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.700+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f475c0041e0 con 0x561b620a8070 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475c004030 con 0x561b620a8070 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f475c035040 con 0x561b620a8070 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 10 client.15549 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:19.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b6246dee0 con 0x561b620a8070 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f475c004030 con 0x561b620a8070 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f475c0321c0 con 0x561b620a8070 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 10 client.15549 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 20 client.15549 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b620669f0 0x561b62471240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 4 client.15549 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.701+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b623c7da0 con 0x561b620669f0 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.702+0000 7f4766ffd640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b620669f0 0x561b62471240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.702+0000 7f474aff5640 10 client.15549 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:19.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.702+0000 7f4766ffd640 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b620669f0 0x561b62471240 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304299170797ba73 server_cookie=b8c5f0a2b35dc2d7 in_seq=0 out_seq=0 2024-09-21T03:34:19.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f474aff5640 1 -- 172.21.15.102:0/576419491 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b623c7da0 con 0x561b620669f0 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f474aff5640 10 client.15549 handle_command_reply: tid=0 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 client.15549 shutdown 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 msgr2=0x561b6246b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f475c0059d0 tx=0x7f475c003730 comp rx=0 tx=0).stop 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 shutdown_connections 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b620669f0 0x561b62471240 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b500 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 --2- 172.21.15.102:0/576419491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b6245acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 >> 172.21.15.102:0/576419491 conn(0x561b6209c460 msgr2=0x561b624527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.703+0000 7f474aff5640 0 client.15549 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.704+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 shutdown_connections 2024-09-21T03:34:19.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.704+0000 7f4773a31740 1 -- 172.21.15.102:0/576419491 wait complete. 2024-09-21T03:34:19.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.704+0000 7f4773a31740 20 client.15549 trim_cache size 0 max 16384 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 Processor -- start 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 -- start start 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b62451150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4754011140 con 0x561b620a8070 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f475400ea10 con 0x561b6207f1b0 2024-09-21T03:34:19.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f4773a31740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f475400c860 con 0x561b62087390 2024-09-21T03:34:19.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47668/0 (socket says 172.21.15.102:47668) 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.721+0000 7f47667fc640 1 -- 172.21.15.102:0/3517744742 learned_addr learned my addr 172.21.15.102:0/3517744742 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b62451150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f4766ffd640 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 -- 172.21.15.102:0/3517744742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 msgr2=0x561b6245cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 -- 172.21.15.102:0/3517744742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 msgr2=0x561b62451150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b62451150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 -- 172.21.15.102:0/3517744742 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b62451940 con 0x561b620a8070 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f47667fc640 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f475c02a930 tx=0x7f475c040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b8a0cdcda9526f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f474cff9640 1 -- 172.21.15.102:0/3517744742 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c053070 con 0x561b620a8070 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f474cff9640 1 -- 172.21.15.102:0/3517744742 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f475c0318c0 con 0x561b620a8070 2024-09-21T03:34:19.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.722+0000 7f474cff9640 1 -- 172.21.15.102:0/3517744742 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c004ab0 con 0x561b620a8070 2024-09-21T03:34:19.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.723+0000 7f4773a31740 1 -- 172.21.15.102:0/3517744742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 msgr2=0x561b6246b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.723+0000 7f4773a31740 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f475c02a930 tx=0x7f475c040040 comp rx=0 tx=0).stop 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 -- 172.21.15.102:0/3517744742 shutdown_connections 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b6246b470 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b62087390 0x561b6245cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 --2- 172.21.15.102:0/3517744742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b6207f1b0 0x561b62451150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 -- 172.21.15.102:0/3517744742 >> 172.21.15.102:0/3517744742 conn(0x561b6209c460 msgr2=0x561b62454760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 -- 172.21.15.102:0/3517744742 shutdown_connections 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 -- 172.21.15.102:0/3517744742 wait complete. 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 -- start start 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.724+0000 7f4773a31740 1 Processor -- start 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b6207f1b0 0x561b624723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b62087390 0x561b62472930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f475400ced0 con 0x561b620a8070 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f475400e340 con 0x561b62087390 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f475400d5a0 con 0x561b6207f1b0 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4773a31740 10 client.0 _ll_register_callbacks cb 0x7f475c032cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47684/0 (socket says 172.21.15.102:47684) 2024-09-21T03:34:19.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 -- 172.21.15.102:0/1433624413 learned_addr learned my addr 172.21.15.102:0/1433624413 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:19.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f4766ffd640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b62087390 0x561b62472930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b6207f1b0 0x561b624723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 -- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b6207f1b0 msgr2=0x561b624723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b6207f1b0 0x561b624723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 -- 172.21.15.102:0/1433624413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b62087390 msgr2=0x561b62472930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b62087390 0x561b62472930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.725+0000 7f47667fc640 1 -- 172.21.15.102:0/1433624413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b624dab40 con 0x561b620a8070 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f47667fc640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f475c003c30 tx=0x7f475c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe47cc1bbe62400 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f474aff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c069060 con 0x561b620a8070 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f475c0042d0 con 0x561b620a8070 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f475c0318c0 con 0x561b620a8070 2024-09-21T03:34:19.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f475c053070 con 0x561b620a8070 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f4773a31740 10 client.15555 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561b624dab40 con 0x561b620a8070 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.726+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f475c0318c0 con 0x561b620a8070 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f475c057470 con 0x561b620a8070 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 10 client.15555 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 20 client.15555 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b6203bda0 0x561b624de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 4 client.15555 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.727+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b623c3850 con 0x561b6203bda0 2024-09-21T03:34:19.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f4766ffd640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b6203bda0 0x561b624de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f474aff5640 10 client.15555 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f4766ffd640 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b6203bda0 0x561b624de140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab8731d44396a06a server_cookie=e1f3824d6c14cb29 in_seq=0 out_seq=0 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f474aff5640 1 -- 172.21.15.102:0/1433624413 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x561b623c3850 con 0x561b6203bda0 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f474aff5640 10 client.15555 handle_command_reply: tid=0 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.728+0000 7f4773a31740 1 client.15555 shutdown 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 msgr2=0x561b62472e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f475c003c30 tx=0x7f475c02a410 comp rx=0 tx=0).stop 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 shutdown_connections 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561b6203bda0 0x561b624de140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561b620a8070 0x561b62472e70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561b62087390 0x561b62472930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 --2- 172.21.15.102:0/1433624413 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561b6207f1b0 0x561b624723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 >> 172.21.15.102:0/1433624413 conn(0x561b6209c460 msgr2=0x561b6245c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f474aff5640 0 client.15555 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 shutdown_connections 2024-09-21T03:34:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 1 -- 172.21.15.102:0/1433624413 wait complete. 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.729+0000 7f4773a31740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:34:19.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:34:19.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 msgr2=0x7f47500b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 0x7f47500b8c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47600a9c20 tx=0x7f476006e820 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 msgr2=0x7f476819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f476000eaa0 tx=0x7f476000ef60 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 shutdown_connections 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f47500b6700 0x7f47500b8c10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f476810de10 0x7f476819fe00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4768105300 0x7f476819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 --2- 172.21.15.102:0/3184517469 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47681049b0 0x7f476819a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 >> 172.21.15.102:0/3184517469 conn(0x7f4768079730 msgr2=0x7f47681007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 shutdown_connections 2024-09-21T03:34:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:19.730+0000 7f476d4bd640 1 -- 172.21.15.102:0/3184517469 wait complete. 2024-09-21T03:34:19.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:19 smithi148 ceph-mon[34651]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:19 smithi121 ceph-mon[34316]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:20.429 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:34:20.429 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:34:20.758 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.279+0000 7f86eb76a640 1 -- 172.21.15.102:0/3638108004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e4105ae0 msgr2=0x7f86e410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.279+0000 7f86eb76a640 1 --2- 172.21.15.102:0/3638108004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e4105ae0 0x7f86e410f530 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009ca0 tx=0x7f86dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 -- 172.21.15.102:0/3638108004 shutdown_connections 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 --2- 172.21.15.102:0/3638108004 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e4105ae0 0x7f86e410f530 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 --2- 172.21.15.102:0/3638108004 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 --2- 172.21.15.102:0/3638108004 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e41031c0 0x7f86e41035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 -- 172.21.15.102:0/3638108004 >> 172.21.15.102:0/3638108004 conn(0x7f86e4077c60 msgr2=0x7f86e40780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 -- 172.21.15.102:0/3638108004 shutdown_connections 2024-09-21T03:34:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.280+0000 7f86eb76a640 1 -- 172.21.15.102:0/3638108004 wait complete. 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 Processor -- start 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 -- start start 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4105ae0 0x7f86e419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.281+0000 7f86eb76a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4112af0 con 0x7f86e41031c0 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e9506640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86eb76a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4112970 con 0x7f86e4105190 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86eb76a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f86e4112c70 con 0x7f86e4105ae0 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e9506640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47714/0 (socket says 172.21.15.102:47714) 2024-09-21T03:34:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e9506640 1 -- 172.21.15.102:0/2595597775 learned_addr learned my addr 172.21.15.102:0/2595597775 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e9d07640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4105ae0 0x7f86e419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 -- 172.21.15.102:0/2595597775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4105ae0 msgr2=0x7f86e419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4105ae0 0x7f86e419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 -- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 msgr2=0x7f86e4199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e8d05640 1 -- 172.21.15.102:0/2595597775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86e419f2b0 con 0x7f86e4105190 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.282+0000 7f86e9506640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86e8d05640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41999a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c940 tx=0x7f86d400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d4007bb0 con 0x7f86e4105190 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86e419f5a0 con 0x7f86e4105190 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86e4101e20 con 0x7f86e4105190 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f86d4007d50 con 0x7f86e4105190 2024-09-21T03:34:21.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.283+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d401d060 con 0x7f86e4105190 2024-09-21T03:34:21.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.284+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c8005290 con 0x7f86e4105190 2024-09-21T03:34:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.287+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f86d40046c0 con 0x7f86e4105190 2024-09-21T03:34:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.287+0000 7f86da7fc640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 0x7f86d00b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.288+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f86d40e74d0 con 0x7f86e4105190 2024-09-21T03:34:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.288+0000 7f86e9506640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 0x7f86d00b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.288+0000 7f86e9506640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 0x7f86d00b8c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86e000f4d0 tx=0x7f86e000a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.290+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86d4014030 con 0x7f86e4105190 2024-09-21T03:34:21.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:21 smithi102 ceph-mon[31392]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:21.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.651+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86c8005580 con 0x7f86e4105190 2024-09-21T03:34:21.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.652+0000 7f86da7fc640 1 -- 172.21.15.102:0/2595597775 <== mon.2 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f86d40b1e70 con 0x7f86e4105190 2024-09-21T03:34:21.654 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:34:21.655 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"btime":"2024-09-21T03:33:38:357326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:33:37.868919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:34:21.655 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 24 2024-09-21T03:34:21.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 msgr2=0x7f86d00b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 0x7f86d00b8c40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f86e000f4d0 tx=0x7f86e000a380 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 msgr2=0x7f86e41999a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41999a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86d400c940 tx=0x7f86d400ce00 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 shutdown_connections 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f86d00b6730 0x7f86d00b8c40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f86e4105ae0 0x7f86e419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f86e4105190 0x7f86e41999a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.655+0000 7f86eb76a640 1 --2- 172.21.15.102:0/2595597775 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f86e41031c0 0x7f86e4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.656+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 >> 172.21.15.102:0/2595597775 conn(0x7f86e4077c60 msgr2=0x7f86e4106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.656+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 shutdown_connections 2024-09-21T03:34:21.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:21.656+0000 7f86eb76a640 1 -- 172.21.15.102:0/2595597775 wait complete. 2024-09-21T03:34:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:21 smithi148 ceph-mon[34651]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:21 smithi121 ceph-mon[34316]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:22.400 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:34:22.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:22 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2595597775' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:34:22.706 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:22 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2595597775' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:34:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:22 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2595597775' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 -- 172.21.15.102:0/120193510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 msgr2=0x7fccfc10ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 --2- 172.21.15.102:0/120193510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc10ecb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009ca0 tx=0x7fccf402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 -- 172.21.15.102:0/120193510 shutdown_connections 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 --2- 172.21.15.102:0/120193510 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc10ecb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 --2- 172.21.15.102:0/120193510 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 --2- 172.21.15.102:0/120193510 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.294+0000 7fcd016a9640 1 -- 172.21.15.102:0/120193510 >> 172.21.15.102:0/120193510 conn(0x7fccfc077c60 msgr2=0x7fccfc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.295+0000 7fcd016a9640 1 -- 172.21.15.102:0/120193510 shutdown_connections 2024-09-21T03:34:23.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.295+0000 7fcd016a9640 1 -- 172.21.15.102:0/120193510 wait complete. 2024-09-21T03:34:23.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.296+0000 7fcd016a9640 1 Processor -- start 2024-09-21T03:34:23.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.296+0000 7fcd016a9640 1 -- start start 2024-09-21T03:34:23.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.296+0000 7fcd016a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.296+0000 7fcd016a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.296+0000 7fcd016a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fcd016a9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1119f0 con 0x7fccfc108480 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fcd016a9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc111870 con 0x7fccfc1021f0 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fcd016a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc111b70 con 0x7fccfc107b30 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:50206/0 (socket says 172.21.15.102:50206) 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:56650/0 (socket says 172.21.15.102:56650) 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccfaffd640 1 -- 172.21.15.102:0/2825379848 learned_addr learned my addr 172.21.15.102:0/2825379848 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:23.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 -- 172.21.15.102:0/2825379848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 msgr2=0x7fccfc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 -- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 msgr2=0x7fccfc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccf3fff640 1 -- 172.21.15.102:0/2825379848 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccfc19e2b0 con 0x7fccfc107b30 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.297+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccfc075820 tx=0x7fcce400dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fccf8ff9640 1 -- 172.21.15.102:0/2825379848 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce4016070 con 0x7fccfc107b30 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccfc19e5a0 con 0x7fccfc107b30 2024-09-21T03:34:23.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fccf8ff9640 1 -- 172.21.15.102:0/2825379848 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcce40099a0 con 0x7fccfc107b30 2024-09-21T03:34:23.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fccf8ff9640 1 -- 172.21.15.102:0/2825379848 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40047a0 con 0x7fccfc107b30 2024-09-21T03:34:23.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.298+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccfc1a4d00 con 0x7fccfc107b30 2024-09-21T03:34:23.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.302+0000 7fcd07c1d740 1 Processor -- start 2024-09-21T03:34:23.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.302+0000 7fcd07c1d740 1 -- start start 2024-09-21T03:34:23.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.302+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 0x55abb98f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.302+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb98f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 0x55abb98f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abb986dea0 con 0x55abb95271b0 2024-09-21T03:34:23.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55abb985d2d0 con 0x55abb9550070 2024-09-21T03:34:23.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55abb98610e0 con 0x55abb952f390 2024-09-21T03:34:23.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccf8ff9640 1 -- 172.21.15.102:0/2825379848 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fcce4004940 con 0x7fccfc107b30 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb98f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 0x55abb98f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfb7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 0x55abb98f76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:50220/0 (socket says 172.21.15.102:50220) 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfb7fe640 1 -- 172.21.15.102:0/1329269093 learned_addr learned my addr 172.21.15.102:0/1329269093 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 0x55abb98f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 -- 172.21.15.102:0/1329269093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 msgr2=0x55abb98f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 0x55abb98f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 -- 172.21.15.102:0/1329269093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 msgr2=0x55abb98f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 0x55abb98f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccf8ff9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 0x7fcce80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccfaffd640 1 -- 172.21.15.102:0/1329269093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb95bb650 con 0x55abb95271b0 2024-09-21T03:34:23.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.303+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 0x55abb98f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccf8ff9640 1 -- 172.21.15.102:0/2825379848 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcce40e8bc0 con 0x7fccfc107b30 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 0x7fcce80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb98f7be0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fccec0058c0 tx=0x7fccec00e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c81ccabc973e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccf17fa640 1 -- 172.21.15.102:0/1329269093 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec019cb0 con 0x55abb95271b0 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccf17fa640 1 -- 172.21.15.102:0/1329269093 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fccec019e50 con 0x55abb95271b0 2024-09-21T03:34:23.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.304+0000 7fccf17fa640 1 -- 172.21.15.102:0/1329269093 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccec00d3e0 con 0x55abb95271b0 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1329269093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 msgr2=0x55abb98f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 0x7fcce80b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccf402f500 tx=0x7fccf4005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb98f7be0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fccec0058c0 tx=0x7fccec00e8e0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1329269093 shutdown_connections 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb98f7be0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb952f390 0x55abb98f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1329269093 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9550070 0x55abb98f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1329269093 >> 172.21.15.102:0/1329269093 conn(0x55abb9544460 msgr2=0x55abb98f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1329269093 shutdown_connections 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.305+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1329269093 wait complete. 2024-09-21T03:34:23.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.306+0000 7fcd07c1d740 1 -- start start 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.306+0000 7fcd07c1d740 1 Processor -- start 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9902db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9550070 0x55abb9920180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abb96be700 con 0x55abb952f390 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55abb97f8160 con 0x55abb95271b0 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55abb9905e80 con 0x55abb9550070 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47746/0 (socket says 172.21.15.102:47746) 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcd07c1d740 10 client.0 _ll_register_callbacks cb 0x55abb98119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 -- 172.21.15.102:0/2122800573 learned_addr learned my addr 172.21.15.102:0/2122800573 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccfaffd640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9902db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9550070 0x55abb9920180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 -- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9550070 msgr2=0x55abb9920180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9550070 0x55abb9920180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 -- 172.21.15.102:0/2122800573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 msgr2=0x55abb9902db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9902db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 -- 172.21.15.102:0/2122800573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb9825c90 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fccf3fff640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcce40abc70 tx=0x7fcce400b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24359a79e58b7c0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcce27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40ae7d0 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.307+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcce40b8190 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.308+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccec019e50 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.308+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcce40aa170 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.308+0000 7fcd07c1d740 10 client.15570 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.308+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55abb9922c00 con 0x55abb952f390 2024-09-21T03:34:23.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.308+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fccec019e50 con 0x55abb952f390 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcce40b30d0 con 0x55abb952f390 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 10 client.15570 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 10 client.15570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 20 client.15570 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb950e9f0 0x55abb9937110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 4 client.15570 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.309+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abb986fdf0 con 0x55abb950e9f0 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.310+0000 7fccfaffd640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb950e9f0 0x55abb9937110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.310+0000 7fccfaffd640 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb950e9f0 0x55abb9937110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=abbc1c4de6ded5e5 server_cookie=729581fb20bcc155 in_seq=0 out_seq=0 2024-09-21T03:34:23.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.310+0000 7fcce27fc640 10 client.15570 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcce27fc640 1 -- 172.21.15.102:0/2122800573 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55abb986fdf0 con 0x55abb950e9f0 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcce27fc640 10 client.15570 handle_command_reply: tid=0 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcd07c1d740 1 client.15570 shutdown 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 msgr2=0x55abb99032f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcce40abc70 tx=0x7fcce400b420 comp rx=0 tx=0).stop 2024-09-21T03:34:23.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 shutdown_connections 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.311+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb950e9f0 0x55abb9937110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcce27fc640 0 client.15570 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb952f390 0x55abb99032f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9550070 0x55abb9920180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/2122800573 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9902db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 >> 172.21.15.102:0/2122800573 conn(0x55abb9544460 msgr2=0x55abb98fa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 shutdown_connections 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 1 -- 172.21.15.102:0/2122800573 wait complete. 2024-09-21T03:34:23.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.312+0000 7fcd07c1d740 20 client.15570 trim_cache size 0 max 16384 2024-09-21T03:34:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.338+0000 7fcd07c1d740 1 Processor -- start 2024-09-21T03:34:23.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.338+0000 7fcd07c1d740 1 -- start start 2024-09-21T03:34:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9544460 0x55abb98faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb99004e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1a7740 con 0x55abb95271b0 2024-09-21T03:34:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc1a5010 con 0x55abb9544460 2024-09-21T03:34:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0735c0 con 0x55abb950e9f0 2024-09-21T03:34:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fccf3fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:56676/0 (socket says 172.21.15.102:56676) 2024-09-21T03:34:23.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fccf3fff640 1 -- 172.21.15.102:0/3448445590 learned_addr learned my addr 172.21.15.102:0/3448445590 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb99004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.339+0000 7fccfaffd640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9544460 0x55abb98faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 -- 172.21.15.102:0/3448445590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9544460 msgr2=0x55abb98faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9544460 0x55abb98faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 -- 172.21.15.102:0/3448445590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 msgr2=0x55abb99004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb99004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 -- 172.21.15.102:0/3448445590 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abb98fda10 con 0x55abb950e9f0 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb99004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf3fff640 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce40e6840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc39aae06b1f14a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf0ff9640 1 -- 172.21.15.102:0/3448445590 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40ae170 con 0x55abb950e9f0 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf0ff9640 1 -- 172.21.15.102:0/3448445590 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcce40d20b0 con 0x55abb950e9f0 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.340+0000 7fccf0ff9640 1 -- 172.21.15.102:0/3448445590 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40ae350 con 0x55abb950e9f0 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 -- 172.21.15.102:0/3448445590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 msgr2=0x55abb98fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce40e6840 comp rx=0 tx=0).stop 2024-09-21T03:34:23.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 -- 172.21.15.102:0/3448445590 shutdown_connections 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb95271b0 0x55abb99004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb950e9f0 0x55abb98fffa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/3448445590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb9544460 0x55abb98faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 -- 172.21.15.102:0/3448445590 >> 172.21.15.102:0/3448445590 conn(0x55abb9937400 msgr2=0x55abb98fa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 -- 172.21.15.102:0/3448445590 shutdown_connections 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.342+0000 7fcd07c1d740 1 -- 172.21.15.102:0/3448445590 wait complete. 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 -- start start 2024-09-21T03:34:23.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 Processor -- start 2024-09-21T03:34:23.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9918b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9544460 0x55abb99a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fccfaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47768/0 (socket says 172.21.15.102:47768) 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fccfaffd640 1 -- 172.21.15.102:0/1701521977 learned_addr learned my addr 172.21.15.102:0/1701521977 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.343+0000 7fcd07c1d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc073c30 con 0x55abb950e9f0 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9918b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc0750a0 con 0x55abb95271b0 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fccfc074300 con 0x55abb9544460 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccfb7fe640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9544460 0x55abb99a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fcd07c1d740 10 client.0 _ll_register_callbacks cb 0x7fcce4005b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 -- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9544460 msgr2=0x55abb99a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9544460 0x55abb99a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 -- 172.21.15.102:0/1701521977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 msgr2=0x55abb9918590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abb99a0fb0 con 0x55abb95271b0 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fccf3fff640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9918b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce40aa600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2967a3e580d47e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:23.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fcce27fc640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:34:23.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.344+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce40ae350 con 0x55abb95271b0 2024-09-21T03:34:23.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcce40b7f90 con 0x55abb95271b0 2024-09-21T03:34:23.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcce40d20b0 con 0x55abb95271b0 2024-09-21T03:34:23.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcce40ae170 con 0x55abb95271b0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcd07c1d740 10 client.25109 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55abb99a20e0 con 0x55abb95271b0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.345+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcce40ae510 con 0x55abb95271b0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcce40d0070 con 0x55abb95271b0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 10 client.25109 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 10 client.25109 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 20 client.25109 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb952f390 0x55abb99a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 4 client.25109 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.346+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fcce40d20b0 con 0x55abb952f390 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb952f390 0x55abb99a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fcce27fc640 10 client.25109 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fccfaffd640 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb952f390 0x55abb99a45c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=715be7d84c368a9b server_cookie=66dc8fd8195ece31 in_seq=0 out_seq=0 2024-09-21T03:34:23.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fcce27fc640 1 -- 172.21.15.102:0/1701521977 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fcce40d20b0 con 0x55abb952f390 2024-09-21T03:34:23.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fcce27fc640 10 client.25109 handle_command_reply: tid=0 2024-09-21T03:34:23.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.347+0000 7fcd07c1d740 1 client.25109 shutdown 2024-09-21T03:34:23.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 msgr2=0x55abb9918b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9918b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcce4005fd0 tx=0x7fcce40aa600 comp rx=0 tx=0).stop 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 shutdown_connections 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55abb952f390 0x55abb99a45c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55abb9544460 0x55abb99a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55abb95271b0 0x55abb9918b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 --2- 172.21.15.102:0/1701521977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abb950e9f0 0x55abb9918590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 >> 172.21.15.102:0/1701521977 conn(0x55abb9937400 msgr2=0x55abb9904070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcce27fc640 0 client.25109 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 shutdown_connections 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.348+0000 7fcd07c1d740 1 -- 172.21.15.102:0/1701521977 wait complete. 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.349+0000 7fcd07c1d740 20 client.25109 trim_cache size 0 max 16384 2024-09-21T03:34:23.352 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:34:23.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.349+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 msgr2=0x7fcce80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.349+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 0x7fcce80b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccf402f500 tx=0x7fccf4005d80 comp rx=0 tx=0).stop 2024-09-21T03:34:23.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.349+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 msgr2=0x7fccfc1988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:23.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fccfc075820 tx=0x7fcce400dbb0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 shutdown_connections 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcce80b6700 0x7fcce80b8c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fccfc108480 0x7fccfc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fccfc107b30 0x7fccfc1988e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 --2- 172.21.15.102:0/2825379848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fccfc1021f0 0x7fccfc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 >> 172.21.15.102:0/2825379848 conn(0x7fccfc077c60 msgr2=0x7fccfc103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 shutdown_connections 2024-09-21T03:34:23.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:23.350+0000 7fcd016a9640 1 -- 172.21.15.102:0/2825379848 wait complete. 2024-09-21T03:34:23.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:23 smithi102 ceph-mon[31392]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:34:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:23 smithi148 ceph-mon[34651]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:34:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:23 smithi121 ceph-mon[34316]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T03:34:24.150 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:34:24.383 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:24 smithi102 ceph-mon[31392]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:24.432 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:24.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:24 smithi148 ceph-mon[34651]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:24 smithi121 ceph-mon[34316]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 -- 172.21.15.102:0/3966955861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6581083a0 msgr2=0x7fc6581087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 --2- 172.21.15.102:0/3966955861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6581083a0 0x7fc6581087b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009900 tx=0x7fc64c02a410 comp rx=0 tx=0).stop 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 -- 172.21.15.102:0/3966955861 shutdown_connections 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 --2- 172.21.15.102:0/3966955861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc6581083a0 0x7fc6581087b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 --2- 172.21.15.102:0/3966955861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc658108cf0 0x7fc65810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 --2- 172.21.15.102:0/3966955861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc658102a60 0x7fc658102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.000+0000 7fc65dffb640 1 -- 172.21.15.102:0/3966955861 >> 172.21.15.102:0/3966955861 conn(0x7fc658079730 msgr2=0x7fc658079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.001+0000 7fc65dffb640 1 -- 172.21.15.102:0/3966955861 shutdown_connections 2024-09-21T03:34:25.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.001+0000 7fc65dffb640 1 -- 172.21.15.102:0/3966955861 wait complete. 2024-09-21T03:34:25.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.002+0000 7fc65dffb640 1 Processor -- start 2024-09-21T03:34:25.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.002+0000 7fc65dffb640 1 -- start start 2024-09-21T03:34:25.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc658108cf0 0x7fc658199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 0x7fc65819f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc658112ad0 con 0x7fc658102a60 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc658112950 con 0x7fc65819eda0 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc65dffb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc658112c50 con 0x7fc658108cf0 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40460/0 (socket says 172.21.15.102:40460) 2024-09-21T03:34:25.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 -- 172.21.15.102:0/992049737 learned_addr learned my addr 172.21.15.102:0/992049737 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:25.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 -- 172.21.15.102:0/992049737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc658108cf0 msgr2=0x7fc658199bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:34:25.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc658108cf0 0x7fc658199bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc6577fe640 1 -- 172.21.15.102:0/992049737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 msgr2=0x7fc65819f1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.003+0000 7fc657fff640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 0x7fc65819f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc6577fe640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 0x7fc65819f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc6577fe640 1 -- 172.21.15.102:0/992049737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65819f8f0 con 0x7fc658102a60 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc657fff640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 0x7fc65819f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc6577fe640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c920 tx=0x7fc64800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc654ff9640 1 -- 172.21.15.102:0/992049737 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc648007c70 con 0x7fc658102a60 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65819fbe0 con 0x7fc658102a60 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65806b220 con 0x7fc658102a60 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc654ff9640 1 -- 172.21.15.102:0/992049737 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc648007e10 con 0x7fc658102a60 2024-09-21T03:34:25.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.004+0000 7fc654ff9640 1 -- 172.21.15.102:0/992049737 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6480188c0 con 0x7fc658102a60 2024-09-21T03:34:25.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.008+0000 7fc66456f740 1 Processor -- start 2024-09-21T03:34:25.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.008+0000 7fc66456f740 1 -- start start 2024-09-21T03:34:25.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.008+0000 7fc66456f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.008+0000 7fc66456f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 0x562aca34a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.008+0000 7fc66456f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca34a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc66456f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562aca2b7ea0 con 0x562ac9f711b0 2024-09-21T03:34:25.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc66456f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562aca2a72d0 con 0x562ac9f9a070 2024-09-21T03:34:25.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc66456f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562aca2ab0e0 con 0x562ac9f79390 2024-09-21T03:34:25.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc657fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc657fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:56046/0 (socket says 172.21.15.102:56046) 2024-09-21T03:34:25.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc657fff640 1 -- 172.21.15.102:0/3350901170 learned_addr learned my addr 172.21.15.102:0/3350901170 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:25.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.009+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca34a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc654ff9640 1 -- 172.21.15.102:0/992049737 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc64800f450 con 0x7fc658102a60 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc6577fe640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 0x562aca34a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 -- 172.21.15.102:0/3350901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 msgr2=0x562aca34a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca34a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 -- 172.21.15.102:0/3350901170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 msgr2=0x562aca34a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 0x562aca34a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 -- 172.21.15.102:0/3350901170 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aca005650 con 0x562ac9f9a070 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc6577fe640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 0x562aca34a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.010+0000 7fc657fff640 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc650009f10 tx=0x7fc65000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8756e60296d41a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc63dffb640 1 -- 172.21.15.102:0/3350901170 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650003b70 con 0x562ac9f9a070 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc63dffb640 1 -- 172.21.15.102:0/3350901170 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc650003d10 con 0x562ac9f9a070 2024-09-21T03:34:25.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc63dffb640 1 -- 172.21.15.102:0/3350901170 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650011aa0 con 0x562ac9f9a070 2024-09-21T03:34:25.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc654ff9640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 0x7fc6400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc6577fe640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 0x7fc6400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.011+0000 7fc654ff9640 1 -- 172.21.15.102:0/992049737 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc6480e7640 con 0x7fc658102a60 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 -- 172.21.15.102:0/3350901170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 msgr2=0x562aca349eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc6577fe640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 0x7fc6400b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6480e4e30 tx=0x7fc648018540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc650009f10 tx=0x7fc65000f730 comp rx=0 tx=0).stop 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 -- 172.21.15.102:0/3350901170 shutdown_connections 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f711b0 0x562aca34a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca34a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 --2- 172.21.15.102:0/3350901170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f9a070 0x562aca349eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 -- 172.21.15.102:0/3350901170 >> 172.21.15.102:0/3350901170 conn(0x562ac9f8e460 msgr2=0x562aca347da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 -- 172.21.15.102:0/3350901170 shutdown_connections 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.012+0000 7fc66456f740 1 -- 172.21.15.102:0/3350901170 wait complete. 2024-09-21T03:34:25.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.013+0000 7fc66456f740 1 -- start start 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.013+0000 7fc66456f740 1 Processor -- start 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f79390 0x562aca355b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562aca108700 con 0x562ac9f9a070 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562aca242160 con 0x562ac9f79390 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc657fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc657fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40482/0 (socket says 172.21.15.102:40482) 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc657fff640 1 -- 172.21.15.102:0/3700896646 learned_addr learned my addr 172.21.15.102:0/3700896646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f79390 0x562aca355b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562aca358690 con 0x562ac9f711b0 2024-09-21T03:34:25.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.014+0000 7fc657fff640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 -- 172.21.15.102:0/3700896646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 msgr2=0x562aca3555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 -- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f79390 msgr2=0x562aca355b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f79390 0x562aca355b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 -- 172.21.15.102:0/3700896646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aca26fc90 con 0x562ac9f9a070 2024-09-21T03:34:25.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc657fff640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc650011580 tx=0x7fc6500115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c569684800dae85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc636ffd640 1 -- 172.21.15.102:0/3700896646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650024040 con 0x562ac9f9a070 2024-09-21T03:34:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc66456f740 10 client.0 _ll_register_callbacks cb 0x562aca25b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc636ffd640 1 -- 172.21.15.102:0/3700896646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc650003ec0 con 0x562ac9f9a070 2024-09-21T03:34:25.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.015+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc650003d10 con 0x562ac9f9a070 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc636ffd640 1 -- 172.21.15.102:0/3700896646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc6500040c0 con 0x562ac9f9a070 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 10 client.15585 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({fsmap=24}) -- 0x562aca364020 con 0x562ac9f9a070 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc636ffd640 1 -- 172.21.15.102:0/3700896646 <== mon.0 v2:172.21.15.102:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc650004260 con 0x562ac9f9a070 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 10 client.15585 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 10 client.15585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 20 client.15585 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f589f0 0x562aca3673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 4 client.15585 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.016+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc650003d10 con 0x562ac9f589f0 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.017+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f589f0 0x562aca3673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.017+0000 7fc636ffd640 10 client.15585 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:34:25.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.017+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f589f0 0x562aca3673e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=33cde234d4453ac2 server_cookie=3a105bf327c8edbf in_seq=0 out_seq=0 2024-09-21T03:34:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc636ffd640 1 -- 172.21.15.102:0/3700896646 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fc650003d10 con 0x562ac9f589f0 2024-09-21T03:34:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc636ffd640 10 client.15585 handle_command_reply: tid=0 2024-09-21T03:34:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 client.15585 shutdown 2024-09-21T03:34:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 msgr2=0x562aca356080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc650011580 tx=0x7fc6500115e0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 shutdown_connections 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f589f0 0x562aca3673e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc636ffd640 0 client.15585 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f9a070 0x562aca356080 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f79390 0x562aca355b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 --2- 172.21.15.102:0/3700896646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.018+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 >> 172.21.15.102:0/3700896646 conn(0x562ac9f8e460 msgr2=0x562aca34d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.019+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 shutdown_connections 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.019+0000 7fc66456f740 1 -- 172.21.15.102:0/3700896646 wait complete. 2024-09-21T03:34:25.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.019+0000 7fc66456f740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T03:34:25.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.044+0000 7fc66456f740 1 Processor -- start 2024-09-21T03:34:25.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.044+0000 7fc66456f740 1 -- start start 2024-09-21T03:34:25.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f589f0 0x562aca3571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 0x562aca352cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc644011160 con 0x562ac9f79390 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400ea30 con 0x562ac9f589f0 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc66456f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400c880 con 0x562ac9f711b0 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:44348/0 (socket says 172.21.15.102:44348) 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.045+0000 7fc656ffd640 1 -- 172.21.15.102:0/3267745711 learned_addr learned my addr 172.21.15.102:0/3267745711 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 -- 172.21.15.102:0/3267745711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f589f0 msgr2=0x562aca3571f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f589f0 0x562aca3571f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 -- 172.21.15.102:0/3267745711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 msgr2=0x562aca352cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc657fff640 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 0x562aca352cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 0x562aca352cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 -- 172.21.15.102:0/3267745711 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aca34cce0 con 0x562ac9f711b0 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc657fff640 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 0x562aca352cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc656ffd640 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009230 tx=0x7fc64c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84b35dee24ec4475 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.046+0000 7fc63d7fa640 1 -- 172.21.15.102:0/3267745711 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c035040 con 0x562ac9f711b0 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.047+0000 7fc63d7fa640 1 -- 172.21.15.102:0/3267745711 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc64c049020 con 0x562ac9f711b0 2024-09-21T03:34:25.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.047+0000 7fc63d7fa640 1 -- 172.21.15.102:0/3267745711 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031600 con 0x562ac9f711b0 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 -- 172.21.15.102:0/3267745711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 msgr2=0x562aca3527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009230 tx=0x7fc64c000bc0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 -- 172.21.15.102:0/3267745711 shutdown_connections 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f79390 0x562aca352cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f711b0 0x562aca3527b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 --2- 172.21.15.102:0/3267745711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f589f0 0x562aca3571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 -- 172.21.15.102:0/3267745711 >> 172.21.15.102:0/3267745711 conn(0x562ac9f8e460 msgr2=0x562aca356ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 -- 172.21.15.102:0/3267745711 shutdown_connections 2024-09-21T03:34:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.048+0000 7fc66456f740 1 -- 172.21.15.102:0/3267745711 wait complete. 2024-09-21T03:34:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.049+0000 7fc66456f740 1 -- start start 2024-09-21T03:34:25.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.049+0000 7fc66456f740 1 Processor -- start 2024-09-21T03:34:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 0x562aca35a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca3d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400cef0 con 0x562ac9f589f0 2024-09-21T03:34:25.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400e360 con 0x562ac9f711b0 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc64400d5c0 con 0x562ac9f79390 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc657fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc657fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40500/0 (socket says 172.21.15.102:40500) 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc657fff640 1 -- 172.21.15.102:0/1694733205 learned_addr learned my addr 172.21.15.102:0/1694733205 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc656ffd640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 0x562aca35a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.050+0000 7fc66456f740 10 client.0 _ll_register_callbacks cb 0x7fc650015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 -- 172.21.15.102:0/1694733205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 msgr2=0x562aca3d0d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca3d0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 -- 172.21.15.102:0/1694733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 msgr2=0x562aca35a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 -- 172.21.15.102:0/1694733205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aca3d1340 con 0x562ac9f711b0 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc657fff640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc656ffd640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 0x562aca35a6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc64c005f70 tx=0x7fc64c004480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24d8637161703ac1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:34:25.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c052070 con 0x562ac9f711b0 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc64c043040 con 0x562ac9f711b0 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.051+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc64c049020 con 0x562ac9f711b0 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.052+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc64c05e050 con 0x562ac9f711b0 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.052+0000 7fc66456f740 10 client.25118 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.052+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562aca3d24d0 con 0x562ac9f711b0 2024-09-21T03:34:25.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.052+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc64c003cd0 con 0x562ac9f711b0 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc64c031cb0 con 0x562ac9f711b0 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 10 client.25118 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 10 client.25118 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 20 client.25118 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f9a070 0x562aca3d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 4 client.25118 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.053+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fc64c049020 con 0x562ac9f9a070 2024-09-21T03:34:25.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc657fff640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f9a070 0x562aca3d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:25.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc636ffd640 10 client.25118 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:34:25.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc657fff640 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f9a070 0x562aca3d4b20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f69e736a5ee0ab7 server_cookie=d4d4f0367c7f0cf in_seq=0 out_seq=0 2024-09-21T03:34:25.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc636ffd640 1 -- 172.21.15.102:0/1694733205 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fc64c049020 con 0x562ac9f9a070 2024-09-21T03:34:25.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc636ffd640 10 client.25118 handle_command_reply: tid=0 2024-09-21T03:34:25.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.054+0000 7fc66456f740 1 client.25118 shutdown 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 msgr2=0x562aca35a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 0x562aca35a6e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc64c005f70 tx=0x7fc64c004480 comp rx=0 tx=0).stop 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 shutdown_connections 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x562ac9f9a070 0x562aca3d4b20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562ac9f79390 0x562aca3d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562ac9f711b0 0x562aca35a6e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc636ffd640 0 client.25118 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 --2- 172.21.15.102:0/1694733205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ac9f589f0 0x562aca35a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 >> 172.21.15.102:0/1694733205 conn(0x562ac9f8e460 msgr2=0x562aca354360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 shutdown_connections 2024-09-21T03:34:25.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 1 -- 172.21.15.102:0/1694733205 wait complete. 2024-09-21T03:34:25.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.055+0000 7fc66456f740 20 client.25118 trim_cache size 0 max 16384 2024-09-21T03:34:25.059 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 msgr2=0x7fc6400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 0x7fc6400b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc6480e4e30 tx=0x7fc648018540 comp rx=0 tx=0).stop 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 msgr2=0x7fc658199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc64800c920 tx=0x7fc64800cde0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 shutdown_connections 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc6400b6700 0x7fc6400b8c10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc65819eda0 0x7fc65819f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc658108cf0 0x7fc658199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 --2- 172.21.15.102:0/992049737 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc658102a60 0x7fc658199620 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:25.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.056+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 >> 172.21.15.102:0/992049737 conn(0x7fc658079730 msgr2=0x7fc658104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:25.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.057+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 shutdown_connections 2024-09-21T03:34:25.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:25.057+0000 7fc65dffb640 1 -- 172.21.15.102:0/992049737 wait complete. 2024-09-21T03:34:25.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:34:26.152 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:26.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 -- 172.21.15.102:0/2966360231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160108730 msgr2=0x7f0160108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 --2- 172.21.15.102:0/2966360231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160108730 0x7f0160108b40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0150009930 tx=0x7f015002a420 comp rx=0 tx=0).stop 2024-09-21T03:34:26.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 -- 172.21.15.102:0/2966360231 shutdown_connections 2024-09-21T03:34:26.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 --2- 172.21.15.102:0/2966360231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f01601105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 --2- 172.21.15.102:0/2966360231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160101e20 0x7f0160102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 --2- 172.21.15.102:0/2966360231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160108730 0x7f0160108b40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 -- 172.21.15.102:0/2966360231 >> 172.21.15.102:0/2966360231 conn(0x7f0160077cc0 msgr2=0x7f0160078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 -- 172.21.15.102:0/2966360231 shutdown_connections 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.728+0000 7f0165afe640 1 -- 172.21.15.102:0/2966360231 wait complete. 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.729+0000 7f0165afe640 1 Processor -- start 2024-09-21T03:34:26.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.729+0000 7f0165afe640 1 -- start start 2024-09-21T03:34:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f016019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f015f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f015f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40518/0 (socket says 172.21.15.102:40518) 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160108730 0x7f016019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f015f7fe640 1 -- 172.21.15.102:0/1770540626 learned_addr learned my addr 172.21.15.102:0/1770540626 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0160113bf0 con 0x7f0160101e20 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0160113a70 con 0x7f0160102770 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0160113d70 con 0x7f0160108730 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f015effd640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f016019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.730+0000 7f015ffff640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160108730 0x7f016019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 -- 172.21.15.102:0/1770540626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160108730 msgr2=0x7f016019fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160108730 0x7f016019fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 -- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 msgr2=0x7f016019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01601a05d0 con 0x7f0160102770 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015f7fe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015effd640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f016019ac00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0160075ad0 tx=0x7f015400dbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.731+0000 7f015cff9640 1 -- 172.21.15.102:0/1770540626 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154017070 con 0x7f0160102770 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.732+0000 7f015cff9640 1 -- 172.21.15.102:0/1770540626 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01540099d0 con 0x7f0160102770 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.732+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01601a08c0 con 0x7f0160102770 2024-09-21T03:34:26.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.732+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01601a7020 con 0x7f0160102770 2024-09-21T03:34:26.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.733+0000 7f015cff9640 1 -- 172.21.15.102:0/1770540626 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01540047a0 con 0x7f0160102770 2024-09-21T03:34:26.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.735+0000 7f015cff9640 1 -- 172.21.15.102:0/1770540626 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f0154009b80 con 0x7f0160102770 2024-09-21T03:34:26.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.736+0000 7f015cff9640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 0x7f01480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.736+0000 7f015f7fe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 0x7f01480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.736+0000 7f015cff9640 1 -- 172.21.15.102:0/1770540626 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f01540e72c0 con 0x7f0160102770 2024-09-21T03:34:26.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.737+0000 7f015f7fe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 0x7f01480b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0150000c00 tx=0x7f0150005d70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.737+0000 7f016c072740 1 Processor -- start 2024-09-21T03:34:26.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.737+0000 7f016c072740 1 -- start start 2024-09-21T03:34:26.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d732287070 0x55d73262e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 0x55d73262ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73262f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7325a4ea0 con 0x55d732266390 2024-09-21T03:34:26.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d7325942d0 con 0x55d73225e1b0 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f016c072740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d7325980e0 con 0x55d732287070 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f015effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 0x55d73262ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f015effd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 0x55d73262ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:56080/0 (socket says 172.21.15.102:56080) 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f015effd640 1 -- 172.21.15.102:0/1432838218 learned_addr learned my addr 172.21.15.102:0/1432838218 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f015ffff640 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73262f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.738+0000 7f015f7fe640 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d732287070 0x55d73262e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 -- 172.21.15.102:0/1432838218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d732287070 msgr2=0x55d73262e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d732287070 0x55d73262e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 -- 172.21.15.102:0/1432838218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 msgr2=0x55d73262ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 0x55d73262ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 -- 172.21.15.102:0/1432838218 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7322f2650 con 0x55d732266390 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.739+0000 7f015ffff640 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73262f120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0158009eb0 tx=0x7f01580107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d0c21295aaee4c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.740+0000 7f0145ffb640 1 -- 172.21.15.102:0/1432838218 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158003b70 con 0x55d732266390 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.740+0000 7f0145ffb640 1 -- 172.21.15.102:0/1432838218 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0158019070 con 0x55d732266390 2024-09-21T03:34:26.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.740+0000 7f0145ffb640 1 -- 172.21.15.102:0/1432838218 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158004680 con 0x55d732266390 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- 172.21.15.102:0/1432838218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 msgr2=0x55d73262f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73262f120 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0158009eb0 tx=0x7f01580107a0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- 172.21.15.102:0/1432838218 shutdown_connections 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73262f120 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d73225e1b0 0x55d73262ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 --2- 172.21.15.102:0/1432838218 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d732287070 0x55d73262e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- 172.21.15.102:0/1432838218 >> 172.21.15.102:0/1432838218 conn(0x55d73227b460 msgr2=0x55d73262c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- 172.21.15.102:0/1432838218 shutdown_connections 2024-09-21T03:34:26.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- 172.21.15.102:0/1432838218 wait complete. 2024-09-21T03:34:26.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.741+0000 7f016c072740 1 -- start start 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 Processor -- start 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732639d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d732287070 0x55d732646170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7323f5700 con 0x55d732266390 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d73252f160 con 0x55d732287070 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d73263ce80 con 0x55d73225e1b0 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f016c072740 10 client.0 _ll_register_callbacks cb 0x55d7325489e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f015effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f015f7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732639d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f015effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40532/0 (socket says 172.21.15.102:40532) 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f015effd640 1 -- 172.21.15.102:0/3312231697 learned_addr learned my addr 172.21.15.102:0/3312231697 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.742+0000 7f015ffff640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d732287070 0x55d732646170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 -- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 msgr2=0x55d732639d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732639d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 -- 172.21.15.102:0/3312231697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d732287070 msgr2=0x55d732646170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d732287070 0x55d732646170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 -- 172.21.15.102:0/3312231697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73255cc90 con 0x55d732266390 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f015effd640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f01540e49a0 tx=0x7f01540a9010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05bb5f808a3d77d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f013effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:26.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0154098020 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f01540981c0 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.743+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0158019070 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01540ac870 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 10 client.15600 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d732648c20 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0158019070 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f01540b2d70 con 0x55d732266390 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 10 client.15600 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 20 client.15600 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d7322459f0 0x55d73264c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 4 client.15600 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:26.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.744+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7325a6df0 con 0x55d7322459f0 2024-09-21T03:34:26.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.745+0000 7f015f7fe640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d7322459f0 0x55d73264c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.745+0000 7f013effd640 10 client.15600 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:26.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.746+0000 7f015f7fe640 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d7322459f0 0x55d73264c160 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91fee8da24d93e50 server_cookie=66ad42ed57565112 in_seq=0 out_seq=0 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.746+0000 7f013effd640 1 -- 172.21.15.102:0/3312231697 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7325a6df0 con 0x55d7322459f0 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.746+0000 7f013effd640 10 client.15600 handle_command_reply: tid=0 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.746+0000 7f016c072740 1 client.15600 shutdown 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 msgr2=0x55d73263a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f01540e49a0 tx=0x7f01540a9010 comp rx=0 tx=0).stop 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 shutdown_connections 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d7322459f0 0x55d73264c160 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f013effd640 0 client.15600 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732266390 0x55d73263a2c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d732287070 0x55d732646170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 --2- 172.21.15.102:0/3312231697 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732639d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 >> 172.21.15.102:0/3312231697 conn(0x55d73227b460 msgr2=0x55d732631830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 shutdown_connections 2024-09-21T03:34:26.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 1 -- 172.21.15.102:0/3312231697 wait complete. 2024-09-21T03:34:26.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.747+0000 7f016c072740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T03:34:26.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.761+0000 7f016c072740 1 Processor -- start 2024-09-21T03:34:26.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.761+0000 7f016c072740 1 -- start start 2024-09-21T03:34:26.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d732646070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732636f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f01601b0060 con 0x55d732287070 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01601ad930 con 0x55d7322459f0 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f016c072740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01601ab780 con 0x55d73225e1b0 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40542/0 (socket says 172.21.15.102:40542) 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 -- 172.21.15.102:0/763291603 learned_addr learned my addr 172.21.15.102:0/763291603 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015effd640 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732636f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015f7fe640 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d732646070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 -- 172.21.15.102:0/763291603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 msgr2=0x55d732636f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732636f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 -- 172.21.15.102:0/763291603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 msgr2=0x55d732646070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d732646070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.762+0000 7f015ffff640 1 -- 172.21.15.102:0/763291603 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73263b040 con 0x55d732287070 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.763+0000 7f015ffff640 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0158005c40 tx=0x7f0158009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311e62353f0a79a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.763+0000 7f01457fa640 1 -- 172.21.15.102:0/763291603 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158003b70 con 0x55d732287070 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.763+0000 7f01457fa640 1 -- 172.21.15.102:0/763291603 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0158019040 con 0x55d732287070 2024-09-21T03:34:26.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.763+0000 7f01457fa640 1 -- 172.21.15.102:0/763291603 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158005770 con 0x55d732287070 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 -- 172.21.15.102:0/763291603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 msgr2=0x55d7326374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0158005c40 tx=0x7f0158009b90 comp rx=0 tx=0).stop 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 -- 172.21.15.102:0/763291603 shutdown_connections 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326374b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d732636f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 --2- 172.21.15.102:0/763291603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d732646070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 -- 172.21.15.102:0/763291603 >> 172.21.15.102:0/763291603 conn(0x55d73227b460 msgr2=0x55d732638600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 -- 172.21.15.102:0/763291603 shutdown_connections 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.764+0000 7f016c072740 1 -- 172.21.15.102:0/763291603 wait complete. 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 -- start start 2024-09-21T03:34:26.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 Processor -- start 2024-09-21T03:34:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d73263e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d73263ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f01601abdf0 con 0x55d732287070 2024-09-21T03:34:26.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01601ad260 con 0x55d7322459f0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01601ac4c0 con 0x55d73225e1b0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.765+0000 7f016c072740 10 client.0 _ll_register_callbacks cb 0x7f01540e4eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40552/0 (socket says 172.21.15.102:40552) 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 -- 172.21.15.102:0/2844000939 learned_addr learned my addr 172.21.15.102:0/2844000939 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015effd640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d73263ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015f7fe640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d73263e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 -- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 msgr2=0x55d73263ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d73263ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 -- 172.21.15.102:0/2844000939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 msgr2=0x55d73263e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d73263e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 -- 172.21.15.102:0/2844000939 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7326b6060 con 0x55d732287070 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f015ffff640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0158009b60 tx=0x7f0158004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d676a704b5ca56c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:26.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f013effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.766+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0158005580 con 0x55d732287070 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f0158005720 con 0x55d732287070 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0158019040 con 0x55d732287070 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0158005920 con 0x55d732287070 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 10 client.15606 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:26.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d7326b7290 con 0x55d732287070 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f015801e940 con 0x55d732287070 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f0158011770 con 0x55d732287070 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 10 client.15606 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 10 client.15606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 20 client.15606 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d73221ada0 0x55d7326b9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 4 client.15606 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.767+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0158019040 con 0x55d73221ada0 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f015f7fe640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d73221ada0 0x55d7326b9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f015f7fe640 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d73221ada0 0x55d7326b9770 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e4c0bd40c41e3f server_cookie=a8a06f8f5779267e in_seq=0 out_seq=0 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f013effd640 10 client.15606 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:26.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f013effd640 1 -- 172.21.15.102:0/2844000939 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0158019040 con 0x55d73221ada0 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f013effd640 10 client.15606 handle_command_reply: tid=0 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.768+0000 7f016c072740 1 client.15606 shutdown 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 msgr2=0x55d7326b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f0158009b60 tx=0x7f0158004070 comp rx=0 tx=0).stop 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 shutdown_connections 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d73221ada0 0x55d7326b9770 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d732287070 0x55d7326b5b20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d73225e1b0 0x55d73263ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 --2- 172.21.15.102:0/2844000939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7322459f0 0x55d73263e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 >> 172.21.15.102:0/2844000939 conn(0x55d73227b460 msgr2=0x55d73262f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f013effd640 0 client.15606 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 shutdown_connections 2024-09-21T03:34:26.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 1 -- 172.21.15.102:0/2844000939 wait complete. 2024-09-21T03:34:26.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f016c072740 20 client.15606 trim_cache size 0 max 16384 2024-09-21T03:34:26.775 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:34:26.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 msgr2=0x7f01480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 0x7f01480b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0150000c00 tx=0x7f0150005d70 comp rx=0 tx=0).stop 2024-09-21T03:34:26.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 msgr2=0x7f016019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.769+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f016019ac00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0160075ad0 tx=0x7f015400dbb0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 shutdown_connections 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01480b6700 0x7f01480b8c10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0160108730 0x7f016019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0160102770 0x7f016019ac00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 --2- 172.21.15.102:0/1770540626 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0160101e20 0x7f016019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 >> 172.21.15.102:0/1770540626 conn(0x7f0160077cc0 msgr2=0x7f0160107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 shutdown_connections 2024-09-21T03:34:26.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:26.770+0000 7f0165afe640 1 -- 172.21.15.102:0/1770540626 wait complete. 2024-09-21T03:34:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:27 smithi102 ceph-mon[31392]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:27 smithi148 ceph-mon[34651]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:27 smithi121 ceph-mon[34316]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:28.487 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:34:28.487 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:34:28.768 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 -- 172.21.15.102:0/2522702724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024108480 msgr2=0x7f202410ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 --2- 172.21.15.102:0/2522702724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024108480 0x7f202410ecb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f201c00adb0 tx=0x7f201c02a690 comp rx=0 tx=0).stop 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 -- 172.21.15.102:0/2522702724 shutdown_connections 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 --2- 172.21.15.102:0/2522702724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024108480 0x7f202410ecb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 --2- 172.21.15.102:0/2522702724 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024107b30 0x7f2024107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 --2- 172.21.15.102:0/2522702724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 -- 172.21.15.102:0/2522702724 >> 172.21.15.102:0/2522702724 conn(0x7f2024077c60 msgr2=0x7f20240780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 -- 172.21.15.102:0/2522702724 shutdown_connections 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.333+0000 7f202b424640 1 -- 172.21.15.102:0/2522702724 wait complete. 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.335+0000 7f202b424640 1 Processor -- start 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.335+0000 7f202b424640 1 -- start start 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024107b30 0x7f20241988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20289bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024107b30 0x7f20241988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:56136/0 (socket says 172.21.15.102:56136) 2024-09-21T03:34:29.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024108480 0x7f202419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 -- 172.21.15.102:0/2654779749 learned_addr learned my addr 172.21.15.102:0/2654779749 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2024111a20 con 0x7f2024107b30 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f20241118a0 con 0x7f20241021f0 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2024111ba0 con 0x7f2024108480 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20299c1640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024108480 0x7f202419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 -- 172.21.15.102:0/2654779749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024108480 msgr2=0x7f202419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024108480 0x7f202419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 -- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024107b30 msgr2=0x7f20241988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024107b30 0x7f20241988b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.336+0000 7f20291c0640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202419e280 con 0x7f20241021f0 2024-09-21T03:34:29.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f20291c0640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2020009990 tx=0x7f2020009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f201a7fc640 1 -- 172.21.15.102:0/2654779749 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202001b070 con 0x7f20241021f0 2024-09-21T03:34:29.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f201a7fc640 1 -- 172.21.15.102:0/2654779749 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2020016410 con 0x7f20241021f0 2024-09-21T03:34:29.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f201a7fc640 1 -- 172.21.15.102:0/2654779749 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020015610 con 0x7f20241021f0 2024-09-21T03:34:29.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202419e570 con 0x7f20241021f0 2024-09-21T03:34:29.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.337+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20241a4cd0 con 0x7f20241021f0 2024-09-21T03:34:29.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.341+0000 7f201a7fc640 1 -- 172.21.15.102:0/2654779749 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f202001e070 con 0x7f20241021f0 2024-09-21T03:34:29.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.341+0000 7f2031998740 1 Processor -- start 2024-09-21T03:34:29.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.341+0000 7f2031998740 1 -- start start 2024-09-21T03:34:29.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.341+0000 7f2031998740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.341+0000 7f2031998740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f2031998740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 0x55edd5daaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20299c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20299c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:56138/0 (socket says 172.21.15.102:56138) 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20291c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20291c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40568/0 (socket says 172.21.15.102:40568) 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f2031998740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edd5d20e60 con 0x55edd59da490 2024-09-21T03:34:29.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f2031998740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edd5d10290 con 0x55edd5a03350 2024-09-21T03:34:29.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f2031998740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edd5d140a0 con 0x55edd59e2670 2024-09-21T03:34:29.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20299c1640 1 -- 172.21.15.102:0/3888117237 learned_addr learned my addr 172.21.15.102:0/3888117237 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:29.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.342+0000 7f20289bf640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 0x55edd5daaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 -- 172.21.15.102:0/3888117237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 msgr2=0x55edd5daaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 0x55edd5daaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 -- 172.21.15.102:0/3888117237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 msgr2=0x55edd5daa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 -- 172.21.15.102:0/3888117237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd5a6e930 con 0x55edd59da490 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f201a7fc640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 0x7f20100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20299c1640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20289bf640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 0x55edd5daaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20299c1640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 0x7f20100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.343+0000 7f20291c0640 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f20200e4280 tx=0x7f20200ef740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4079e8fd059f96c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.344+0000 7f201a7fc640 1 -- 172.21.15.102:0/2654779749 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f20200e6b40 con 0x7f20241021f0 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.344+0000 7f200f7fe640 1 -- 172.21.15.102:0/3888117237 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20200f6070 con 0x55edd59da490 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.344+0000 7f200f7fe640 1 -- 172.21.15.102:0/3888117237 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f20200ac490 con 0x55edd59da490 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.344+0000 7f200f7fe640 1 -- 172.21.15.102:0/3888117237 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20200ac750 con 0x55edd59da490 2024-09-21T03:34:29.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.344+0000 7f20299c1640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 0x7f20100b8c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f201c004af0 tx=0x7f201c004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 -- 172.21.15.102:0/3888117237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 msgr2=0x55edd5daa970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f20200e4280 tx=0x7f20200ef740 comp rx=0 tx=0).stop 2024-09-21T03:34:29.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 -- 172.21.15.102:0/3888117237 shutdown_connections 2024-09-21T03:34:29.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5daa970 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59e2670 0x55edd5daaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 --2- 172.21.15.102:0/3888117237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5daa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 -- 172.21.15.102:0/3888117237 >> 172.21.15.102:0/3888117237 conn(0x55edd59f7740 msgr2=0x55edd5da8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 -- 172.21.15.102:0/3888117237 shutdown_connections 2024-09-21T03:34:29.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.346+0000 7f2031998740 1 -- 172.21.15.102:0/3888117237 wait complete. 2024-09-21T03:34:29.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.347+0000 7f2031998740 1 -- start start 2024-09-21T03:34:29.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.347+0000 7f2031998740 1 Processor -- start 2024-09-21T03:34:29.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f2031998740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5db60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f2031998740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f2031998740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 0x55edd5dc1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20291c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5db60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20289bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20289bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:56144/0 (socket says 172.21.15.102:56144) 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20299c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 0x55edd5dc1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20299c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 0x55edd5dc1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40582/0 (socket says 172.21.15.102:40582) 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20291c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5db60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:44424/0 (socket says 172.21.15.102:44424) 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.348+0000 7f20289bf640 1 -- 172.21.15.102:0/2061707721 learned_addr learned my addr 172.21.15.102:0/2061707721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edd5b71890 con 0x55edd5a03350 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edd5caad40 con 0x55edd59e2670 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edd5db8c10 con 0x55edd59da490 2024-09-21T03:34:29.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 -- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 msgr2=0x55edd5db60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5db60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 -- 172.21.15.102:0/2061707721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 msgr2=0x55edd5dc1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 0x55edd5dc1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd5dc2540 con 0x55edd59e2670 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f20289bf640 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20140095f0 tx=0x7f2014009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706636734b6a936d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.349+0000 7f200cff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f200cff9640 1 -- 172.21.15.102:0/2061707721 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401e030 con 0x55edd59e2670 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f2031998740 10 client.0 _ll_register_callbacks cb 0x55edd5d0ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f200cff9640 1 -- 172.21.15.102:0/2061707721 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2014004020 con 0x55edd59e2670 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20200ac490 con 0x55edd59e2670 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f200cff9640 1 -- 172.21.15.102:0/2061707721 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2014028050 con 0x55edd59e2670 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f2031998740 10 client.25148 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:29.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55edd5dc4c40 con 0x55edd59e2670 2024-09-21T03:34:29.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.350+0000 7f200cff9640 1 -- 172.21.15.102:0/2061707721 <== mon.2 v2:172.21.15.121:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2014004220 con 0x55edd59e2670 2024-09-21T03:34:29.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 10 client.25148 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 10 client.25148 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 20 client.25148 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd59c1cd0 0x55edd5dc8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 4 client.25148 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f20200ac490 con 0x55edd59c1cd0 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.351+0000 7f20291c0640 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd59c1cd0 0x55edd5dc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.352+0000 7f200cff9640 10 client.25148 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.352+0000 7f20291c0640 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd59c1cd0 0x55edd5dc8100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05cf1a06a8569ee server_cookie=9c74a45a69d43db0 in_seq=0 out_seq=0 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.352+0000 7f200cff9640 1 -- 172.21.15.102:0/2061707721 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f20200ac490 con 0x55edd59c1cd0 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f200cff9640 10 client.25148 handle_command_reply: tid=0 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 client.25148 shutdown 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 msgr2=0x55edd5db6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20140095f0 tx=0x7f2014009ab0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 shutdown_connections 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd59c1cd0 0x55edd5dc8100 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd5a03350 0x55edd5dc1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5db6660 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 --2- 172.21.15.102:0/2061707721 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5db60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 >> 172.21.15.102:0/2061707721 conn(0x55edd59f7740 msgr2=0x55edd5dad610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f200cff9640 0 client.25148 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 shutdown_connections 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 1 -- 172.21.15.102:0/2061707721 wait complete. 2024-09-21T03:34:29.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.353+0000 7f2031998740 20 client.25148 trim_cache size 0 max 16384 2024-09-21T03:34:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.388+0000 7f2031998740 1 Processor -- start 2024-09-21T03:34:29.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.388+0000 7f2031998740 1 -- start start 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5daf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5dad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f20289bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f20289bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40586/0 (socket says 172.21.15.102:40586) 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f20291c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5daf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f20291c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5daf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:44438/0 (socket says 172.21.15.102:44438) 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f20289bf640 1 -- 172.21.15.102:0/1141122787 learned_addr learned my addr 172.21.15.102:0/1141122787 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f20241aff60 con 0x55edd59e2670 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f20241ad830 con 0x55edd5a03350 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.389+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20241ab680 con 0x55edd59da490 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20299c1640 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5dad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 -- 172.21.15.102:0/1141122787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 msgr2=0x55edd5daf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5daf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 -- 172.21.15.102:0/1141122787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 msgr2=0x55edd5dad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5dad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 -- 172.21.15.102:0/1141122787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edd5db1750 con 0x55edd59e2670 2024-09-21T03:34:29.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20299c1640 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5dad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.390+0000 7f20289bf640 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f201400f760 tx=0x7f2014013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19b68fd3da88317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.391+0000 7f200effd640 1 -- 172.21.15.102:0/1141122787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014031070 con 0x55edd59e2670 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.391+0000 7f200effd640 1 -- 172.21.15.102:0/1141122787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2014007ce0 con 0x55edd59e2670 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.391+0000 7f200effd640 1 -- 172.21.15.102:0/1141122787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201401e040 con 0x55edd59e2670 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.392+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 msgr2=0x55edd5dafa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.392+0000 7f2031998740 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f201400f760 tx=0x7f2014013000 comp rx=0 tx=0).stop 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.392+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 shutdown_connections 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.392+0000 7f2031998740 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59e2670 0x55edd5dafa50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.392+0000 7f2031998740 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd5a03350 0x55edd5dad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.393+0000 7f2031998740 1 --2- 172.21.15.102:0/1141122787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd59da490 0x55edd5daf510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.393+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 >> 172.21.15.102:0/1141122787 conn(0x55edd59f7740 msgr2=0x55edd5db4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.393+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 shutdown_connections 2024-09-21T03:34:29.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.393+0000 7f2031998740 1 -- 172.21.15.102:0/1141122787 wait complete. 2024-09-21T03:34:29.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.393+0000 7f2031998740 1 -- start start 2024-09-21T03:34:29.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.394+0000 7f2031998740 1 Processor -- start 2024-09-21T03:34:29.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.394+0000 7f2031998740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5dba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5dbae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 0x55edd5e2bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f20291c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5dba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f20291c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5dba8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40598/0 (socket says 172.21.15.102:40598) 2024-09-21T03:34:29.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f20291c0640 1 -- 172.21.15.102:0/815236238 learned_addr learned my addr 172.21.15.102:0/815236238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:29.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f20241abcf0 con 0x55edd59da490 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f20241ad160 con 0x55edd59e2670 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f20241ac3c0 con 0x55edd5a03350 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f20299c1640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 0x55edd5e2bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f20289bf640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5dbae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.395+0000 7f2031998740 10 client.0 _ll_register_callbacks cb 0x7f201400f690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 -- 172.21.15.102:0/815236238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 msgr2=0x55edd5dbae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5dbae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 -- 172.21.15.102:0/815236238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 msgr2=0x55edd5dba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5dba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edd5e2c220 con 0x55edd5a03350 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f20299c1640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 0x55edd5e2bbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f201c00adb0 tx=0x7f201c00a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76b47c692bd7b501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:29.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f200cff9640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:34:29.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201c057060 con 0x55edd5a03350 2024-09-21T03:34:29.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f201c0045d0 con 0x55edd5a03350 2024-09-21T03:34:29.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.396+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2014007ce0 con 0x55edd5a03350 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f201c0047d0 con 0x55edd5a03350 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 10 client.25198 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55edd5e335f0 con 0x55edd5a03350 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f201c02f9e0 con 0x55edd5a03350 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f201c045040 con 0x55edd5a03350 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 10 client.25198 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 10 client.25198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 20 client.25198 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd5997080 0x55edd5e35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:29.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 4 client.25198 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:34:29.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.397+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f2014007ce0 con 0x55edd5997080 2024-09-21T03:34:29.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.398+0000 7f20291c0640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd5997080 0x55edd5e35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:29.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.398+0000 7f200cff9640 10 client.25198 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:29.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.398+0000 7f20291c0640 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd5997080 0x55edd5e35d50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b575b6f3b0aead7 server_cookie=72b878fb0f3d2779 in_seq=0 out_seq=0 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f200cff9640 1 -- 172.21.15.102:0/815236238 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f2014007ce0 con 0x55edd5997080 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f200cff9640 10 client.25198 handle_command_reply: tid=0 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 client.25198 shutdown 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 msgr2=0x55edd5e2bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 0x55edd5e2bbb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f201c00adb0 tx=0x7f201c00a6d0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 shutdown_connections 2024-09-21T03:34:29.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edd5a03350 0x55edd5e2bbb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edd59e2670 0x55edd5dbae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edd5997080 0x55edd5e35d50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f200cff9640 0 client.25198 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 --2- 172.21.15.102:0/815236238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edd59da490 0x55edd5dba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.400+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 >> 172.21.15.102:0/815236238 conn(0x55edd59f7740 msgr2=0x55edd5db4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.401+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 shutdown_connections 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.401+0000 7f2031998740 1 -- 172.21.15.102:0/815236238 wait complete. 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.401+0000 7f2031998740 20 client.25198 trim_cache size 0 max 16384 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:34:29.404 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:34:29.405 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "319b84da-6ffe-46e6-abf1-535a8947f405", 2024-09-21T03:34:29.405 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:34:29.405 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.401+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 msgr2=0x7f20100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.401+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 0x7f20100b8c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f201c004af0 tx=0x7f201c004a40 comp rx=0 tx=0).stop 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 msgr2=0x7f2024198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2020009990 tx=0x7f2020009e50 comp rx=0 tx=0).stop 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 shutdown_connections 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f20100b6700 0x7f20100b8c10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2024107b30 0x7f20241988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2024108480 0x7f202419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 --2- 172.21.15.102:0/2654779749 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20241021f0 0x7f2024198310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:29.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 >> 172.21.15.102:0/2654779749 conn(0x7f2024077c60 msgr2=0x7f2024105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:29.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 shutdown_connections 2024-09-21T03:34:29.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:29.402+0000 7f202b424640 1 -- 172.21.15.102:0/2654779749 wait complete. 2024-09-21T03:34:29.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:29 smithi102 ceph-mon[31392]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:29.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:29 smithi148 ceph-mon[34651]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:29 smithi121 ceph-mon[34316]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:30.154 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:34:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:30 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:34:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:30 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:30 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:34:30.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:30 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:30.549 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:34:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:30 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:34:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:30 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:30 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:34:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:30 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:30.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:30 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:34:30.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:30 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:30.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:30 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:34:30.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:30 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.137+0000 7f3d24907640 1 -- 172.21.15.102:0/1161108508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d20102f80 msgr2=0x7f3d2010fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.137+0000 7f3d24907640 1 --2- 172.21.15.102:0/1161108508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d20102f80 0x7f3d2010fca0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009900 tx=0x7f3d1402a4a0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 -- 172.21.15.102:0/1161108508 shutdown_connections 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 --2- 172.21.15.102:0/1161108508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d20102f80 0x7f3d2010fca0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 --2- 172.21.15.102:0/1161108508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d201101e0 0x7f3d20112600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 --2- 172.21.15.102:0/1161108508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 0x7f3d20102a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 -- 172.21.15.102:0/1161108508 >> 172.21.15.102:0/1161108508 conn(0x7f3d20079730 msgr2=0x7f3d20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 -- 172.21.15.102:0/1161108508 shutdown_connections 2024-09-21T03:34:31.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.138+0000 7f3d24907640 1 -- 172.21.15.102:0/1161108508 wait complete. 2024-09-21T03:34:31.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.139+0000 7f3d24907640 1 Processor -- start 2024-09-21T03:34:31.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.139+0000 7f3d24907640 1 -- start start 2024-09-21T03:34:31.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.139+0000 7f3d24907640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 0x7f3d2019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.139+0000 7f3d24907640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d20102f80 0x7f3d2019cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.139+0000 7f3d24907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40620/0 (socket says 172.21.15.102:40620) 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 0x7f3d2019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/3773348647 learned_addr learned my addr 172.21.15.102:0/3773348647 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d20102f80 0x7f3d2019cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20115d70 con 0x7f3d201101e0 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20115bf0 con 0x7f3d20102f80 2024-09-21T03:34:31.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20115ef0 con 0x7f3d20102630 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/3773348647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 msgr2=0x7f3d2019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 0x7f3d2019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/3773348647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d20102f80 msgr2=0x7f3d2019cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d20102f80 0x7f3d2019cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d201a2590 con 0x7f3d201101e0 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.140+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cce0 tx=0x7f3d1800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.141+0000 7f3d0f7fe640 1 -- 172.21.15.102:0/3773348647 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1800f450 con 0x7f3d201101e0 2024-09-21T03:34:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.141+0000 7f3d0f7fe640 1 -- 172.21.15.102:0/3773348647 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d1800fac0 con 0x7f3d201101e0 2024-09-21T03:34:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.141+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d201a2880 con 0x7f3d201101e0 2024-09-21T03:34:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.141+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a90a0 con 0x7f3d201101e0 2024-09-21T03:34:31.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.141+0000 7f3d0f7fe640 1 -- 172.21.15.102:0/3773348647 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18018be0 con 0x7f3d201101e0 2024-09-21T03:34:31.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.145+0000 7f3d0f7fe640 1 -- 172.21.15.102:0/3773348647 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f3d180213f0 con 0x7f3d201101e0 2024-09-21T03:34:31.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d0f7fe640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 0x7f3d080b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 Processor -- start 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 -- start start 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 0x7f3d080b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf55240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb8d390 0x564a7cf55cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a7cecbe50 con 0x564a7cb851b0 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564a7cebb280 con 0x564a7cb8d390 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.146+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a7cebf090 con 0x564a7cbae070 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40630/0 (socket says 172.21.15.102:40630) 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/1099391240 learned_addr learned my addr 172.21.15.102:0/1099391240 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:31.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d0f7fe640 1 -- 172.21.15.102:0/3773348647 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3d180e8a60 con 0x7f3d201101e0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 0x7f3d080b8c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005fd0 tx=0x7f3d1000a400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/1099391240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 msgr2=0x564a7cf55240 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf55240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/1099391240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb8d390 msgr2=0x564a7cf55cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb8d390 0x564a7cf55cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/1099391240 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7cc19650 con 0x564a7cb851b0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.147+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009900 tx=0x7f3d14005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4b21349fb8242f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.148+0000 7f3d0cff9640 1 -- 172.21.15.102:0/1099391240 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14031440 con 0x564a7cb851b0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.148+0000 7f3d0cff9640 1 -- 172.21.15.102:0/1099391240 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d14031ab0 con 0x564a7cb851b0 2024-09-21T03:34:31.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.148+0000 7f3d0cff9640 1 -- 172.21.15.102:0/1099391240 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1403dbd0 con 0x564a7cb851b0 2024-09-21T03:34:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/1099391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 msgr2=0x564a7cf55780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009900 tx=0x7f3d14005f10 comp rx=0 tx=0).stop 2024-09-21T03:34:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/1099391240 shutdown_connections 2024-09-21T03:34:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf55780 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb8d390 0x564a7cf55cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/1099391240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf55240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/1099391240 >> 172.21.15.102:0/1099391240 conn(0x564a7cba2460 msgr2=0x564a7cf53130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/1099391240 shutdown_connections 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.149+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/1099391240 wait complete. 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 -- start start 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 Processor -- start 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb851b0 0x564a7cf608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a7cd1c700 con 0x564a7cb8d390 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564a7ce56110 con 0x564a7cb851b0 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564a7cf639c0 con 0x564a7cbae070 2024-09-21T03:34:31.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d2ae7b740 10 client.0 _ll_register_callbacks cb 0x564a7ce6f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d1dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40636/0 (socket says 172.21.15.102:40636) 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/949760589 learned_addr learned my addr 172.21.15.102:0/949760589 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.150+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 msgr2=0x564a7cf613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/949760589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb851b0 msgr2=0x564a7cf608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb851b0 0x564a7cf608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 -- 172.21.15.102:0/949760589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7ce83c40 con 0x564a7cb8d390 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3d14033040 tx=0x7f3d1403d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c87df10e66cdee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d14053020 con 0x564a7cb8d390 2024-09-21T03:34:31.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d14031ab0 con 0x564a7cb8d390 2024-09-21T03:34:31.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3d14031c60 con 0x564a7cb8d390 2024-09-21T03:34:31.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d1405e050 con 0x564a7cb8d390 2024-09-21T03:34:31.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d2ae7b740 10 client.15633 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:31.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.151+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a7cf6f690 con 0x564a7cb8d390 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d14031ab0 con 0x564a7cb8d390 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d14046430 con 0x564a7cb8d390 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 10 client.15633 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 20 client.15633 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cb6c9f0 0x564a7cf729f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 4 client.15633 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.152+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a7cecdda0 con 0x564a7cb6c9f0 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.153+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cb6c9f0 0x564a7cf729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.153+0000 7f3d05ffb640 10 client.15633 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:31.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.153+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cb6c9f0 0x564a7cf729f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88f8a75355822f08 server_cookie=538e5a44ff58c340 in_seq=0 out_seq=0 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d05ffb640 1 -- 172.21.15.102:0/949760589 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a7cecdda0 con 0x564a7cb6c9f0 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d05ffb640 10 client.15633 handle_command_reply: tid=0 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 client.15633 shutdown 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 msgr2=0x564a7cf60e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3d14033040 tx=0x7f3d1403d4e0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 shutdown_connections 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cb6c9f0 0x564a7cf729f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d05ffb640 0 client.15633 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb8d390 0x564a7cf60e20 secure :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3d14033040 tx=0x7f3d1403d4e0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cbae070 0x564a7cf613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/949760589 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cb851b0 0x564a7cf608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.154+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 >> 172.21.15.102:0/949760589 conn(0x564a7cba2460 msgr2=0x564a7cf583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.155+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 shutdown_connections 2024-09-21T03:34:31.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.155+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/949760589 wait complete. 2024-09-21T03:34:31.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.155+0000 7f3d2ae7b740 20 client.15633 trim_cache size 0 max 16384 2024-09-21T03:34:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.188+0000 7f3d2ae7b740 1 Processor -- start 2024-09-21T03:34:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.188+0000 7f3d2ae7b740 1 -- start start 2024-09-21T03:34:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb851b0 0x564a7cf53160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf5dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201afde0 con 0x564a7cb41da0 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201ad6b0 con 0x564a7cbae070 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201ab520 con 0x564a7cb851b0 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:40646/0 (socket says 172.21.15.102:40646) 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/2322423946 learned_addr learned my addr 172.21.15.102:0/2322423946 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/2322423946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb851b0 msgr2=0x564a7cf53160 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb851b0 0x564a7cf53160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/2322423946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 msgr2=0x564a7cf5dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.189+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf5dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf5dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d1ed9d640 1 -- 172.21.15.102:0/2322423946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a7cf5f840 con 0x564a7cb41da0 2024-09-21T03:34:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf5dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3d180ae540 tx=0x7f3d180ae730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d45bfeae799300 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d07fff640 1 -- 172.21.15.102:0/2322423946 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18094070 con 0x564a7cb41da0 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d07fff640 1 -- 172.21.15.102:0/2322423946 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d180aef40 con 0x564a7cb41da0 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.190+0000 7f3d07fff640 1 -- 172.21.15.102:0/2322423946 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18094210 con 0x564a7cb41da0 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/2322423946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 msgr2=0x564a7cf5e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3d180ae540 tx=0x7f3d180ae730 comp rx=0 tx=0).stop 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/2322423946 shutdown_connections 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb41da0 0x564a7cf5e010 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf5dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/2322423946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb851b0 0x564a7cf53160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/2322423946 >> 172.21.15.102:0/2322423946 conn(0x564a7cba2460 msgr2=0x564a7cf52a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/2322423946 shutdown_connections 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.191+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/2322423946 wait complete. 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 -- start start 2024-09-21T03:34:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 Processor -- start 2024-09-21T03:34:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201abb70 con 0x564a7cb851b0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201acfe0 con 0x564a7cbae070 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201ac240 con 0x564a7cb41da0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.192+0000 7f3d2ae7b740 10 client.0 _ll_register_callbacks cb 0x7f3d14005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:44488/0 (socket says 172.21.15.102:44488) 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 -- 172.21.15.102:0/3605908314 learned_addr learned my addr 172.21.15.102:0/3605908314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1ed9d640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 -- 172.21.15.102:0/3605908314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 msgr2=0x564a7cf749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 -- 172.21.15.102:0/3605908314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 msgr2=0x564a7cf74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:34:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1e59c640 1 -- 172.21.15.102:0/3605908314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a7cf74ef0 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.193+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d1e59c640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x564a7cecbfa0 tx=0x7f3d10004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40c71ef21e6610ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10016070 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f3d1001c420 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d180aef40 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d1002d640 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d2ae7b740 10 client.25207 fetch_fsmap learned FSMap version 24 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.194+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564a7cfdde50 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.195+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d1002dcb0 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.195+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3d1002b070 con 0x564a7cb41da0 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.195+0000 7f3d2ae7b740 10 client.25207 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:34:31.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.195+0000 7f3d2ae7b740 10 client.25207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:34:31.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.195+0000 7f3d2ae7b740 20 client.25207 populate_metadata read hostname 'smithi102' 2024-09-21T03:34:31.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cfde5f0 0x564a7cfe0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:34:31.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d2ae7b740 4 client.25207 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:34:31.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f3d180aef40 con 0x564a7cfde5f0 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cfde5f0 0x564a7cfe0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d1dd9b640 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cfde5f0 0x564a7cfe0a10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608ffbef978c0d06 server_cookie=a035e439e36016a5 in_seq=0 out_seq=0 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.196+0000 7f3d05ffb640 10 client.25207 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d05ffb640 1 -- 172.21.15.102:0/3605908314 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7f3d180aef40 con 0x564a7cfde5f0 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d05ffb640 10 client.25207 handle_command_reply: tid=0 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 client.25207 shutdown 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 msgr2=0x564a7cf75f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x564a7cecbfa0 tx=0x7f3d10004730 comp rx=0 tx=0).stop 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 shutdown_connections 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564a7cfde5f0 0x564a7cfe0a10 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a7cb851b0 0x564a7cf74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d05ffb640 0 client.25207 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:34:31.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564a7cbae070 0x564a7cf749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 --2- 172.21.15.102:0/3605908314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564a7cb41da0 0x564a7cf75f90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 >> 172.21.15.102:0/3605908314 conn(0x564a7cba2460 msgr2=0x564a7cf56270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.197+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 shutdown_connections 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d2ae7b740 1 -- 172.21.15.102:0/3605908314 wait complete. 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d2ae7b740 20 client.25207 trim_cache size 0 max 16384 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:34:31.203 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "319b84da-6ffe-46e6-abf1-535a8947f405", 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:34:31.204 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:34:31.205 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 msgr2=0x7f3d080b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 0x7f3d080b8c40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d10005fd0 tx=0x7f3d1000a400 comp rx=0 tx=0).stop 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 msgr2=0x7f3d201a1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.198+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800cce0 tx=0x7f3d1800a620 comp rx=0 tx=0).stop 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 shutdown_connections 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d080b6730 0x7f3d080b8c40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d201101e0 0x7f3d201a1f20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d20102f80 0x7f3d2019cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 --2- 172.21.15.102:0/3773348647 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d20102630 0x7f3d2019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:34:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 >> 172.21.15.102:0/3773348647 conn(0x7f3d20079730 msgr2=0x7f3d20109cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:34:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 shutdown_connections 2024-09-21T03:34:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:34:31.199+0000 7f3d24907640 1 -- 172.21.15.102:0/3773348647 wait complete. 2024-09-21T03:34:31.328 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:31 smithi102 ceph-mon[31392]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:31.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:31 smithi148 ceph-mon[34651]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:31 smithi121 ceph-mon[34316]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T03:34:32.053 INFO:tasks.cephfs.filesystem:scrub status for tag:319b84da-6ffe-46e6-abf1-535a8947f405 - {'path': '/', 'tag': '319b84da-6ffe-46e6-abf1-535a8947f405', 'options': 'recursive,force'} 2024-09-21T03:34:32.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:32 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:34:32.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:32 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:34:32.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:32 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:34:33.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:33 smithi102 ceph-mon[31392]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:33 smithi148 ceph-mon[34651]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:33 smithi121 ceph-mon[34316]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T03:34:35.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:35 smithi102 ceph-mon[31392]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:34:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:35 smithi148 ceph-mon[34651]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:34:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:35 smithi121 ceph-mon[34316]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-21T03:34:37.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:37 smithi102 ceph-mon[31392]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:34:37.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:37 smithi148 ceph-mon[34651]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:34:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:37 smithi121 ceph-mon[34316]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:34:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:39 smithi102 ceph-mon[31392]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T03:34:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:39 smithi148 ceph-mon[34651]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T03:34:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:39 smithi121 ceph-mon[34316]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T03:34:41.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:41 smithi102 ceph-mon[31392]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:34:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:41 smithi148 ceph-mon[34651]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:34:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:41 smithi121 ceph-mon[34316]: pgmap v357: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T03:34:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:43 smithi102 ceph-mon[31392]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:34:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:43 smithi148 ceph-mon[34651]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:34:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:43 smithi121 ceph-mon[34316]: pgmap v358: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:34:45.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:45 smithi102 ceph-mon[31392]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:45 smithi148 ceph-mon[34651]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:45 smithi121 ceph-mon[34316]: pgmap v359: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:47.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:47 smithi102 ceph-mon[31392]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:34:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:47 smithi148 ceph-mon[34651]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:34:47.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:47 smithi121 ceph-mon[34316]: pgmap v360: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:34:49.593 INFO:tasks.workunit.client.0.smithi102.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T03:34:49.593 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T03:34:49.594 INFO:tasks.workunit.client.0.smithi102.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: git switch -c 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr:Or undo this operation with: 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: git switch - 2024-09-21T03:34:49.595 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.596 INFO:tasks.workunit.client.0.smithi102.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T03:34:49.596 INFO:tasks.workunit.client.0.smithi102.stderr: 2024-09-21T03:34:49.596 INFO:tasks.workunit.client.0.smithi102.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:34:49.599 DEBUG:teuthology.orchestra.run.smithi102:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T03:34:49.629 INFO:tasks.workunit.client.0.smithi102.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T03:34:49.631 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:34:49.631 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T03:34:49.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:49 smithi102 ceph-mon[31392]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:34:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:49 smithi148 ceph-mon[34651]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:34:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:49 smithi121 ceph-mon[34316]: pgmap v361: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T03:34:50.355 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T03:34:50.425 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T03:34:50.466 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T03:34:50.468 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:34:50.468 INFO:tasks.workunit.client.0.smithi102.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T03:34:50.508 INFO:tasks.workunit.client.0.smithi102.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T03:34:50.513 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:34:50.514 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T03:34:50.568 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-21T03:34:50.569 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-21T03:34:50.569 DEBUG:teuthology.orchestra.run.smithi102:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-21T03:34:50.629 INFO:tasks.workunit.client.0.smithi102.stderr:+ KERNEL=linux-4.0.5 2024-09-21T03:34:50.629 INFO:tasks.workunit.client.0.smithi102.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-21T03:34:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:51 smithi102 ceph-mon[31392]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:34:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:51 smithi148 ceph-mon[34651]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:34:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:51 smithi121 ceph-mon[34316]: pgmap v362: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-21T03:34:53.499 INFO:tasks.workunit.client.0.smithi102.stderr:+ mkdir untar_tar 2024-09-21T03:34:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:+ cd untar_tar 2024-09-21T03:34:53.503 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-21T03:34:53.529 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ 2024-09-21T03:34:53.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-21T03:34:53.532 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-21T03:34:53.533 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-21T03:34:53.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-21T03:34:53.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-21T03:34:53.536 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-21T03:34:53.537 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-21T03:34:53.538 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-21T03:34:53.540 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-21T03:34:53.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-21T03:34:53.542 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-21T03:34:53.543 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-21T03:34:53.544 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-21T03:34:53.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-21T03:34:53.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-21T03:34:53.547 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-21T03:34:53.548 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-21T03:34:53.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-21T03:34:53.550 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-21T03:34:53.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-21T03:34:53.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-21T03:34:53.553 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-21T03:34:53.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-21T03:34:53.555 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-21T03:34:53.556 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-21T03:34:53.557 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-21T03:34:53.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-21T03:34:53.559 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-21T03:34:53.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-21T03:34:53.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-21T03:34:53.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-21T03:34:53.563 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-21T03:34:53.564 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-21T03:34:53.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-21T03:34:53.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-21T03:34:53.567 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-21T03:34:53.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-21T03:34:53.569 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-21T03:34:53.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-21T03:34:53.571 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-21T03:34:53.572 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-21T03:34:53.573 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-21T03:34:53.574 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-21T03:34:53.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-21T03:34:53.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-21T03:34:53.577 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-21T03:34:53.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-21T03:34:53.579 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-21T03:34:53.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-21T03:34:53.581 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-21T03:34:53.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-21T03:34:53.583 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-21T03:34:53.584 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-21T03:34:53.585 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-21T03:34:53.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-21T03:34:53.587 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-21T03:34:53.588 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-21T03:34:53.589 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-21T03:34:53.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-21T03:34:53.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-21T03:34:53.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-21T03:34:53.593 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-21T03:34:53.594 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-21T03:34:53.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-21T03:34:53.596 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-21T03:34:53.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-21T03:34:53.598 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-21T03:34:53.599 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-21T03:34:53.600 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-21T03:34:53.601 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-21T03:34:53.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-21T03:34:53.603 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-21T03:34:53.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-21T03:34:53.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-21T03:34:53.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-21T03:34:53.607 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-21T03:34:53.608 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-21T03:34:53.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-21T03:34:53.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-21T03:34:53.611 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-21T03:34:53.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-21T03:34:53.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-21T03:34:53.614 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-21T03:34:53.615 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-21T03:34:53.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-21T03:34:53.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-21T03:34:53.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-21T03:34:53.619 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-21T03:34:53.620 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-21T03:34:53.621 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-21T03:34:53.622 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-21T03:34:53.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-21T03:34:53.624 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-21T03:34:53.625 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-21T03:34:53.626 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-21T03:34:53.627 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-21T03:34:53.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-21T03:34:53.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-21T03:34:53.630 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-21T03:34:53.632 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-21T03:34:53.633 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-21T03:34:53.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-21T03:34:53.635 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-21T03:34:53.636 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-21T03:34:53.637 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-21T03:34:53.638 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-21T03:34:53.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-21T03:34:53.640 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-21T03:34:53.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-21T03:34:53.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-21T03:34:53.643 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-21T03:34:53.644 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-21T03:34:53.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-21T03:34:53.646 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-21T03:34:53.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-21T03:34:53.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-21T03:34:53.649 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-21T03:34:53.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-21T03:34:53.652 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-21T03:34:53.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-21T03:34:53.654 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-21T03:34:53.655 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-21T03:34:53.656 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-21T03:34:53.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-21T03:34:53.658 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-21T03:34:53.660 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-21T03:34:53.661 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-21T03:34:53.662 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-21T03:34:53.663 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-21T03:34:53.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-21T03:34:53.665 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-21T03:34:53.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-21T03:34:53.667 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-21T03:34:53.668 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-21T03:34:53.669 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-21T03:34:53.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-21T03:34:53.671 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-21T03:34:53.672 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-21T03:34:53.673 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-21T03:34:53.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-21T03:34:53.675 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-21T03:34:53.677 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-21T03:34:53.678 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-21T03:34:53.679 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-21T03:34:53.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-21T03:34:53.681 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-21T03:34:53.682 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-21T03:34:53.683 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-21T03:34:53.684 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-21T03:34:53.685 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-21T03:34:53.686 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-21T03:34:53.687 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-21T03:34:53.688 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-21T03:34:53.689 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-21T03:34:53.690 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-21T03:34:53.691 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-21T03:34:53.692 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-21T03:34:53.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-21T03:34:53.694 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-21T03:34:53.695 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-21T03:34:53.697 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-21T03:34:53.697 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-21T03:34:53.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-21T03:34:53.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-21T03:34:53.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-21T03:34:53.701 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-21T03:34:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:53 smithi102 ceph-mon[31392]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:34:53.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-21T03:34:53.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-21T03:34:53.704 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-21T03:34:53.705 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-21T03:34:53.706 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-21T03:34:53.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-21T03:34:53.708 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-21T03:34:53.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-21T03:34:53.710 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-21T03:34:53.711 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-21T03:34:53.712 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-21T03:34:53.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-21T03:34:53.714 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-21T03:34:53.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-21T03:34:53.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-21T03:34:53.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-21T03:34:53.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-21T03:34:53.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-21T03:34:53.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-21T03:34:53.721 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-21T03:34:53.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-21T03:34:53.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-21T03:34:53.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-21T03:34:53.725 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-21T03:34:53.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-21T03:34:53.727 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-21T03:34:53.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-21T03:34:53.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-21T03:34:53.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-21T03:34:53.732 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-21T03:34:53.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-21T03:34:53.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-21T03:34:53.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:53 smithi148 ceph-mon[34651]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:34:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:53 smithi121 ceph-mon[34316]: pgmap v363: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:34:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:55 smithi102 ceph-mon[31392]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:55 smithi148 ceph-mon[34651]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:55 smithi121 ceph-mon[34316]: pgmap v364: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T03:34:56.032 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-21T03:34:56.034 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-21T03:34:56.035 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-21T03:34:56.036 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-21T03:34:56.037 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-21T03:34:56.038 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-21T03:34:56.039 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-21T03:34:56.040 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-21T03:34:56.041 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-21T03:34:56.042 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-21T03:34:56.043 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-21T03:34:56.044 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-21T03:34:56.045 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-21T03:34:56.046 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-21T03:34:56.047 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-21T03:34:56.048 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-21T03:34:56.049 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-21T03:34:56.050 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-21T03:34:56.051 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-21T03:34:56.052 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-21T03:34:56.053 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-21T03:34:56.054 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-21T03:34:56.055 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-21T03:34:56.056 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-21T03:34:56.057 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-21T03:34:56.058 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-21T03:34:56.059 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-21T03:34:56.060 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-21T03:34:56.061 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-21T03:34:56.062 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-21T03:34:56.063 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-21T03:34:56.064 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-21T03:34:56.065 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-21T03:34:56.066 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-21T03:34:56.067 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-21T03:34:56.068 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-21T03:34:56.069 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-21T03:34:56.070 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-21T03:34:56.071 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-21T03:34:56.072 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-21T03:34:56.074 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-21T03:34:56.074 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-21T03:34:56.075 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-21T03:34:56.077 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-21T03:34:56.078 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-21T03:34:56.078 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-21T03:34:56.079 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-21T03:34:56.080 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-21T03:34:56.081 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-21T03:34:56.082 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-21T03:34:56.083 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-21T03:34:56.084 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-21T03:34:56.085 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-21T03:34:56.086 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-21T03:34:56.087 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-21T03:34:56.088 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-21T03:34:56.089 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-21T03:34:56.090 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-21T03:34:56.092 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-21T03:34:56.093 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-21T03:34:56.094 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-21T03:34:56.095 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-21T03:34:56.096 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-21T03:34:56.097 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/Changes 2024-09-21T03:34:56.098 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-21T03:34:56.099 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-21T03:34:56.100 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-21T03:34:56.101 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-21T03:34:56.102 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-21T03:34:56.103 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-21T03:34:56.104 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-21T03:34:56.105 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-21T03:34:56.106 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-21T03:34:56.107 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-21T03:34:56.108 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-21T03:34:56.109 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-21T03:34:56.110 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-21T03:34:56.111 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-21T03:34:56.112 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-21T03:34:56.113 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-21T03:34:56.115 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-21T03:34:56.116 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-21T03:34:56.117 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-21T03:34:56.118 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-21T03:34:56.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-21T03:34:56.120 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-21T03:34:56.121 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-21T03:34:56.122 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-21T03:34:56.123 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-21T03:34:56.124 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-21T03:34:56.125 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-21T03:34:56.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-21T03:34:56.127 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-21T03:34:56.128 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-21T03:34:56.129 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-21T03:34:56.130 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-21T03:34:56.131 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-21T03:34:56.132 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-21T03:34:56.133 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-21T03:34:56.134 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-21T03:34:56.135 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-21T03:34:56.136 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-21T03:34:56.137 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-21T03:34:56.138 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-21T03:34:56.139 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-21T03:34:56.140 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-21T03:34:56.141 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-21T03:34:56.142 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-21T03:34:56.143 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-21T03:34:56.144 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-21T03:34:56.145 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-21T03:34:56.147 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-21T03:34:56.149 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-21T03:34:56.149 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-21T03:34:56.150 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-21T03:34:56.151 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-21T03:34:56.152 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-21T03:34:56.153 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-21T03:34:56.154 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-21T03:34:56.155 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-21T03:34:56.156 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-21T03:34:56.157 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-21T03:34:56.158 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-21T03:34:56.161 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-21T03:34:56.162 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-21T03:34:56.163 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-21T03:34:56.164 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-21T03:34:56.165 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-21T03:34:56.166 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-21T03:34:56.167 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-21T03:34:56.167 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-21T03:34:56.168 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-21T03:34:56.169 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-21T03:34:56.170 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-21T03:34:56.171 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-21T03:34:56.172 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-21T03:34:56.173 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-21T03:34:56.174 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-21T03:34:56.175 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-21T03:34:56.176 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-21T03:34:56.177 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-21T03:34:56.178 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-21T03:34:56.180 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-21T03:34:56.180 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-21T03:34:56.182 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-21T03:34:56.183 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-21T03:34:56.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-21T03:34:56.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-21T03:34:56.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-21T03:34:56.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-21T03:34:56.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-21T03:34:56.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-21T03:34:56.189 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-21T03:34:56.190 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-21T03:34:56.191 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-21T03:34:56.192 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-21T03:34:56.193 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-21T03:34:56.193 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-21T03:34:56.194 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-21T03:34:56.195 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-21T03:34:56.196 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-21T03:34:56.197 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-21T03:34:56.198 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-21T03:34:56.199 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-21T03:34:56.200 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-21T03:34:56.201 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-21T03:34:56.202 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-21T03:34:56.203 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-21T03:34:56.204 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-21T03:34:56.205 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-21T03:34:56.206 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-21T03:34:56.207 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-21T03:34:56.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-21T03:34:56.209 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-21T03:34:56.210 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-21T03:34:56.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-21T03:34:56.212 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-21T03:34:56.213 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-21T03:34:56.214 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-21T03:34:56.215 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-21T03:34:56.216 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-21T03:34:56.217 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-21T03:34:56.218 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-21T03:34:56.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-21T03:34:56.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-21T03:34:56.220 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-21T03:34:56.221 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-21T03:34:56.222 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-21T03:34:56.223 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-21T03:34:56.224 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-21T03:34:56.225 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-21T03:34:56.226 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-21T03:34:56.227 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-21T03:34:56.227 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-21T03:34:56.228 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-21T03:34:56.229 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-21T03:34:56.230 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-21T03:34:56.231 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-21T03:34:56.232 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-21T03:34:56.233 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-21T03:34:56.233 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-21T03:34:56.235 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-21T03:34:56.235 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-21T03:34:56.236 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-21T03:34:56.237 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-21T03:34:56.238 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-21T03:34:56.239 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-21T03:34:56.240 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-21T03:34:56.241 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-21T03:34:56.242 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-21T03:34:56.243 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-21T03:34:56.243 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-21T03:34:56.244 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-21T03:34:56.245 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-21T03:34:56.246 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-21T03:34:56.247 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-21T03:34:56.248 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-21T03:34:56.249 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-21T03:34:56.250 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-21T03:34:56.251 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-21T03:34:56.252 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-21T03:34:56.253 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-21T03:34:56.254 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-21T03:34:56.255 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-21T03:34:56.256 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-21T03:34:56.257 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-21T03:34:56.258 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-21T03:34:56.259 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-21T03:34:56.260 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-21T03:34:56.261 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-21T03:34:56.262 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-21T03:34:56.263 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-21T03:34:56.264 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-21T03:34:56.265 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-21T03:34:56.266 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-21T03:34:56.267 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-21T03:34:56.268 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-21T03:34:56.269 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-21T03:34:56.270 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-21T03:34:56.271 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-21T03:34:56.272 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-21T03:34:56.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-21T03:34:56.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-21T03:34:56.274 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-21T03:34:56.275 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-21T03:34:56.276 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-21T03:34:56.277 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-21T03:34:56.278 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-21T03:34:56.279 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-21T03:34:56.280 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-21T03:34:56.281 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-21T03:34:56.282 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-21T03:34:56.283 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-21T03:34:56.284 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-21T03:34:56.285 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-21T03:34:56.286 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-21T03:34:56.287 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-21T03:34:56.288 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-21T03:34:56.289 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-21T03:34:56.290 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-21T03:34:56.291 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-21T03:34:56.292 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-21T03:34:56.293 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-21T03:34:56.294 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-21T03:34:56.295 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-21T03:34:56.295 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-21T03:34:56.296 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-21T03:34:56.297 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-21T03:34:56.298 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-21T03:34:56.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-21T03:34:56.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-21T03:34:56.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-21T03:34:56.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-21T03:34:56.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-21T03:34:56.721 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-21T03:34:56.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-21T03:34:56.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-21T03:34:56.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-21T03:34:56.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-21T03:34:56.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-21T03:34:56.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-21T03:34:56.727 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-21T03:34:56.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-21T03:34:56.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-21T03:34:56.730 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-21T03:34:56.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-21T03:34:56.732 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-21T03:34:56.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-21T03:34:56.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-21T03:34:56.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-21T03:34:56.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-21T03:34:56.736 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-21T03:34:56.737 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-21T03:34:56.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-21T03:34:56.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-21T03:34:56.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-21T03:34:56.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-21T03:34:56.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-21T03:34:56.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-21T03:34:56.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-21T03:34:56.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-21T03:34:56.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-21T03:34:56.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-21T03:34:56.749 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-21T03:34:56.750 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-21T03:34:56.751 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-21T03:34:56.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-21T03:34:56.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-21T03:34:56.753 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-21T03:34:56.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-21T03:34:56.755 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-21T03:34:56.756 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-21T03:34:56.757 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-21T03:34:56.757 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-21T03:34:56.758 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-21T03:34:56.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-21T03:34:56.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-21T03:34:56.761 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-21T03:34:56.762 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-21T03:34:56.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-21T03:34:56.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/Makefile 2024-09-21T03:34:56.764 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-21T03:34:56.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-21T03:34:56.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-21T03:34:56.767 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-21T03:34:56.768 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-21T03:34:56.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-21T03:34:56.770 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-21T03:34:56.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-21T03:34:56.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-21T03:34:56.773 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-21T03:34:56.774 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-21T03:34:56.775 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-21T03:34:56.776 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-21T03:34:56.777 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-21T03:34:56.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-21T03:34:56.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-21T03:34:56.780 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-21T03:34:56.781 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-21T03:34:56.782 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-21T03:34:56.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-21T03:34:56.784 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-21T03:34:56.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-21T03:34:56.786 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-21T03:34:56.787 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-21T03:34:56.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-21T03:34:56.790 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-21T03:34:56.790 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-21T03:34:56.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-21T03:34:56.792 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-21T03:34:56.793 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-21T03:34:56.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-21T03:34:56.795 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-21T03:34:56.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-21T03:34:56.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-21T03:34:56.798 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-21T03:34:56.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-21T03:34:56.800 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-21T03:34:56.801 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-21T03:34:56.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-21T03:34:56.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-21T03:34:56.804 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-21T03:34:56.805 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-21T03:34:56.806 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-21T03:34:56.807 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-21T03:34:56.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-21T03:34:56.809 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-21T03:34:56.809 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-21T03:34:56.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-21T03:34:56.811 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-21T03:34:56.812 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-21T03:34:56.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-21T03:34:56.814 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-21T03:34:56.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-21T03:34:56.816 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-21T03:34:56.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-21T03:34:56.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-21T03:34:56.818 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-21T03:34:56.819 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-21T03:34:56.820 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-21T03:34:56.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-21T03:34:56.822 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-21T03:34:56.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-21T03:34:56.824 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-21T03:34:56.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-21T03:34:56.826 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-21T03:34:56.827 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/ 2024-09-21T03:34:56.828 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-21T03:34:56.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-21T03:34:56.830 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-21T03:34:56.830 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-21T03:34:56.831 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-21T03:34:56.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-21T03:34:56.833 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-21T03:34:56.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-21T03:34:56.835 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-21T03:34:56.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-21T03:34:56.837 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-21T03:34:56.838 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-21T03:34:56.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-21T03:34:56.840 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-21T03:34:56.841 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-21T03:34:56.842 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/README 2024-09-21T03:34:56.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-21T03:34:56.844 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-21T03:34:56.845 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-21T03:34:56.846 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-21T03:34:56.847 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-21T03:34:56.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-21T03:34:56.849 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-21T03:34:56.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-21T03:34:56.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-21T03:34:56.852 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-21T03:34:56.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-21T03:34:56.854 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-21T03:34:56.855 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-21T03:34:56.856 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-21T03:34:56.857 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-21T03:34:56.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-21T03:34:56.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-21T03:34:56.860 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-21T03:34:56.861 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-21T03:34:56.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-21T03:34:56.863 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-21T03:34:56.864 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-21T03:34:56.865 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-21T03:34:56.866 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-21T03:34:56.867 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-21T03:34:56.868 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-21T03:34:56.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-21T03:34:56.870 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-21T03:34:56.871 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-21T03:34:56.872 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-21T03:34:56.873 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-21T03:34:56.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-21T03:34:56.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-21T03:34:56.875 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-21T03:34:56.876 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-21T03:34:56.877 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-21T03:34:56.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-21T03:34:56.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-21T03:34:56.880 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-21T03:34:56.881 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-21T03:34:56.882 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-21T03:34:56.883 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-21T03:34:56.884 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-21T03:34:56.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-21T03:34:56.886 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-21T03:34:56.887 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-21T03:34:56.888 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-21T03:34:56.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-21T03:34:56.890 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-21T03:34:56.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-21T03:34:56.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-21T03:34:56.892 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-21T03:34:56.893 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-21T03:34:56.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-21T03:34:56.895 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-21T03:34:56.896 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-21T03:34:56.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-21T03:34:56.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-21T03:34:56.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-21T03:34:56.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-21T03:34:56.899 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-21T03:34:56.900 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-21T03:34:56.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-21T03:34:56.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-21T03:34:56.902 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-21T03:34:56.903 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-21T03:34:56.904 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-21T03:34:56.905 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-21T03:34:56.905 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-21T03:34:56.906 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-21T03:34:56.907 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-21T03:34:56.908 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-21T03:34:56.909 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-21T03:34:56.910 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-21T03:34:56.911 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-21T03:34:56.911 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-21T03:34:56.912 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-21T03:34:56.913 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-21T03:34:56.914 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-21T03:34:56.915 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-21T03:34:56.916 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-21T03:34:56.917 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-21T03:34:56.918 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-21T03:34:56.919 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-21T03:34:56.919 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-21T03:34:56.920 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-21T03:34:56.921 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-21T03:34:56.922 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-21T03:34:56.923 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-21T03:34:56.924 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-21T03:34:56.925 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-21T03:34:56.926 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-21T03:34:56.927 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-21T03:34:56.928 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-21T03:34:56.929 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-21T03:34:56.930 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-21T03:34:56.931 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-21T03:34:56.932 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-21T03:34:56.933 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-21T03:34:56.934 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/ 2024-09-21T03:34:56.935 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-21T03:34:56.936 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-21T03:34:56.937 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-21T03:34:56.938 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-21T03:34:56.939 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-21T03:34:56.940 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-21T03:34:56.941 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-21T03:34:56.941 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-21T03:34:56.942 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-21T03:34:56.943 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-21T03:34:56.944 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-21T03:34:56.945 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-21T03:34:56.947 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-21T03:34:56.947 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-21T03:34:56.948 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-21T03:34:56.949 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-21T03:34:56.950 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-21T03:34:56.951 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-21T03:34:56.952 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-21T03:34:56.953 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-21T03:34:56.954 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-21T03:34:56.955 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-21T03:34:56.956 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-21T03:34:56.957 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-21T03:34:56.958 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-21T03:34:56.959 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-21T03:34:56.960 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-21T03:34:56.961 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-21T03:34:56.962 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-21T03:34:56.963 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-21T03:34:56.964 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-21T03:34:56.965 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-21T03:34:56.966 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-21T03:34:56.968 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-21T03:34:56.968 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-21T03:34:56.969 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-21T03:34:56.970 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-21T03:34:56.971 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-21T03:34:56.972 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-21T03:34:56.973 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-21T03:34:56.974 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-21T03:34:56.975 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-21T03:34:56.976 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-21T03:34:56.977 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-21T03:34:56.978 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-21T03:34:56.979 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-21T03:34:56.980 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-21T03:34:56.981 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-21T03:34:56.982 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-21T03:34:56.983 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-21T03:34:56.984 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-21T03:34:56.985 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-21T03:34:56.986 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-21T03:34:56.987 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-21T03:34:56.988 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-21T03:34:56.989 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-21T03:34:56.989 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-21T03:34:56.990 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-21T03:34:56.991 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-21T03:34:56.992 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-21T03:34:56.993 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-21T03:34:56.994 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-21T03:34:56.995 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-21T03:34:56.996 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-21T03:34:56.997 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-21T03:34:56.998 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/ 2024-09-21T03:34:56.999 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-21T03:34:57.000 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-21T03:34:57.001 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-21T03:34:57.002 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-21T03:34:57.003 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-21T03:34:57.004 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/console/ 2024-09-21T03:34:57.005 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-21T03:34:57.006 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-21T03:34:57.007 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-21T03:34:57.008 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-21T03:34:57.009 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-21T03:34:57.010 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-21T03:34:57.011 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-21T03:34:57.012 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-21T03:34:57.013 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-21T03:34:57.014 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-21T03:34:57.015 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-21T03:34:57.016 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-21T03:34:57.017 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-21T03:34:57.018 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-21T03:34:57.019 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-21T03:34:57.020 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-21T03:34:57.022 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-21T03:34:57.022 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-21T03:34:57.023 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-21T03:34:57.024 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-21T03:34:57.025 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-21T03:34:57.026 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-21T03:34:57.027 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cris/ 2024-09-21T03:34:57.028 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/cris/README 2024-09-21T03:34:57.028 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-21T03:34:57.029 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-21T03:34:57.030 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-21T03:34:57.031 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-21T03:34:57.032 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-21T03:34:57.033 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-21T03:34:57.034 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-21T03:34:57.035 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-21T03:34:57.036 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-21T03:34:57.037 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-21T03:34:57.038 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-21T03:34:57.039 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-21T03:34:57.040 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-21T03:34:57.041 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-21T03:34:57.042 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-21T03:34:57.043 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-21T03:34:57.044 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-21T03:34:57.045 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-21T03:34:57.046 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-21T03:34:57.047 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-21T03:34:57.048 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-21T03:34:57.049 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-21T03:34:57.049 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-21T03:34:57.050 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-21T03:34:57.051 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-21T03:34:57.052 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-21T03:34:57.053 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-21T03:34:57.054 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-21T03:34:57.055 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-21T03:34:57.056 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-21T03:34:57.057 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-21T03:34:57.058 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-21T03:34:57.059 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-21T03:34:57.060 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-21T03:34:57.061 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-21T03:34:57.062 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-21T03:34:57.063 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-21T03:34:57.064 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-21T03:34:57.065 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-21T03:34:57.066 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-21T03:34:57.067 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-21T03:34:57.068 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-21T03:34:57.069 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-21T03:34:57.071 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-21T03:34:57.072 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-21T03:34:57.073 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-21T03:34:57.074 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-21T03:34:57.075 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-21T03:34:57.076 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-21T03:34:57.077 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-21T03:34:57.078 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-21T03:34:57.078 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-21T03:34:57.079 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-21T03:34:57.080 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-21T03:34:57.081 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-21T03:34:57.082 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-21T03:34:57.083 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-21T03:34:57.084 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-21T03:34:57.085 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-21T03:34:57.086 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-21T03:34:57.087 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-21T03:34:57.088 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-21T03:34:57.089 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-21T03:34:57.090 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-21T03:34:57.091 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-21T03:34:57.092 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-21T03:34:57.093 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-21T03:34:57.094 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-21T03:34:57.095 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-21T03:34:57.096 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-21T03:34:57.097 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-21T03:34:57.098 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-21T03:34:57.099 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-21T03:34:57.102 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-21T03:34:57.102 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-21T03:34:57.102 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-21T03:34:57.103 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-21T03:34:57.104 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-21T03:34:57.105 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-21T03:34:57.106 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-21T03:34:57.107 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-21T03:34:57.108 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-21T03:34:57.109 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-21T03:34:57.110 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-21T03:34:57.111 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-21T03:34:57.112 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-21T03:34:57.113 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-21T03:34:57.114 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-21T03:34:57.115 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-21T03:34:57.116 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-21T03:34:57.117 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-21T03:34:57.118 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-21T03:34:57.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-21T03:34:57.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-21T03:34:57.120 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-21T03:34:57.121 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-21T03:34:57.122 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-21T03:34:57.123 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-21T03:34:57.124 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-21T03:34:57.125 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-21T03:34:57.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-21T03:34:57.127 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-21T03:34:57.128 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-21T03:34:57.129 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-21T03:34:57.130 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-21T03:34:57.131 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-21T03:34:57.132 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-21T03:34:57.133 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-21T03:34:57.134 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-21T03:34:57.135 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-21T03:34:57.136 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-21T03:34:57.137 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-21T03:34:57.138 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-21T03:34:57.139 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-21T03:34:57.140 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-21T03:34:57.141 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-21T03:34:57.142 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-21T03:34:57.143 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-21T03:34:57.144 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-21T03:34:57.145 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-21T03:34:57.146 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-21T03:34:57.147 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-21T03:34:57.148 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-21T03:34:57.149 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-21T03:34:57.150 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-21T03:34:57.151 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-21T03:34:57.152 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-21T03:34:57.153 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-21T03:34:57.154 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-21T03:34:57.155 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-21T03:34:57.157 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-21T03:34:57.157 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-21T03:34:57.158 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-21T03:34:57.159 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-21T03:34:57.160 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-21T03:34:57.161 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-21T03:34:57.163 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-21T03:34:57.163 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-21T03:34:57.164 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-21T03:34:57.165 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-21T03:34:57.166 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-21T03:34:57.167 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-21T03:34:57.168 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-21T03:34:57.169 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-21T03:34:57.170 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-21T03:34:57.171 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-21T03:34:57.172 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-21T03:34:57.173 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-21T03:34:57.174 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-21T03:34:57.175 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-21T03:34:57.176 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-21T03:34:57.177 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-21T03:34:57.178 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-21T03:34:57.179 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-21T03:34:57.180 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-21T03:34:57.181 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-21T03:34:57.182 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-21T03:34:57.183 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-21T03:34:57.183 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-21T03:34:57.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-21T03:34:57.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-21T03:34:57.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-21T03:34:57.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-21T03:34:57.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-21T03:34:57.189 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-21T03:34:57.190 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-21T03:34:57.191 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-21T03:34:57.192 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-21T03:34:57.193 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-21T03:34:57.195 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-21T03:34:57.195 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-21T03:34:57.196 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-21T03:34:57.197 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-21T03:34:57.198 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-21T03:34:57.199 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-21T03:34:57.200 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-21T03:34:57.201 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-21T03:34:57.202 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-21T03:34:57.203 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-21T03:34:57.204 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-21T03:34:57.205 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-21T03:34:57.206 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-21T03:34:57.207 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-21T03:34:57.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-21T03:34:57.209 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-21T03:34:57.210 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-21T03:34:57.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-21T03:34:57.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-21T03:34:57.212 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-21T03:34:57.213 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-21T03:34:57.214 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-21T03:34:57.215 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-21T03:34:57.216 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-21T03:34:57.217 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-21T03:34:57.218 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-21T03:34:57.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-21T03:34:57.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-21T03:34:57.221 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-21T03:34:57.221 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-21T03:34:57.222 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-21T03:34:57.223 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-21T03:34:57.224 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-21T03:34:57.416 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-21T03:34:57.417 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-21T03:34:57.418 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-21T03:34:57.419 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-21T03:34:57.420 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-21T03:34:57.421 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-21T03:34:57.422 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-21T03:34:57.423 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-21T03:34:57.424 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-21T03:34:57.425 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-21T03:34:57.426 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-21T03:34:57.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-21T03:34:57.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-21T03:34:57.429 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-21T03:34:57.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-21T03:34:57.431 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-21T03:34:57.432 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-21T03:34:57.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-21T03:34:57.434 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-21T03:34:57.435 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-21T03:34:57.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-21T03:34:57.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-21T03:34:57.438 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-21T03:34:57.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-21T03:34:57.440 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-21T03:34:57.441 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-21T03:34:57.442 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-21T03:34:57.443 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-21T03:34:57.444 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-21T03:34:57.445 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-21T03:34:57.446 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-21T03:34:57.447 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-21T03:34:57.448 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-21T03:34:57.449 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-21T03:34:57.450 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-21T03:34:57.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-21T03:34:57.452 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-21T03:34:57.453 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-21T03:34:57.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-21T03:34:57.455 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-21T03:34:57.456 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-21T03:34:57.457 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-21T03:34:57.458 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-21T03:34:57.459 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-21T03:34:57.460 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-21T03:34:57.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-21T03:34:57.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-21T03:34:57.462 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-21T03:34:57.463 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-21T03:34:57.464 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-21T03:34:57.465 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-21T03:34:57.466 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-21T03:34:57.467 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-21T03:34:57.468 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-21T03:34:57.469 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-21T03:34:57.470 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-21T03:34:57.471 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-21T03:34:57.472 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-21T03:34:57.473 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-21T03:34:57.474 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-21T03:34:57.475 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-21T03:34:57.476 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-21T03:34:57.477 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-21T03:34:57.478 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-21T03:34:57.479 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-21T03:34:57.480 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-21T03:34:57.481 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-21T03:34:57.482 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-21T03:34:57.483 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-21T03:34:57.484 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-21T03:34:57.485 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-21T03:34:57.486 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-21T03:34:57.487 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-21T03:34:57.488 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-21T03:34:57.489 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-21T03:34:57.490 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-21T03:34:57.491 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-21T03:34:57.492 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-21T03:34:57.493 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-21T03:34:57.494 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-21T03:34:57.495 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-21T03:34:57.496 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-21T03:34:57.497 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-21T03:34:57.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-21T03:34:57.499 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-21T03:34:57.500 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-21T03:34:57.501 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-21T03:34:57.502 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-21T03:34:57.502 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-21T03:34:57.503 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-21T03:34:57.504 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-21T03:34:57.505 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-21T03:34:57.506 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-21T03:34:57.507 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-21T03:34:57.508 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-21T03:34:57.509 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-21T03:34:57.510 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-21T03:34:57.511 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-21T03:34:57.514 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-21T03:34:57.514 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-21T03:34:57.514 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-21T03:34:57.515 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-21T03:34:57.516 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-21T03:34:57.517 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-21T03:34:57.518 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-21T03:34:57.519 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-21T03:34:57.520 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-21T03:34:57.521 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-21T03:34:57.522 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-21T03:34:57.523 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-21T03:34:57.524 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-21T03:34:57.525 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-21T03:34:57.526 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-21T03:34:57.527 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-21T03:34:57.528 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-21T03:34:57.529 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-21T03:34:57.530 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-21T03:34:57.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-21T03:34:57.532 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-21T03:34:57.533 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-21T03:34:57.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-21T03:34:57.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-21T03:34:57.536 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-21T03:34:57.537 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-21T03:34:57.539 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-21T03:34:57.540 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-21T03:34:57.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-21T03:34:57.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-21T03:34:57.542 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-21T03:34:57.544 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-21T03:34:57.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-21T03:34:57.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-21T03:34:57.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-21T03:34:57.547 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-21T03:34:57.548 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-21T03:34:57.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-21T03:34:57.550 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-21T03:34:57.551 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-21T03:34:57.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-21T03:34:57.553 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-21T03:34:57.555 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-21T03:34:57.555 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-21T03:34:57.556 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-21T03:34:57.557 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-21T03:34:57.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-21T03:34:57.559 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-21T03:34:57.559 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-21T03:34:57.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-21T03:34:57.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-21T03:34:57.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-21T03:34:57.563 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-21T03:34:57.564 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-21T03:34:57.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-21T03:34:57.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-21T03:34:57.567 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-21T03:34:57.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-21T03:34:57.569 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-21T03:34:57.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-21T03:34:57.571 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-21T03:34:57.572 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-21T03:34:57.573 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-21T03:34:57.574 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-21T03:34:57.574 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-21T03:34:57.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-21T03:34:57.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-21T03:34:57.577 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-21T03:34:57.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-21T03:34:57.579 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-21T03:34:57.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-21T03:34:57.581 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-21T03:34:57.581 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-21T03:34:57.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-21T03:34:57.583 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-21T03:34:57.584 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-21T03:34:57.585 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-21T03:34:57.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-21T03:34:57.587 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-21T03:34:57.588 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-21T03:34:57.589 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-21T03:34:57.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-21T03:34:57.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-21T03:34:57.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-21T03:34:57.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-21T03:34:57.593 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-21T03:34:57.594 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-21T03:34:57.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-21T03:34:57.596 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-21T03:34:57.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-21T03:34:57.598 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-21T03:34:57.599 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-21T03:34:57.600 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-21T03:34:57.601 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-21T03:34:57.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-21T03:34:57.603 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-21T03:34:57.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-21T03:34:57.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-21T03:34:57.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-21T03:34:57.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-21T03:34:57.607 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-21T03:34:57.608 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-21T03:34:57.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-21T03:34:57.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-21T03:34:57.611 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-21T03:34:57.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-21T03:34:57.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-21T03:34:57.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-21T03:34:57.614 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-21T03:34:57.615 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-21T03:34:57.616 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-21T03:34:57.617 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-21T03:34:57.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-21T03:34:57.619 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-21T03:34:57.620 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-21T03:34:57.621 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-21T03:34:57.622 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-21T03:34:57.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-21T03:34:57.624 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-21T03:34:57.625 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-21T03:34:57.626 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-21T03:34:57.627 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-21T03:34:57.628 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-21T03:34:57.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-21T03:34:57.630 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-21T03:34:57.630 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-21T03:34:57.631 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-21T03:34:57.632 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-21T03:34:57.633 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-21T03:34:57.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-21T03:34:57.635 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-21T03:34:57.636 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-21T03:34:57.637 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-21T03:34:57.638 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-21T03:34:57.638 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-21T03:34:57.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-21T03:34:57.640 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-21T03:34:57.641 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-21T03:34:57.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-21T03:34:57.643 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-21T03:34:57.644 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-21T03:34:57.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-21T03:34:57.646 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-21T03:34:57.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-21T03:34:57.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-21T03:34:57.649 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-21T03:34:57.650 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-21T03:34:57.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-21T03:34:57.652 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-21T03:34:57.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-21T03:34:57.654 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-21T03:34:57.655 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-21T03:34:57.656 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-21T03:34:57.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-21T03:34:57.658 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-21T03:34:57.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-21T03:34:57.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-21T03:34:57.660 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-21T03:34:57.661 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-21T03:34:57.662 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-21T03:34:57.663 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-21T03:34:57.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-21T03:34:57.665 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-21T03:34:57.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-21T03:34:57.667 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-21T03:34:57.668 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-21T03:34:57.669 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-21T03:34:57.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-21T03:34:57.671 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-21T03:34:57.672 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-21T03:34:57.673 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-21T03:34:57.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-21T03:34:57.675 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-21T03:34:57.676 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-21T03:34:57.677 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-21T03:34:57.678 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-21T03:34:57.679 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-21T03:34:57.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-21T03:34:57.681 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-21T03:34:57.682 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-21T03:34:57.683 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-21T03:34:57.684 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-21T03:34:57.685 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-21T03:34:57.686 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-21T03:34:57.687 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-21T03:34:57.688 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-21T03:34:57.689 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-21T03:34:57.690 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-21T03:34:57.691 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-21T03:34:57.692 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-21T03:34:57.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-21T03:34:57.694 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-21T03:34:57.695 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-21T03:34:57.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-21T03:34:57.697 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-21T03:34:57.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-21T03:34:57.699 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-21T03:34:57.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-21T03:34:57.701 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-21T03:34:57.702 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-21T03:34:57.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:57 smithi102 ceph-mon[31392]: pgmap v365: 97 pgs: 97 active+clean; 5.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-09-21T03:34:57.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-21T03:34:57.704 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-21T03:34:57.705 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-21T03:34:57.706 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-21T03:34:57.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-21T03:34:57.708 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-21T03:34:57.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-21T03:34:57.710 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-21T03:34:57.711 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-21T03:34:57.712 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-21T03:34:57.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-21T03:34:57.714 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-21T03:34:57.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-21T03:34:57.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-21T03:34:57.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-21T03:34:57.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-21T03:34:57.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-21T03:34:57.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-21T03:34:57.721 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-21T03:34:57.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-21T03:34:57.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-21T03:34:57.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-21T03:34:57.725 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-21T03:34:57.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-21T03:34:57.727 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-21T03:34:57.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-21T03:34:57.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-21T03:34:57.730 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-21T03:34:57.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-21T03:34:57.732 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-21T03:34:57.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-21T03:34:57.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-21T03:34:57.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-21T03:34:57.736 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-21T03:34:57.737 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-21T03:34:57.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-21T03:34:57.739 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-21T03:34:57.740 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-21T03:34:57.741 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-21T03:34:57.742 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-21T03:34:57.743 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-21T03:34:57.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:57 smithi148 ceph-mon[34651]: pgmap v365: 97 pgs: 97 active+clean; 5.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-09-21T03:34:57.744 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-21T03:34:57.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-21T03:34:57.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-21T03:34:57.746 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-21T03:34:57.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-21T03:34:57.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-21T03:34:57.749 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-21T03:34:57.750 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-21T03:34:57.751 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-21T03:34:57.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-21T03:34:57.753 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-21T03:34:57.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-21T03:34:57.755 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-21T03:34:57.756 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-21T03:34:57.757 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-21T03:34:57.758 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-21T03:34:57.758 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-21T03:34:57.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-21T03:34:57.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-21T03:34:57.761 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-21T03:34:57.762 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-21T03:34:57.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-21T03:34:57.764 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-21T03:34:57.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-21T03:34:57.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-21T03:34:57.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-21T03:34:57.767 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-21T03:34:57.768 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-21T03:34:57.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-21T03:34:57.770 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-21T03:34:57.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-21T03:34:57.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-21T03:34:57.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-21T03:34:57.773 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-21T03:34:57.774 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-21T03:34:57.775 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-21T03:34:57.776 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-21T03:34:57.777 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-21T03:34:57.777 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-21T03:34:57.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-21T03:34:57.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-21T03:34:57.780 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-21T03:34:57.781 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-21T03:34:57.782 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-21T03:34:57.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-21T03:34:57.784 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-21T03:34:57.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-21T03:34:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:57 smithi121 ceph-mon[34316]: pgmap v365: 97 pgs: 97 active+clean; 5.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 349 KiB/s wr, 9 op/s 2024-09-21T03:34:57.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-21T03:34:57.786 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-21T03:34:57.787 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-21T03:34:57.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-21T03:34:57.789 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-21T03:34:57.790 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-21T03:34:57.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-21T03:34:57.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-21T03:34:57.792 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-21T03:34:57.793 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-21T03:34:57.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-21T03:34:57.795 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-21T03:34:57.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-21T03:34:57.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-21T03:34:57.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-21T03:34:57.798 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-21T03:34:57.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-21T03:34:57.800 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-21T03:34:57.801 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-21T03:34:57.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-21T03:34:57.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-21T03:34:57.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-21T03:34:57.804 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-21T03:34:57.805 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-21T03:34:57.806 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-21T03:34:57.807 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-21T03:34:57.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-21T03:34:57.809 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-21T03:34:57.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-21T03:34:57.811 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-21T03:34:57.812 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-21T03:34:57.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-21T03:34:57.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-21T03:34:57.814 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-21T03:34:57.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-21T03:34:57.816 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-21T03:34:57.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-21T03:34:57.818 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-21T03:34:57.819 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-21T03:34:57.820 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-21T03:34:57.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-21T03:34:57.822 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-21T03:34:57.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-21T03:34:57.824 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-21T03:34:57.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-21T03:34:57.826 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-21T03:34:57.827 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-21T03:34:57.828 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-21T03:34:57.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-21T03:34:57.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-21T03:34:57.830 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-21T03:34:57.831 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-21T03:34:57.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-21T03:34:57.833 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-21T03:34:57.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-21T03:34:57.835 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-21T03:34:57.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-21T03:34:57.837 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-21T03:34:57.838 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-21T03:34:57.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-21T03:34:57.840 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-21T03:34:57.841 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-21T03:34:57.842 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-21T03:34:57.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-21T03:34:57.844 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-21T03:34:57.845 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-21T03:34:57.846 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-21T03:34:57.847 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-21T03:34:57.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-21T03:34:57.849 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-21T03:34:57.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-21T03:34:57.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-21T03:34:57.852 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-21T03:34:57.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-21T03:34:57.854 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-21T03:34:57.855 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-21T03:34:57.856 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-21T03:34:57.857 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-21T03:34:57.858 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-21T03:34:57.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-21T03:34:57.860 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-21T03:34:57.861 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-21T03:34:57.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-21T03:34:57.863 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-21T03:34:57.864 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-21T03:34:57.865 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-21T03:34:57.866 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-21T03:34:57.867 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-21T03:34:57.868 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-21T03:34:57.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-21T03:34:57.870 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-21T03:34:57.871 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-21T03:34:57.872 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-21T03:34:57.873 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-21T03:34:57.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-21T03:34:57.875 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-21T03:34:57.876 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-21T03:34:57.877 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-21T03:34:57.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-21T03:34:57.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-21T03:34:57.880 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-21T03:34:57.881 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-21T03:34:57.882 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-21T03:34:57.883 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-21T03:34:57.884 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-21T03:34:57.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-21T03:34:57.886 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-21T03:34:57.887 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-21T03:34:57.888 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-21T03:34:57.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-21T03:34:57.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-21T03:34:57.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-21T03:34:57.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-21T03:34:57.892 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-21T03:34:57.893 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-21T03:34:57.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-21T03:34:58.087 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-21T03:34:58.088 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-21T03:34:58.089 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-21T03:34:58.090 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-21T03:34:58.091 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-21T03:34:58.093 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-21T03:34:58.094 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-21T03:34:58.095 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-21T03:34:58.096 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-21T03:34:58.097 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-21T03:34:58.098 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-21T03:34:58.099 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-21T03:34:58.100 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-21T03:34:58.101 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-21T03:34:58.102 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-21T03:34:58.103 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-21T03:34:58.104 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-21T03:34:58.105 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-21T03:34:58.106 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-21T03:34:58.107 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-21T03:34:58.108 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-21T03:34:58.109 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-21T03:34:58.110 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-21T03:34:58.111 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-21T03:34:58.112 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-21T03:34:58.113 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-21T03:34:58.114 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-21T03:34:58.115 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-21T03:34:58.116 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-21T03:34:58.117 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-21T03:34:58.118 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-21T03:34:58.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-21T03:34:58.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-21T03:34:58.120 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-21T03:34:58.121 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-21T03:34:58.122 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-21T03:34:58.123 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-21T03:34:58.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-21T03:34:58.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-21T03:34:58.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-21T03:34:58.127 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-21T03:34:58.128 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-21T03:34:58.129 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-21T03:34:58.130 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-21T03:34:58.131 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-21T03:34:58.132 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-21T03:34:58.133 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-21T03:34:58.134 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-21T03:34:58.135 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-21T03:34:58.136 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-21T03:34:58.137 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-21T03:34:58.138 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-21T03:34:58.139 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-21T03:34:58.140 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-21T03:34:58.141 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-21T03:34:58.142 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-21T03:34:58.143 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-21T03:34:58.144 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-21T03:34:58.145 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-21T03:34:58.146 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-21T03:34:58.147 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-21T03:34:58.148 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-21T03:34:58.149 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-21T03:34:58.150 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-21T03:34:58.151 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-21T03:34:58.152 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-21T03:34:58.153 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-21T03:34:58.154 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-21T03:34:58.155 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-21T03:34:58.156 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-21T03:34:58.157 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-21T03:34:58.158 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-21T03:34:58.159 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-21T03:34:58.160 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-21T03:34:58.161 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-21T03:34:58.162 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-21T03:34:58.163 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-21T03:34:58.164 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-21T03:34:58.165 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-21T03:34:58.166 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-21T03:34:58.167 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-21T03:34:58.168 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-21T03:34:58.169 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-21T03:34:58.170 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-21T03:34:58.171 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-21T03:34:58.172 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-21T03:34:58.173 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-21T03:34:58.174 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-21T03:34:58.175 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-21T03:34:58.176 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-21T03:34:58.177 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-21T03:34:58.178 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-21T03:34:58.179 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-21T03:34:58.180 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-21T03:34:58.180 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-21T03:34:58.181 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-21T03:34:58.182 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-21T03:34:58.183 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-21T03:34:58.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-21T03:34:58.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-21T03:34:58.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-21T03:34:58.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-21T03:34:58.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-21T03:34:58.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-21T03:34:58.189 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-21T03:34:58.190 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-21T03:34:58.191 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-21T03:34:58.192 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-21T03:34:58.193 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-21T03:34:58.194 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-21T03:34:58.194 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-21T03:34:58.195 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-21T03:34:58.196 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-21T03:34:58.197 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-21T03:34:58.198 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-21T03:34:58.199 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-21T03:34:58.200 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-21T03:34:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-21T03:34:58.201 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-21T03:34:58.202 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-21T03:34:58.203 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-21T03:34:58.204 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-21T03:34:58.205 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-21T03:34:58.206 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-21T03:34:58.207 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-21T03:34:58.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-21T03:34:58.209 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-21T03:34:58.210 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-21T03:34:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-21T03:34:58.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-21T03:34:58.212 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-21T03:34:58.213 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-21T03:34:58.214 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-21T03:34:58.215 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-21T03:34:58.216 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-21T03:34:58.217 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-21T03:34:58.217 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-21T03:34:58.218 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-21T03:34:58.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-21T03:34:58.220 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-21T03:34:58.221 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-21T03:34:58.222 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-21T03:34:58.223 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-21T03:34:58.224 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-21T03:34:58.225 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-21T03:34:58.226 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-21T03:34:58.226 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-21T03:34:58.227 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-21T03:34:58.228 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-21T03:34:58.229 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-21T03:34:58.230 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-21T03:34:58.231 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-21T03:34:58.232 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-21T03:34:58.233 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-21T03:34:58.234 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-21T03:34:58.235 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-21T03:34:58.236 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-21T03:34:58.237 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-21T03:34:58.238 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-21T03:34:58.239 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-21T03:34:58.240 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-21T03:34:58.242 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-21T03:34:58.243 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-21T03:34:58.244 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-21T03:34:58.245 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-21T03:34:58.246 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-21T03:34:58.247 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-21T03:34:58.248 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-21T03:34:58.249 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-21T03:34:58.250 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-21T03:34:58.251 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-21T03:34:58.252 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-21T03:34:58.253 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-21T03:34:58.254 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-21T03:34:58.255 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-21T03:34:58.256 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-21T03:34:58.258 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-21T03:34:58.259 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-21T03:34:58.260 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-21T03:34:58.261 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-21T03:34:58.262 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-21T03:34:58.263 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-21T03:34:58.264 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-21T03:34:58.265 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-21T03:34:58.266 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-21T03:34:58.267 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-21T03:34:58.268 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-21T03:34:58.270 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-21T03:34:58.271 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-21T03:34:58.271 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-21T03:34:58.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-21T03:34:58.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-21T03:34:58.275 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-21T03:34:58.275 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-21T03:34:58.276 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-21T03:34:58.277 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-21T03:34:58.278 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-21T03:34:58.279 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-21T03:34:58.280 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-21T03:34:58.281 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-21T03:34:58.282 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-21T03:34:58.283 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-21T03:34:58.284 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-21T03:34:58.285 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-21T03:34:58.286 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-21T03:34:58.287 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-21T03:34:58.289 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-21T03:34:58.290 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-21T03:34:58.291 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-21T03:34:58.292 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-21T03:34:58.293 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-21T03:34:58.295 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-21T03:34:58.296 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-21T03:34:58.298 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-21T03:34:58.299 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-21T03:34:58.300 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-21T03:34:58.301 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-21T03:34:58.302 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-21T03:34:58.304 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-21T03:34:58.305 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-21T03:34:58.306 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-21T03:34:58.307 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-21T03:34:58.308 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-21T03:34:58.309 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-21T03:34:58.311 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-21T03:34:58.312 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-21T03:34:58.313 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-21T03:34:58.315 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-21T03:34:58.316 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-21T03:34:58.317 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-21T03:34:58.318 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-21T03:34:58.319 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-21T03:34:58.320 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-21T03:34:58.321 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-21T03:34:58.322 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-21T03:34:58.323 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-21T03:34:58.324 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-21T03:34:58.326 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-21T03:34:58.327 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-21T03:34:58.330 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-21T03:34:58.330 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-21T03:34:58.330 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-21T03:34:58.331 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-21T03:34:58.332 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-21T03:34:58.334 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-21T03:34:58.336 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-21T03:34:58.337 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-21T03:34:58.338 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-21T03:34:58.339 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-21T03:34:58.340 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-21T03:34:58.341 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-21T03:34:58.342 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-21T03:34:58.343 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-21T03:34:58.344 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-21T03:34:58.345 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-21T03:34:58.346 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-21T03:34:58.348 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-21T03:34:58.348 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-21T03:34:58.350 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-21T03:34:58.351 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-21T03:34:58.352 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-21T03:34:58.353 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-21T03:34:58.354 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-21T03:34:58.355 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-21T03:34:58.356 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-21T03:34:58.357 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-21T03:34:58.358 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-21T03:34:58.359 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-21T03:34:58.361 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-21T03:34:58.362 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-21T03:34:58.363 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-21T03:34:58.365 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-21T03:34:58.367 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-21T03:34:58.369 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-21T03:34:58.370 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-21T03:34:58.372 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-21T03:34:58.373 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-21T03:34:58.375 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-21T03:34:58.376 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-21T03:34:58.378 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-21T03:34:58.379 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-21T03:34:58.380 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-21T03:34:58.381 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-21T03:34:58.382 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-21T03:34:58.383 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-21T03:34:58.384 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-21T03:34:58.385 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-21T03:34:58.386 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-21T03:34:58.387 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-21T03:34:58.388 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-21T03:34:58.390 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-21T03:34:58.391 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-21T03:34:58.392 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-21T03:34:58.393 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-21T03:34:58.394 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-21T03:34:58.395 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-21T03:34:58.396 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-21T03:34:58.397 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-21T03:34:58.398 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-21T03:34:58.399 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-21T03:34:58.400 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-21T03:34:58.402 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-21T03:34:58.403 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-21T03:34:58.405 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-21T03:34:58.405 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-21T03:34:58.406 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-21T03:34:58.407 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-21T03:34:58.408 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-21T03:34:58.409 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-21T03:34:58.410 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-21T03:34:58.411 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-21T03:34:58.412 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-21T03:34:58.414 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-21T03:34:58.415 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-21T03:34:58.416 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-21T03:34:58.417 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-21T03:34:58.418 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-21T03:34:58.419 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-21T03:34:58.420 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-21T03:34:58.421 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-21T03:34:58.422 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-21T03:34:58.423 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-21T03:34:58.424 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-21T03:34:58.425 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-21T03:34:58.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-21T03:34:58.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-21T03:34:58.429 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-21T03:34:58.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-21T03:34:58.431 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-21T03:34:58.432 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-21T03:34:58.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-21T03:34:58.434 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-21T03:34:58.435 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-21T03:34:58.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-21T03:34:58.438 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-21T03:34:58.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-21T03:34:58.440 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-21T03:34:58.441 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-21T03:34:58.442 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-21T03:34:58.443 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-21T03:34:58.444 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-21T03:34:58.445 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-21T03:34:58.446 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-21T03:34:58.447 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-21T03:34:58.448 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-21T03:34:58.449 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-21T03:34:58.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-21T03:34:58.452 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-21T03:34:58.453 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-21T03:34:58.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-21T03:34:58.455 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-21T03:34:58.456 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-21T03:34:58.457 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-21T03:34:58.458 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-21T03:34:58.459 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-21T03:34:58.460 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-21T03:34:58.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-21T03:34:58.462 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-21T03:34:58.463 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-21T03:34:58.465 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-21T03:34:58.466 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-21T03:34:58.467 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-21T03:34:58.468 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-21T03:34:58.469 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-21T03:34:58.470 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-21T03:34:58.471 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-21T03:34:58.472 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-21T03:34:58.473 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-21T03:34:58.474 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-21T03:34:58.475 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-21T03:34:58.476 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-21T03:34:58.478 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-21T03:34:58.479 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-21T03:34:58.480 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-21T03:34:58.482 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-21T03:34:58.483 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-21T03:34:58.484 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-21T03:34:58.485 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-21T03:34:58.486 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-21T03:34:58.487 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-21T03:34:58.489 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-21T03:34:58.489 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-21T03:34:58.490 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-21T03:34:58.492 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-21T03:34:58.493 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-21T03:34:58.494 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-21T03:34:58.495 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-21T03:34:58.496 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-21T03:34:58.497 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-21T03:34:58.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-21T03:34:58.499 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-21T03:34:58.500 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-21T03:34:58.502 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-21T03:34:58.503 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-21T03:34:58.504 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-21T03:34:58.505 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-21T03:34:58.506 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-21T03:34:58.507 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-21T03:34:58.508 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-21T03:34:58.509 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-21T03:34:58.510 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-21T03:34:58.511 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-21T03:34:58.512 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-21T03:34:58.513 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-21T03:34:58.514 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-21T03:34:58.515 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-21T03:34:58.517 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-21T03:34:58.518 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-21T03:34:58.520 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-21T03:34:58.522 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-21T03:34:58.523 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-21T03:34:58.524 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-21T03:34:58.525 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-21T03:34:58.526 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-21T03:34:58.527 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-21T03:34:58.528 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-21T03:34:58.529 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-21T03:34:58.530 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-21T03:34:58.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-21T03:34:58.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-21T03:34:58.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-21T03:34:58.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-21T03:34:58.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-21T03:34:58.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-21T03:34:58.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-21T03:34:58.536 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-21T03:34:58.537 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-21T03:34:58.538 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-21T03:34:58.539 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-21T03:34:58.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-21T03:34:58.542 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-21T03:34:58.544 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-21T03:34:58.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-21T03:34:58.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-21T03:34:58.547 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-21T03:34:58.548 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-21T03:34:58.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-21T03:34:58.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-21T03:34:58.550 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-21T03:34:58.551 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-21T03:34:58.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-21T03:34:58.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-21T03:34:58.553 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-21T03:34:58.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-21T03:34:58.555 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-21T03:34:58.556 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-21T03:34:58.557 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-21T03:34:58.557 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-21T03:34:58.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-21T03:34:58.559 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-21T03:34:58.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-21T03:34:58.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-21T03:34:58.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-21T03:34:58.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-21T03:34:58.563 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-21T03:34:58.564 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-21T03:34:58.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-21T03:34:58.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-21T03:34:58.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-21T03:34:58.567 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-21T03:34:58.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-21T03:34:58.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-21T03:34:58.569 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-21T03:34:58.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-21T03:34:58.571 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-21T03:34:58.572 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-21T03:34:58.572 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-21T03:34:58.574 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-21T03:34:58.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-21T03:34:58.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-21T03:34:58.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-21T03:34:58.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-21T03:34:58.579 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-21T03:34:58.581 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-21T03:34:58.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-21T03:34:58.583 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-21T03:34:58.584 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-21T03:34:58.585 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-21T03:34:58.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-21T03:34:58.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-21T03:34:58.587 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-21T03:34:58.588 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-21T03:34:58.589 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-21T03:34:58.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-21T03:34:58.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-21T03:34:58.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-21T03:34:58.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-21T03:34:58.593 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-21T03:34:58.594 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-21T03:34:58.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-21T03:34:58.596 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-21T03:34:58.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-21T03:34:58.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-21T03:34:58.598 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-21T03:34:58.599 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-21T03:34:58.600 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-21T03:34:58.601 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-21T03:34:58.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-21T03:34:58.603 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-21T03:34:58.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-21T03:34:58.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-21T03:34:58.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-21T03:34:58.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-21T03:34:58.607 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-21T03:34:58.608 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-21T03:34:58.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-21T03:34:58.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-21T03:34:58.611 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-21T03:34:58.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-21T03:34:58.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-21T03:34:58.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-21T03:34:58.614 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-21T03:34:58.615 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-21T03:34:58.616 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-21T03:34:58.617 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-21T03:34:58.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-21T03:34:58.619 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-21T03:34:58.620 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-21T03:34:58.621 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-21T03:34:58.622 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-21T03:34:58.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-21T03:34:58.624 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-21T03:34:58.625 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-21T03:34:58.626 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-21T03:34:58.627 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-21T03:34:58.628 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-21T03:34:58.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-21T03:34:58.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-21T03:34:58.630 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-21T03:34:58.631 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-21T03:34:58.632 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-21T03:34:58.633 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-21T03:34:58.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-21T03:34:58.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-21T03:34:58.635 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-21T03:34:58.637 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-21T03:34:58.638 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-21T03:34:58.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-21T03:34:58.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-21T03:34:58.641 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-21T03:34:58.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-21T03:34:58.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-21T03:34:58.643 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-21T03:34:58.644 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-21T03:34:58.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-21T03:34:58.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-21T03:34:58.646 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-21T03:34:58.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-21T03:34:58.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-21T03:34:58.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-21T03:34:58.649 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-21T03:34:58.650 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-21T03:34:58.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-21T03:34:58.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-21T03:34:58.652 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-21T03:34:58.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-21T03:34:58.654 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-21T03:34:58.655 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-21T03:34:58.655 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-21T03:34:58.656 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-21T03:34:58.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-21T03:34:58.658 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-21T03:34:58.658 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-21T03:34:58.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-21T03:34:58.660 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-21T03:34:58.661 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-21T03:34:58.662 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-21T03:34:58.662 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-21T03:34:58.663 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-21T03:34:58.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-21T03:34:58.665 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-21T03:34:58.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-21T03:34:58.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-21T03:34:58.667 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-21T03:34:58.668 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-21T03:34:58.669 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-21T03:34:58.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-21T03:34:58.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-21T03:34:58.671 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-21T03:34:58.672 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-21T03:34:58.673 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-21T03:34:58.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-21T03:34:58.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-21T03:34:58.675 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-21T03:34:58.676 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-21T03:34:58.677 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-21T03:34:58.678 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-21T03:34:58.679 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-21T03:34:58.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-21T03:34:58.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-21T03:34:58.681 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-21T03:34:58.682 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-21T03:34:58.683 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-21T03:34:58.684 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-21T03:34:58.685 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-21T03:34:58.685 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-21T03:34:58.686 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-21T03:34:58.687 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-21T03:34:58.688 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-21T03:34:58.689 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-21T03:34:58.690 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-21T03:34:58.691 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-21T03:34:58.692 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-21T03:34:58.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-21T03:34:58.694 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-21T03:34:58.695 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-21T03:34:58.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-21T03:34:58.697 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-21T03:34:58.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-21T03:34:58.699 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-21T03:34:58.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-21T03:34:58.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-21T03:34:58.701 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-21T03:34:58.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:58 smithi102 ceph-mon[31392]: pgmap v366: 97 pgs: 97 active+clean; 46 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-21T03:34:58.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:58 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:58.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-21T03:34:58.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-21T03:34:58.704 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-21T03:34:58.705 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-21T03:34:58.706 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-21T03:34:58.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-21T03:34:58.708 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-21T03:34:58.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-21T03:34:58.710 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-21T03:34:58.711 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-21T03:34:58.712 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-21T03:34:58.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-21T03:34:58.714 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-21T03:34:58.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-21T03:34:58.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-21T03:34:58.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-21T03:34:58.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-21T03:34:58.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-21T03:34:58.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-21T03:34:58.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-21T03:34:58.721 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-21T03:34:58.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-21T03:34:58.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-21T03:34:58.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-21T03:34:58.725 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-21T03:34:58.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-21T03:34:58.727 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-21T03:34:58.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-21T03:34:58.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-21T03:34:58.730 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-21T03:34:58.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-21T03:34:58.732 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-21T03:34:58.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-21T03:34:58.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-21T03:34:58.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-21T03:34:58.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-21T03:34:58.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-21T03:34:58.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-21T03:34:58.739 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-21T03:34:58.740 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-21T03:34:58.741 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-21T03:34:58.742 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-21T03:34:58.743 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-21T03:34:58.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:58 smithi148 ceph-mon[34651]: pgmap v366: 97 pgs: 97 active+clean; 46 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-21T03:34:58.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:58 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:58.744 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-21T03:34:58.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-21T03:34:58.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-21T03:34:58.746 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-21T03:34:58.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-21T03:34:58.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-21T03:34:58.749 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-21T03:34:58.750 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-21T03:34:58.751 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-21T03:34:58.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-21T03:34:58.753 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-21T03:34:58.753 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-21T03:34:58.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-21T03:34:58.755 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-21T03:34:58.756 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-21T03:34:58.757 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-21T03:34:58.758 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-21T03:34:58.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-21T03:34:58.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-21T03:34:58.761 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-21T03:34:58.762 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-21T03:34:58.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-21T03:34:58.764 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-21T03:34:58.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-21T03:34:58.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-21T03:34:58.767 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-21T03:34:58.768 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-21T03:34:58.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-21T03:34:58.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-21T03:34:58.770 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-21T03:34:58.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-21T03:34:58.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-21T03:34:58.773 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-21T03:34:58.774 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-21T03:34:58.775 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-21T03:34:58.776 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-21T03:34:58.777 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-21T03:34:58.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-21T03:34:58.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-21T03:34:58.780 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-21T03:34:58.781 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-21T03:34:58.782 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-21T03:34:58.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-21T03:34:58.784 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-21T03:34:58.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-21T03:34:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:58 smithi121 ceph-mon[34316]: pgmap v366: 97 pgs: 97 active+clean; 46 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.7 MiB/s wr, 15 op/s 2024-09-21T03:34:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:58 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:34:58.786 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-21T03:34:58.787 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-21T03:34:58.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-21T03:34:58.789 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-21T03:34:58.789 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-21T03:34:58.790 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-21T03:34:58.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-21T03:34:58.792 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-21T03:34:58.793 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-21T03:34:58.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-21T03:34:58.795 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-21T03:34:58.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-21T03:34:58.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-21T03:34:58.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-21T03:34:58.798 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-21T03:34:58.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-21T03:34:58.800 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-21T03:34:58.801 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-21T03:34:58.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-21T03:34:58.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-21T03:34:58.804 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-21T03:34:58.805 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-21T03:34:58.806 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-21T03:34:58.807 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-21T03:34:58.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-21T03:34:58.809 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-21T03:34:58.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-21T03:34:58.811 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-21T03:34:58.812 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-21T03:34:58.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-21T03:34:58.814 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-21T03:34:58.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-21T03:34:58.816 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-21T03:34:58.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-21T03:34:58.818 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-21T03:34:58.819 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-21T03:34:58.820 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-21T03:34:58.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-21T03:34:58.822 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-21T03:34:58.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-21T03:34:58.824 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-21T03:34:58.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-21T03:34:58.826 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-21T03:34:58.827 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-21T03:34:58.828 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-21T03:34:58.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-21T03:34:58.830 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-21T03:34:58.831 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-21T03:34:58.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-21T03:34:58.833 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-21T03:34:58.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-21T03:34:58.835 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-21T03:34:58.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-21T03:34:58.837 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-21T03:34:58.838 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-21T03:34:58.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-21T03:34:58.840 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-21T03:34:58.841 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-21T03:34:58.842 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-21T03:34:58.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-21T03:34:58.844 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-21T03:34:58.845 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-21T03:34:58.846 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-21T03:34:58.847 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-21T03:34:58.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-21T03:34:58.849 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-21T03:34:58.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-21T03:34:58.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-21T03:34:58.852 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-21T03:34:58.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-21T03:34:58.854 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-21T03:34:58.855 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-21T03:34:58.856 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-21T03:34:58.857 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-21T03:34:58.858 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-21T03:34:58.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-21T03:34:58.860 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-21T03:34:58.861 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-21T03:34:58.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-21T03:34:58.863 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-21T03:34:58.864 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-21T03:34:58.865 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-21T03:34:58.866 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-21T03:34:58.867 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-21T03:34:58.868 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-21T03:34:58.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-21T03:34:58.870 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-21T03:34:58.871 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-21T03:34:58.872 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-21T03:34:58.873 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-21T03:34:58.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-21T03:34:58.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-21T03:34:58.875 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-21T03:34:58.876 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-21T03:34:58.877 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-21T03:34:58.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-21T03:34:58.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-21T03:34:58.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-21T03:34:58.880 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-21T03:34:58.881 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-21T03:34:58.882 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-21T03:34:58.883 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-21T03:34:58.884 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-21T03:34:58.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-21T03:34:58.886 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-21T03:34:58.886 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-21T03:34:58.887 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-21T03:34:58.888 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-21T03:34:58.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-21T03:34:58.890 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-21T03:34:58.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-21T03:34:58.892 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-21T03:34:58.893 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-21T03:34:58.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-21T03:34:58.895 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-21T03:34:58.897 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-21T03:34:58.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-21T03:34:58.899 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-21T03:34:58.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-21T03:34:58.902 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-21T03:34:58.903 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-21T03:34:58.905 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-21T03:34:58.906 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-21T03:34:58.908 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-21T03:34:58.909 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-21T03:34:58.910 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-21T03:34:58.912 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-21T03:34:58.913 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-21T03:34:58.915 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-21T03:34:58.916 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-21T03:34:58.918 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-21T03:34:58.919 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-21T03:34:58.920 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-21T03:34:58.922 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-21T03:34:58.923 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-21T03:34:58.924 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-21T03:34:58.926 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-21T03:34:58.927 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-21T03:34:58.929 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-21T03:34:58.930 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-21T03:34:58.931 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-21T03:34:58.933 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-21T03:34:58.934 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-21T03:34:58.935 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-21T03:34:58.937 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-21T03:34:58.938 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-21T03:34:58.941 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-21T03:34:58.941 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-21T03:34:58.942 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-21T03:34:58.944 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-21T03:34:58.945 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-21T03:34:58.946 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-21T03:34:58.947 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-21T03:34:58.948 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-21T03:34:58.949 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-21T03:34:58.950 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-21T03:34:58.951 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-21T03:34:58.951 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-21T03:34:58.952 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-21T03:34:58.953 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-21T03:34:58.954 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-21T03:34:58.955 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-21T03:34:58.956 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-21T03:34:58.957 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-21T03:34:58.958 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-21T03:34:58.959 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-21T03:34:58.960 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-21T03:34:58.961 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-21T03:34:58.962 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-21T03:34:58.962 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-21T03:34:58.963 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-21T03:34:58.964 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-21T03:34:58.965 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-21T03:34:58.966 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-21T03:34:58.967 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-21T03:34:58.967 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-21T03:34:58.968 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-21T03:34:58.969 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-21T03:34:58.970 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-21T03:34:58.971 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-21T03:34:58.972 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-21T03:34:58.973 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-21T03:34:58.974 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-21T03:34:58.975 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-21T03:34:58.975 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-21T03:34:58.976 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-21T03:34:58.977 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-21T03:34:58.978 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-21T03:34:58.979 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-21T03:34:58.980 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-21T03:34:58.981 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-21T03:34:58.982 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-21T03:34:58.983 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-21T03:34:58.983 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-21T03:34:58.984 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-21T03:34:58.985 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-21T03:34:58.986 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-21T03:34:58.987 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-21T03:34:58.988 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-21T03:34:58.989 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-21T03:34:58.991 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-21T03:34:58.992 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-21T03:34:58.993 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-21T03:34:58.995 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-21T03:34:58.997 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-21T03:34:58.998 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-21T03:34:58.999 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-21T03:34:59.000 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-21T03:34:59.002 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-21T03:34:59.003 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-21T03:34:59.005 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-21T03:34:59.006 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-21T03:34:59.007 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-21T03:34:59.009 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-21T03:34:59.010 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-21T03:34:59.011 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-21T03:34:59.013 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-21T03:34:59.014 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-21T03:34:59.015 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-21T03:34:59.016 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-21T03:34:59.017 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-21T03:34:59.018 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-21T03:34:59.019 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-21T03:34:59.020 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-21T03:34:59.021 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-21T03:34:59.022 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-21T03:34:59.022 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-21T03:34:59.023 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-21T03:34:59.024 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-21T03:34:59.025 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-21T03:34:59.026 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-21T03:34:59.026 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-21T03:34:59.028 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-21T03:34:59.028 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-21T03:34:59.029 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-21T03:34:59.030 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-21T03:34:59.031 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-21T03:34:59.033 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-21T03:34:59.033 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-21T03:34:59.034 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-21T03:34:59.035 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-21T03:34:59.036 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-21T03:34:59.037 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-21T03:34:59.038 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-21T03:34:59.039 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-21T03:34:59.040 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-21T03:34:59.041 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-21T03:34:59.042 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-21T03:34:59.043 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-21T03:34:59.044 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-21T03:34:59.045 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-21T03:34:59.045 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-21T03:34:59.046 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-21T03:34:59.047 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-21T03:34:59.048 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-21T03:34:59.049 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-21T03:34:59.050 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-21T03:34:59.051 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-21T03:34:59.051 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-21T03:34:59.052 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-21T03:34:59.053 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-21T03:34:59.054 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-21T03:34:59.055 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-21T03:34:59.056 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-21T03:34:59.057 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-21T03:34:59.058 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-21T03:34:59.058 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-21T03:34:59.059 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-21T03:34:59.060 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-21T03:34:59.061 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-21T03:34:59.062 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-21T03:34:59.063 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-21T03:34:59.064 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-21T03:34:59.065 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-21T03:34:59.067 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-21T03:34:59.067 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-21T03:34:59.068 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-21T03:34:59.069 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-21T03:34:59.070 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-21T03:34:59.071 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-21T03:34:59.072 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-21T03:34:59.073 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-21T03:34:59.074 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-21T03:34:59.075 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-21T03:34:59.076 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-21T03:34:59.077 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-21T03:34:59.078 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-21T03:34:59.079 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-21T03:34:59.081 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-21T03:34:59.081 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-21T03:34:59.082 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-21T03:34:59.083 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-21T03:34:59.084 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-21T03:34:59.085 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-21T03:34:59.086 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-21T03:34:59.087 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-21T03:34:59.088 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-21T03:34:59.089 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-21T03:34:59.090 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-21T03:34:59.091 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-21T03:34:59.092 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-21T03:34:59.093 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-21T03:34:59.419 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-21T03:34:59.420 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-21T03:34:59.421 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-21T03:34:59.422 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-21T03:34:59.423 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-21T03:34:59.424 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-21T03:34:59.425 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-21T03:34:59.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-21T03:34:59.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-21T03:34:59.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-21T03:34:59.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-21T03:34:59.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-21T03:34:59.431 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-21T03:34:59.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-21T03:34:59.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-21T03:34:59.435 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-21T03:34:59.436 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-21T03:34:59.436 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-21T03:34:59.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-21T03:34:59.438 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-21T03:34:59.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-21T03:34:59.440 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-21T03:34:59.441 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-21T03:34:59.442 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-21T03:34:59.444 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-21T03:34:59.445 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-21T03:34:59.446 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-21T03:34:59.447 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-21T03:34:59.448 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-21T03:34:59.449 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-21T03:34:59.450 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-21T03:34:59.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-21T03:34:59.452 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-21T03:34:59.453 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-21T03:34:59.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-21T03:34:59.455 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-21T03:34:59.456 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-21T03:34:59.457 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-21T03:34:59.458 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-21T03:34:59.459 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-21T03:34:59.460 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-21T03:34:59.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-21T03:34:59.462 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-21T03:34:59.463 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-21T03:34:59.464 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-21T03:34:59.465 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-21T03:34:59.466 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-21T03:34:59.467 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-21T03:34:59.468 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-21T03:34:59.469 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-21T03:34:59.470 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-21T03:34:59.471 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-21T03:34:59.472 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-21T03:34:59.473 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-21T03:34:59.474 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-21T03:34:59.475 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-21T03:34:59.476 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-21T03:34:59.477 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-21T03:34:59.478 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-21T03:34:59.479 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-21T03:34:59.480 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-21T03:34:59.481 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-21T03:34:59.482 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-21T03:34:59.483 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-21T03:34:59.485 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-21T03:34:59.486 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-21T03:34:59.487 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-21T03:34:59.488 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-21T03:34:59.489 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-21T03:34:59.491 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-21T03:34:59.492 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-21T03:34:59.493 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-21T03:34:59.494 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-21T03:34:59.495 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-21T03:34:59.496 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-21T03:34:59.497 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-21T03:34:59.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-21T03:34:59.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-21T03:34:59.499 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-21T03:34:59.500 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-21T03:34:59.501 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-21T03:34:59.502 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-21T03:34:59.503 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-21T03:34:59.504 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-21T03:34:59.505 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-21T03:34:59.506 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-21T03:34:59.508 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-21T03:34:59.509 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-21T03:34:59.509 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-21T03:34:59.510 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-21T03:34:59.511 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-21T03:34:59.513 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-21T03:34:59.513 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-21T03:34:59.515 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-21T03:34:59.516 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-21T03:34:59.517 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-21T03:34:59.518 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-21T03:34:59.520 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-21T03:34:59.521 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-21T03:34:59.521 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-21T03:34:59.521 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-21T03:34:59.522 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-21T03:34:59.523 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-21T03:34:59.524 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-21T03:34:59.525 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-21T03:34:59.526 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-21T03:34:59.527 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-21T03:34:59.528 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-21T03:34:59.530 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-21T03:34:59.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-21T03:34:59.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-21T03:34:59.532 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-21T03:34:59.533 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-21T03:34:59.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-21T03:34:59.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-21T03:34:59.537 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-21T03:34:59.538 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-21T03:34:59.538 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-21T03:34:59.539 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/ 2024-09-21T03:34:59.540 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-21T03:34:59.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-21T03:34:59.543 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-21T03:34:59.543 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-21T03:34:59.544 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-21T03:34:59.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-21T03:34:59.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-21T03:34:59.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-21T03:34:59.548 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-21T03:34:59.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-21T03:34:59.550 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-21T03:34:59.551 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-21T03:34:59.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-21T03:34:59.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-21T03:34:59.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-21T03:34:59.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-21T03:34:59.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-21T03:34:59.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-21T03:34:59.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-21T03:34:59.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-21T03:34:59.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-21T03:34:59.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-21T03:34:59.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-21T03:34:59.563 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-21T03:34:59.564 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-21T03:34:59.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-21T03:34:59.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-21T03:34:59.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-21T03:34:59.567 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-21T03:34:59.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-21T03:34:59.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-21T03:34:59.569 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-21T03:34:59.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-21T03:34:59.572 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-21T03:34:59.573 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-21T03:34:59.574 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-21T03:34:59.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-21T03:34:59.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-21T03:34:59.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-21T03:34:59.577 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-21T03:34:59.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-21T03:34:59.579 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-21T03:34:59.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-21T03:34:59.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-21T03:34:59.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-21T03:34:59.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-21T03:34:59.583 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-21T03:34:59.584 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-21T03:34:59.585 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-21T03:34:59.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-21T03:34:59.587 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-21T03:34:59.587 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-21T03:34:59.588 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-21T03:34:59.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-21T03:34:59.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-21T03:34:59.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-21T03:34:59.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-21T03:34:59.593 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-21T03:34:59.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-21T03:34:59.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-21T03:34:59.596 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-21T03:34:59.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-21T03:34:59.599 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-21T03:34:59.600 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-21T03:34:59.601 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-21T03:34:59.601 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-21T03:34:59.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-21T03:34:59.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-21T03:34:59.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-21T03:34:59.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-21T03:34:59.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-21T03:34:59.607 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-21T03:34:59.608 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-21T03:34:59.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-21T03:34:59.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-21T03:34:59.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-21T03:34:59.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-21T03:34:59.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-21T03:34:59.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-21T03:34:59.614 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-21T03:34:59.615 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-21T03:34:59.616 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-21T03:34:59.617 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-21T03:34:59.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-21T03:34:59.619 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-21T03:34:59.620 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-21T03:34:59.621 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-21T03:34:59.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-21T03:34:59.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-21T03:34:59.624 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-21T03:34:59.625 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-21T03:34:59.626 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-21T03:34:59.627 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-21T03:34:59.628 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-21T03:34:59.628 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-21T03:34:59.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-21T03:34:59.631 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-21T03:34:59.632 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-21T03:34:59.633 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-21T03:34:59.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-21T03:34:59.635 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-21T03:34:59.636 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-21T03:34:59.636 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-21T03:34:59.637 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-21T03:34:59.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-21T03:34:59.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-21T03:34:59.640 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-21T03:34:59.641 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-21T03:34:59.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-21T03:34:59.643 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-21T03:34:59.644 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-21T03:34:59.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-21T03:34:59.646 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-21T03:34:59.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-21T03:34:59.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-21T03:34:59.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-21T03:34:59.649 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-21T03:34:59.650 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-21T03:34:59.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-21T03:34:59.652 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-21T03:34:59.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-21T03:34:59.654 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-21T03:34:59.656 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-21T03:34:59.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-21T03:34:59.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-21T03:34:59.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-21T03:34:59.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-21T03:34:59.660 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-21T03:34:59.661 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-21T03:34:59.663 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-21T03:34:59.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-21T03:34:59.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-21T03:34:59.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-21T03:34:59.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-21T03:34:59.667 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-21T03:34:59.668 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-21T03:34:59.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-21T03:34:59.671 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-21T03:34:59.672 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-21T03:34:59.673 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-21T03:34:59.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-21T03:34:59.675 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-21T03:34:59.676 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-21T03:34:59.676 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-21T03:34:59.677 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-21T03:34:59.678 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-21T03:34:59.679 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-21T03:34:59.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-21T03:34:59.681 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-21T03:34:59.682 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-21T03:34:59.683 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-21T03:34:59.684 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-21T03:34:59.686 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-21T03:34:59.687 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-21T03:34:59.688 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-21T03:34:59.689 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-21T03:34:59.690 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-21T03:34:59.691 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-21T03:34:59.692 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-21T03:34:59.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-21T03:34:59.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-21T03:34:59.695 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-21T03:34:59.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-21T03:34:59.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-21T03:34:59.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-21T03:34:59.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-21T03:34:59.699 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-21T03:34:59.701 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/ 2024-09-21T03:34:59.702 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-21T03:34:59.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-21T03:34:59.704 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-21T03:34:59.705 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-21T03:34:59.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-21T03:34:59.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-21T03:34:59.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-21T03:34:59.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-21T03:34:59.710 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-21T03:34:59.711 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-21T03:34:59.712 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-21T03:34:59.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-21T03:34:59.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-21T03:34:59.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-21T03:34:59.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-21T03:34:59.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-21T03:34:59.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-21T03:34:59.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-21T03:34:59.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-21T03:34:59.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-21T03:34:59.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-21T03:34:59.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/ 2024-09-21T03:34:59.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-21T03:34:59.725 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-21T03:34:59.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-21T03:34:59.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-21T03:34:59.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-21T03:34:59.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-21T03:34:59.730 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-21T03:34:59.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-21T03:34:59.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-21T03:34:59.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-21T03:34:59.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-21T03:34:59.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-21T03:34:59.737 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-21T03:34:59.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-21T03:34:59.740 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-21T03:34:59.740 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-21T03:34:59.741 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-21T03:34:59.741 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-21T03:34:59.743 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-21T03:34:59.743 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-21T03:34:59.744 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-21T03:34:59.744 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-21T03:34:59.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-21T03:34:59.746 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-21T03:34:59.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-21T03:34:59.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-21T03:34:59.749 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-21T03:34:59.750 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-21T03:34:59.751 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-21T03:34:59.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-21T03:34:59.753 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-21T03:34:59.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-21T03:34:59.755 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-21T03:34:59.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-21T03:34:59.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-21T03:34:59.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-21T03:34:59.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-21T03:34:59.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-21T03:34:59.761 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-21T03:34:59.762 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-21T03:34:59.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-21T03:34:59.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-21T03:34:59.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-21T03:34:59.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-21T03:34:59.767 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-21T03:34:59.768 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-21T03:34:59.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-21T03:34:59.770 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-21T03:34:59.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-21T03:34:59.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-21T03:34:59.773 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-21T03:34:59.774 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-21T03:34:59.775 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-21T03:34:59.776 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-21T03:34:59.777 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-21T03:34:59.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-21T03:34:59.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-21T03:34:59.780 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-21T03:34:59.781 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-21T03:34:59.782 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-21T03:34:59.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-21T03:34:59.784 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-21T03:34:59.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-21T03:34:59.787 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-21T03:34:59.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-21T03:34:59.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-21T03:34:59.789 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-21T03:34:59.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-21T03:34:59.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-21T03:34:59.792 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-21T03:34:59.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-21T03:34:59.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-21T03:34:59.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-21T03:34:59.797 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-21T03:34:59.798 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-21T03:34:59.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-21T03:34:59.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-21T03:34:59.801 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-21T03:34:59.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-21T03:34:59.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-21T03:34:59.804 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-21T03:34:59.805 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-21T03:34:59.806 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-21T03:34:59.807 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-21T03:34:59.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-21T03:34:59.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-21T03:34:59.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-21T03:34:59.811 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-21T03:34:59.812 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-21T03:34:59.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-21T03:34:59.814 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-21T03:34:59.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-21T03:34:59.816 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-21T03:34:59.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-21T03:34:59.819 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-21T03:34:59.820 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-21T03:34:59.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-21T03:34:59.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-21T03:34:59.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-21T03:34:59.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-21T03:34:59.824 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-21T03:34:59.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-21T03:34:59.826 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-21T03:34:59.827 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-21T03:34:59.828 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-21T03:34:59.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-21T03:34:59.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-21T03:34:59.831 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-21T03:34:59.831 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-21T03:34:59.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-21T03:34:59.833 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-21T03:34:59.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-21T03:34:59.835 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-21T03:34:59.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-21T03:34:59.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-21T03:34:59.837 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-21T03:34:59.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-21T03:34:59.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-21T03:34:59.840 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-21T03:34:59.841 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-21T03:34:59.842 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-21T03:34:59.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-21T03:34:59.844 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-21T03:34:59.845 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-21T03:34:59.846 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-21T03:34:59.847 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-21T03:34:59.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-21T03:34:59.849 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-21T03:34:59.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-21T03:34:59.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-21T03:34:59.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-21T03:34:59.852 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-21T03:34:59.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-21T03:34:59.854 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-21T03:34:59.858 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-21T03:34:59.858 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-21T03:34:59.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-21T03:34:59.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-21T03:34:59.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-21T03:34:59.860 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-21T03:34:59.861 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-21T03:34:59.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-21T03:34:59.863 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-21T03:34:59.864 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-21T03:34:59.865 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-21T03:34:59.866 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-21T03:34:59.868 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-21T03:34:59.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-21T03:34:59.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-21T03:34:59.870 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-21T03:34:59.871 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-21T03:34:59.872 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-21T03:34:59.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-21T03:34:59.875 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-21T03:34:59.876 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-21T03:34:59.877 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-21T03:34:59.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-21T03:34:59.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-21T03:34:59.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-21T03:34:59.880 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-21T03:34:59.881 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-21T03:34:59.882 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-21T03:34:59.883 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-21T03:34:59.884 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-21T03:34:59.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-21T03:34:59.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-21T03:34:59.887 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-21T03:34:59.888 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-21T03:34:59.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-21T03:34:59.890 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-21T03:34:59.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-21T03:34:59.892 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-21T03:34:59.893 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-21T03:34:59.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-21T03:34:59.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-21T03:34:59.895 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-21T03:34:59.896 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-21T03:34:59.897 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-21T03:34:59.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-21T03:34:59.899 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-21T03:34:59.900 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-21T03:34:59.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-21T03:34:59.902 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-21T03:34:59.903 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-21T03:34:59.904 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-21T03:34:59.905 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-21T03:34:59.906 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-21T03:34:59.907 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-21T03:34:59.908 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-21T03:34:59.909 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-21T03:34:59.910 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-21T03:34:59.912 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-21T03:34:59.913 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-21T03:34:59.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:59.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:59.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:34:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:34:59.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:34:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:35:00.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:34:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:35:00.108 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-21T03:35:00.110 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-21T03:35:00.111 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-21T03:35:00.112 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-21T03:35:00.113 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-21T03:35:00.114 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-21T03:35:00.115 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ 2024-09-21T03:35:00.116 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-21T03:35:00.117 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-21T03:35:00.117 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-21T03:35:00.119 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-21T03:35:00.120 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-21T03:35:00.121 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-21T03:35:00.121 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-21T03:35:00.122 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-21T03:35:00.123 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-21T03:35:00.125 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-21T03:35:00.126 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-21T03:35:00.127 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-21T03:35:00.128 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-21T03:35:00.129 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/init.txt 2024-09-21T03:35:00.130 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-21T03:35:00.131 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/ 2024-09-21T03:35:00.132 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-21T03:35:00.132 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-21T03:35:00.133 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-21T03:35:00.134 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-21T03:35:00.136 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-21T03:35:00.137 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-21T03:35:00.138 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-21T03:35:00.138 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-21T03:35:00.139 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-21T03:35:00.140 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-21T03:35:00.141 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-21T03:35:00.142 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-21T03:35:00.143 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-21T03:35:00.144 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-21T03:35:00.146 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-21T03:35:00.147 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-21T03:35:00.148 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-21T03:35:00.149 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-21T03:35:00.150 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-21T03:35:00.151 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-21T03:35:00.152 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-21T03:35:00.153 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-21T03:35:00.154 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-21T03:35:00.155 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-21T03:35:00.155 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-21T03:35:00.157 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-21T03:35:00.159 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-21T03:35:00.182 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-21T03:35:00.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-21T03:35:00.184 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-21T03:35:00.185 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-21T03:35:00.186 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-21T03:35:00.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-21T03:35:00.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-21T03:35:00.187 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-21T03:35:00.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-21T03:35:00.188 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-21T03:35:00.189 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-21T03:35:00.190 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-21T03:35:00.191 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-21T03:35:00.192 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-21T03:35:00.193 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-21T03:35:00.194 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-21T03:35:00.194 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-21T03:35:00.195 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-21T03:35:00.197 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-21T03:35:00.198 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-21T03:35:00.198 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-21T03:35:00.199 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-21T03:35:00.200 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-21T03:35:00.202 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-21T03:35:00.203 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-21T03:35:00.203 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-21T03:35:00.204 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-21T03:35:00.205 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-21T03:35:00.206 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/java.txt 2024-09-21T03:35:00.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-21T03:35:00.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-21T03:35:00.208 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-21T03:35:00.209 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-21T03:35:00.210 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-21T03:35:00.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-21T03:35:00.211 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-21T03:35:00.212 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-21T03:35:00.213 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-21T03:35:00.214 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-21T03:35:00.215 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-21T03:35:00.216 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-21T03:35:00.217 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-21T03:35:00.218 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-21T03:35:00.219 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-21T03:35:00.221 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-21T03:35:00.222 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-21T03:35:00.223 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-21T03:35:00.224 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-21T03:35:00.225 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-21T03:35:00.226 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-21T03:35:00.227 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-21T03:35:00.228 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-21T03:35:00.229 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-21T03:35:00.230 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-21T03:35:00.231 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-21T03:35:00.232 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-21T03:35:00.232 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-21T03:35:00.233 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-21T03:35:00.234 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-21T03:35:00.235 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-21T03:35:00.236 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-21T03:35:00.237 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-21T03:35:00.238 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-21T03:35:00.239 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-21T03:35:00.240 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-21T03:35:00.241 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-21T03:35:00.242 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-21T03:35:00.243 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-21T03:35:00.244 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/ 2024-09-21T03:35:00.245 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-21T03:35:00.246 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-21T03:35:00.247 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-21T03:35:00.248 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-21T03:35:00.249 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-21T03:35:00.250 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-21T03:35:00.251 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-21T03:35:00.252 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-21T03:35:00.253 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-21T03:35:00.254 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-21T03:35:00.255 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-21T03:35:00.256 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-21T03:35:00.257 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/ 2024-09-21T03:35:00.258 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-21T03:35:00.259 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-21T03:35:00.260 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-21T03:35:00.261 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-21T03:35:00.262 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-21T03:35:00.263 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-21T03:35:00.264 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-21T03:35:00.265 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-21T03:35:00.266 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-21T03:35:00.267 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-21T03:35:00.268 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-21T03:35:00.269 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-21T03:35:00.270 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-21T03:35:00.271 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-21T03:35:00.272 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-21T03:35:00.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-21T03:35:00.274 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-21T03:35:00.274 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-21T03:35:00.276 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-21T03:35:00.277 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-21T03:35:00.278 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/md.txt 2024-09-21T03:35:00.279 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-21T03:35:00.280 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-21T03:35:00.358 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-21T03:35:00.360 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-21T03:35:00.361 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-21T03:35:00.362 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/metag/ 2024-09-21T03:35:00.364 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-21T03:35:00.365 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-21T03:35:00.367 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/ 2024-09-21T03:35:00.369 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-21T03:35:00.370 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-21T03:35:00.371 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-21T03:35:00.372 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-21T03:35:00.374 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-21T03:35:00.375 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-21T03:35:00.377 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-21T03:35:00.379 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-21T03:35:00.380 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-21T03:35:00.381 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-21T03:35:00.382 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mips/ 2024-09-21T03:35:00.383 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-21T03:35:00.385 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-21T03:35:00.386 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-21T03:35:00.388 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-21T03:35:00.389 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-21T03:35:00.390 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-21T03:35:00.391 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-21T03:35:00.393 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-21T03:35:00.395 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-21T03:35:00.396 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-21T03:35:00.397 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-21T03:35:00.399 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-21T03:35:00.400 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-21T03:35:00.402 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-21T03:35:00.402 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-21T03:35:00.404 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-21T03:35:00.405 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-21T03:35:00.407 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-21T03:35:00.408 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-21T03:35:00.409 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-21T03:35:00.411 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-21T03:35:00.413 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-21T03:35:00.414 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-21T03:35:00.415 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-21T03:35:00.416 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-21T03:35:00.418 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-21T03:35:00.419 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-21T03:35:00.420 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-21T03:35:00.422 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-21T03:35:00.423 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-21T03:35:00.424 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-21T03:35:00.425 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-21T03:35:00.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-21T03:35:00.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-21T03:35:00.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-21T03:35:00.429 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-21T03:35:00.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-21T03:35:00.431 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-21T03:35:00.432 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-21T03:35:00.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-21T03:35:00.434 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-21T03:35:00.435 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-21T03:35:00.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-21T03:35:00.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-21T03:35:00.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-21T03:35:00.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ 2024-09-21T03:35:00.440 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-21T03:35:00.441 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-21T03:35:00.442 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-21T03:35:00.443 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-21T03:35:00.444 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-21T03:35:00.445 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-21T03:35:00.446 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-21T03:35:00.447 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-21T03:35:00.448 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-21T03:35:00.449 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-21T03:35:00.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-21T03:35:00.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-21T03:35:00.453 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-21T03:35:00.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-21T03:35:00.456 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-21T03:35:00.457 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-21T03:35:00.459 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-21T03:35:00.460 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-21T03:35:00.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-21T03:35:00.463 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-21T03:35:00.465 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-21T03:35:00.466 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-21T03:35:00.468 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-21T03:35:00.469 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-21T03:35:00.471 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-21T03:35:00.472 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-21T03:35:00.473 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-21T03:35:00.474 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-21T03:35:00.476 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-21T03:35:00.477 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-21T03:35:00.478 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-21T03:35:00.480 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-21T03:35:00.481 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-21T03:35:00.483 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-21T03:35:00.484 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-21T03:35:00.485 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-21T03:35:00.487 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-21T03:35:00.488 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-21T03:35:00.489 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-21T03:35:00.491 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-21T03:35:00.492 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-21T03:35:00.493 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-21T03:35:00.494 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-21T03:35:00.495 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-21T03:35:00.496 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-21T03:35:00.497 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-21T03:35:00.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-21T03:35:00.498 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-21T03:35:00.499 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-21T03:35:00.500 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-21T03:35:00.501 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-21T03:35:00.502 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-21T03:35:00.503 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-21T03:35:00.504 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-21T03:35:00.505 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-21T03:35:00.506 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-21T03:35:00.506 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-21T03:35:00.507 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-21T03:35:00.508 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-21T03:35:00.509 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-21T03:35:00.510 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-21T03:35:00.511 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-21T03:35:00.512 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-21T03:35:00.513 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-21T03:35:00.514 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-21T03:35:00.515 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-21T03:35:00.516 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-21T03:35:00.517 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-21T03:35:00.518 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-21T03:35:00.519 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-21T03:35:00.520 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-21T03:35:00.521 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-21T03:35:00.522 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-21T03:35:00.523 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-21T03:35:00.524 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-21T03:35:00.525 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-21T03:35:00.526 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-21T03:35:00.527 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-21T03:35:00.528 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-21T03:35:00.528 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-21T03:35:00.529 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-21T03:35:00.530 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-21T03:35:00.531 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-21T03:35:00.532 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-21T03:35:00.533 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-21T03:35:00.534 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-21T03:35:00.535 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-21T03:35:00.536 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-21T03:35:00.536 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-21T03:35:00.537 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-21T03:35:00.538 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-21T03:35:00.539 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-21T03:35:00.540 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-21T03:35:00.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-21T03:35:00.541 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-21T03:35:00.542 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-21T03:35:00.544 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-21T03:35:00.545 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-21T03:35:00.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-21T03:35:00.546 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-21T03:35:00.547 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-21T03:35:00.548 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-21T03:35:00.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-21T03:35:00.549 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-21T03:35:00.551 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-21T03:35:00.551 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-21T03:35:00.552 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-21T03:35:00.553 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-21T03:35:00.554 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-21T03:35:00.555 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-21T03:35:00.556 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-21T03:35:00.556 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-21T03:35:00.557 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-21T03:35:00.558 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-21T03:35:00.559 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-21T03:35:00.560 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-21T03:35:00.561 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-21T03:35:00.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-21T03:35:00.562 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-21T03:35:00.563 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-21T03:35:00.564 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-21T03:35:00.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-21T03:35:00.565 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-21T03:35:00.566 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-21T03:35:00.567 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-21T03:35:00.568 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-21T03:35:00.569 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-21T03:35:00.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-21T03:35:00.570 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-21T03:35:00.571 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-21T03:35:00.573 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-21T03:35:00.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-21T03:35:00.575 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-21T03:35:00.576 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-21T03:35:00.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-21T03:35:00.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-21T03:35:00.578 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-21T03:35:00.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-21T03:35:00.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-21T03:35:00.580 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-21T03:35:00.581 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-21T03:35:00.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-21T03:35:00.582 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-21T03:35:00.583 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-21T03:35:00.584 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-21T03:35:00.585 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-21T03:35:00.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-21T03:35:00.586 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-21T03:35:00.588 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-21T03:35:00.589 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-21T03:35:00.590 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-21T03:35:00.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-21T03:35:00.591 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-21T03:35:00.592 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-21T03:35:00.594 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-21T03:35:00.594 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-21T03:35:00.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-21T03:35:00.595 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-21T03:35:00.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-21T03:35:00.597 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-21T03:35:00.598 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/phy/ 2024-09-21T03:35:00.599 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-21T03:35:00.600 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-21T03:35:00.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-21T03:35:00.602 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/platform/ 2024-09-21T03:35:00.603 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-21T03:35:00.603 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-21T03:35:00.604 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/ 2024-09-21T03:35:00.605 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-21T03:35:00.606 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-21T03:35:00.607 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-21T03:35:00.608 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-21T03:35:00.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-21T03:35:00.609 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-21T03:35:00.610 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-21T03:35:00.611 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-21T03:35:00.612 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-21T03:35:00.613 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-21T03:35:00.615 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-21T03:35:00.616 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-21T03:35:00.617 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-21T03:35:00.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-21T03:35:00.618 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-21T03:35:00.619 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-21T03:35:00.620 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-21T03:35:00.621 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-21T03:35:00.622 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-21T03:35:00.622 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-21T03:35:00.623 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-21T03:35:00.624 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-21T03:35:00.625 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-21T03:35:00.626 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-21T03:35:00.627 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-21T03:35:00.628 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-21T03:35:00.629 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-21T03:35:00.630 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-21T03:35:00.631 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-21T03:35:00.631 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-21T03:35:00.632 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-21T03:35:00.633 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-21T03:35:00.634 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-21T03:35:00.635 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-21T03:35:00.636 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-21T03:35:00.637 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-21T03:35:00.638 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-21T03:35:00.639 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-21T03:35:00.640 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-21T03:35:00.641 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-21T03:35:00.641 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-21T03:35:00.642 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-21T03:35:00.643 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-21T03:35:00.644 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-21T03:35:00.645 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-21T03:35:00.646 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-21T03:35:00.647 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pps/ 2024-09-21T03:35:00.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-21T03:35:00.648 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-21T03:35:00.649 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-21T03:35:00.650 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-21T03:35:00.651 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-21T03:35:00.652 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-21T03:35:00.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-21T03:35:00.653 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-21T03:35:00.654 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-21T03:35:00.655 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-21T03:35:00.656 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-21T03:35:00.657 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pti/ 2024-09-21T03:35:00.658 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-21T03:35:00.659 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-21T03:35:00.660 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-21T03:35:00.661 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-21T03:35:00.662 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-21T03:35:00.663 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-21T03:35:00.664 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-21T03:35:00.665 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-21T03:35:00.665 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-21T03:35:00.666 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-21T03:35:00.667 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-21T03:35:00.668 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-21T03:35:00.669 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-21T03:35:00.670 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-21T03:35:00.671 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-21T03:35:00.672 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-21T03:35:00.673 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-21T03:35:00.674 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-21T03:35:00.675 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-21T03:35:00.676 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-21T03:35:00.677 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/ 2024-09-21T03:35:00.678 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-21T03:35:00.679 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-21T03:35:00.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-21T03:35:00.680 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-21T03:35:00.681 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-21T03:35:00.682 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-21T03:35:00.683 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-21T03:35:00.684 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-21T03:35:00.685 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-21T03:35:00.686 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-21T03:35:00.687 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-21T03:35:00.688 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-21T03:35:00.689 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-21T03:35:00.690 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-21T03:35:00.691 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-21T03:35:00.692 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-21T03:35:00.693 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-21T03:35:00.694 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-21T03:35:00.695 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-21T03:35:00.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-21T03:35:00.696 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-21T03:35:00.697 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-21T03:35:00.698 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-21T03:35:00.699 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-21T03:35:00.700 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-21T03:35:00.701 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-21T03:35:00.702 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-21T03:35:00.703 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-21T03:35:00.704 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-21T03:35:00.705 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-21T03:35:00.706 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-21T03:35:00.707 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-21T03:35:00.708 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-21T03:35:00.709 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-21T03:35:00.710 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-21T03:35:00.711 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-21T03:35:00.712 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-21T03:35:00.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-21T03:35:00.713 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-21T03:35:00.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-21T03:35:00.715 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-21T03:35:00.716 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-21T03:35:00.717 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-21T03:35:00.718 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-21T03:35:00.719 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-21T03:35:00.720 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-21T03:35:00.721 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-21T03:35:00.722 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-21T03:35:00.723 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-21T03:35:00.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-21T03:35:00.724 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-21T03:35:00.725 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-21T03:35:00.726 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-21T03:35:00.727 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-21T03:35:00.728 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-21T03:35:00.729 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-21T03:35:00.730 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-21T03:35:00.731 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-21T03:35:00.732 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-21T03:35:00.733 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-21T03:35:00.734 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-21T03:35:00.735 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-21T03:35:00.736 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-21T03:35:00.737 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-21T03:35:00.738 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-21T03:35:00.739 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-21T03:35:00.740 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-21T03:35:00.741 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-21T03:35:00.742 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-21T03:35:00.743 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-21T03:35:00.744 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-21T03:35:00.745 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-21T03:35:00.746 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-21T03:35:00.747 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-21T03:35:00.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-21T03:35:00.748 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-21T03:35:00.749 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-21T03:35:00.750 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-21T03:35:00.751 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-21T03:35:00.752 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-21T03:35:00.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-21T03:35:00.754 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-21T03:35:00.755 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-21T03:35:00.756 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-21T03:35:00.756 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-21T03:35:00.757 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/ 2024-09-21T03:35:00.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-21T03:35:00.759 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-21T03:35:00.760 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-21T03:35:00.761 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-21T03:35:00.762 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-21T03:35:00.763 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-21T03:35:00.764 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-21T03:35:00.765 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-21T03:35:00.766 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-21T03:35:00.767 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-21T03:35:00.768 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-21T03:35:00.769 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-21T03:35:00.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-21T03:35:00.771 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-21T03:35:00.772 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/ 2024-09-21T03:35:00.773 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-21T03:35:00.774 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-21T03:35:00.775 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-21T03:35:00.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-21T03:35:00.778 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-21T03:35:00.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-21T03:35:00.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-21T03:35:00.779 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-21T03:35:00.780 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-21T03:35:00.781 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sh/ 2024-09-21T03:35:00.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-21T03:35:00.783 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-21T03:35:00.785 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-21T03:35:00.786 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/ 2024-09-21T03:35:00.786 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-21T03:35:00.787 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-21T03:35:00.788 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-21T03:35:00.789 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-21T03:35:00.790 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-21T03:35:00.791 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-21T03:35:00.792 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-21T03:35:00.793 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-21T03:35:00.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-21T03:35:00.794 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-21T03:35:00.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-21T03:35:00.796 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-21T03:35:00.798 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-21T03:35:00.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-21T03:35:00.799 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-21T03:35:00.800 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-21T03:35:00.801 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-21T03:35:00.802 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-21T03:35:00.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-21T03:35:00.803 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-21T03:35:00.804 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-21T03:35:00.805 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-21T03:35:00.806 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-21T03:35:00.807 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-21T03:35:00.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-21T03:35:00.808 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-21T03:35:00.809 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-21T03:35:00.810 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-21T03:35:00.811 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-21T03:35:00.812 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-21T03:35:00.813 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-21T03:35:00.814 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-21T03:35:00.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-21T03:35:00.815 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-21T03:35:00.816 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-21T03:35:00.817 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-21T03:35:00.818 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-21T03:35:00.819 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-21T03:35:00.820 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-21T03:35:00.821 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-21T03:35:00.822 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-21T03:35:00.823 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-21T03:35:00.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-21T03:35:00.825 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-21T03:35:00.826 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-21T03:35:00.827 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-21T03:35:00.828 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-21T03:35:00.829 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-21T03:35:00.830 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-21T03:35:00.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-21T03:35:00.832 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-21T03:35:00.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-21T03:35:00.834 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-21T03:35:00.835 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-21T03:35:00.836 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-21T03:35:00.837 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-21T03:35:00.838 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-21T03:35:00.839 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-21T03:35:00.840 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-21T03:35:00.841 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-21T03:35:00.842 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-21T03:35:00.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-21T03:35:00.843 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-21T03:35:00.844 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/ 2024-09-21T03:35:00.845 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-21T03:35:00.846 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-21T03:35:00.847 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-21T03:35:00.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-21T03:35:00.848 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-21T03:35:00.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-21T03:35:00.850 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-21T03:35:00.851 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-21T03:35:00.852 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-21T03:35:00.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-21T03:35:00.853 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-21T03:35:00.854 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-21T03:35:00.855 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-21T03:35:00.857 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-21T03:35:00.859 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-21T03:35:00.861 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-21T03:35:00.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-21T03:35:00.862 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-21T03:35:00.863 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-21T03:35:00.864 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-21T03:35:00.866 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-21T03:35:00.867 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-21T03:35:00.868 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-21T03:35:00.869 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-21T03:35:00.870 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-21T03:35:00.871 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-21T03:35:00.873 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-21T03:35:00.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/target/ 2024-09-21T03:35:00.874 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-21T03:35:00.876 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-21T03:35:00.877 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-21T03:35:00.878 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-21T03:35:00.879 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-21T03:35:00.880 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-21T03:35:00.881 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-21T03:35:00.882 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-21T03:35:00.884 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-21T03:35:00.885 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-21T03:35:00.886 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-21T03:35:00.887 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-21T03:35:00.888 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/ 2024-09-21T03:35:00.889 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-21T03:35:00.890 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-21T03:35:00.891 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-21T03:35:00.893 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-21T03:35:00.894 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-21T03:35:00.895 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-21T03:35:00.896 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-21T03:35:00.897 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-21T03:35:00.898 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-21T03:35:00.899 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-21T03:35:00.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-21T03:35:00.901 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-21T03:35:00.903 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-21T03:35:00.904 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/ 2024-09-21T03:35:00.905 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-21T03:35:00.906 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-21T03:35:00.907 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-21T03:35:00.908 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-21T03:35:00.909 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-21T03:35:00.910 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-21T03:35:00.911 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-21T03:35:00.915 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-21T03:35:00.915 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-21T03:35:00.916 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-21T03:35:00.917 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-21T03:35:00.918 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-21T03:35:00.919 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-21T03:35:00.920 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-21T03:35:00.921 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-21T03:35:00.922 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-21T03:35:00.923 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-21T03:35:00.924 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-21T03:35:00.925 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-21T03:35:00.926 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-21T03:35:00.928 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/ 2024-09-21T03:35:00.929 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-21T03:35:00.930 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-21T03:35:00.931 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-21T03:35:00.932 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-21T03:35:00.933 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-21T03:35:00.934 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-21T03:35:00.935 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-21T03:35:00.936 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-21T03:35:00.937 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-21T03:35:00.939 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-21T03:35:00.940 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-21T03:35:00.941 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-21T03:35:00.942 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-21T03:35:00.943 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-21T03:35:00.944 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-21T03:35:00.945 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-21T03:35:00.946 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-21T03:35:00.948 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-21T03:35:00.949 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-21T03:35:00.950 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-21T03:35:00.951 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-21T03:35:00.952 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-21T03:35:00.952 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:00 smithi102 ceph-mon[31392]: pgmap v367: 97 pgs: 97 active+clean; 74 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 24 op/s 2024-09-21T03:35:00.953 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-21T03:35:00.954 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-21T03:35:00.955 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-21T03:35:00.957 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-21T03:35:00.958 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-21T03:35:00.959 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-21T03:35:00.960 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-21T03:35:00.961 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-21T03:35:00.962 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-21T03:35:00.963 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-21T03:35:00.965 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-21T03:35:00.966 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-21T03:35:00.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:00 smithi148 ceph-mon[34651]: pgmap v367: 97 pgs: 97 active+clean; 74 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 24 op/s 2024-09-21T03:35:01.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:00 smithi121 ceph-mon[34316]: pgmap v367: 97 pgs: 97 active+clean; 74 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 6.1 MiB/s wr, 24 op/s 2024-09-21T03:35:01.147 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-21T03:35:01.248 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-21T03:35:01.249 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-21T03:35:01.249 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-21T03:35:01.250 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-21T03:35:01.251 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-21T03:35:01.252 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-21T03:35:01.253 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-21T03:35:01.254 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-21T03:35:01.255 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-21T03:35:01.256 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-21T03:35:01.257 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-21T03:35:01.258 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-21T03:35:01.259 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-21T03:35:01.260 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-21T03:35:01.261 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-21T03:35:01.262 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-21T03:35:01.263 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-21T03:35:01.264 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-21T03:35:01.265 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-21T03:35:01.266 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-21T03:35:01.267 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-21T03:35:01.268 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-21T03:35:01.269 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-21T03:35:01.270 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-21T03:35:01.271 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-21T03:35:01.272 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-21T03:35:01.273 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-21T03:35:01.274 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-21T03:35:01.275 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-21T03:35:01.275 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-21T03:35:01.276 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-21T03:35:01.277 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-21T03:35:01.278 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-21T03:35:01.279 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-21T03:35:01.280 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-21T03:35:01.281 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-21T03:35:01.282 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-21T03:35:01.283 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-21T03:35:01.284 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-21T03:35:01.284 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-21T03:35:01.285 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-21T03:35:01.286 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-21T03:35:01.287 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-21T03:35:01.288 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-21T03:35:01.289 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-21T03:35:01.290 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-21T03:35:01.290 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-21T03:35:01.291 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-21T03:35:01.292 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-21T03:35:01.293 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-21T03:35:01.294 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-21T03:35:01.295 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-21T03:35:01.296 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-21T03:35:01.297 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-21T03:35:01.298 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-21T03:35:01.299 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-21T03:35:01.300 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-21T03:35:01.301 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-21T03:35:01.302 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-21T03:35:01.303 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-21T03:35:01.304 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-21T03:35:01.304 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-21T03:35:01.305 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-21T03:35:01.306 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-21T03:35:01.307 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-21T03:35:01.308 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-21T03:35:01.309 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-21T03:35:01.310 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-21T03:35:01.311 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-21T03:35:01.312 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-21T03:35:01.313 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-21T03:35:01.314 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-21T03:35:01.315 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-21T03:35:01.316 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-21T03:35:01.317 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-21T03:35:01.317 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-21T03:35:01.318 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-21T03:35:01.319 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-21T03:35:01.320 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-21T03:35:01.321 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-21T03:35:01.322 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-21T03:35:01.323 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-21T03:35:01.323 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-21T03:35:01.324 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-21T03:35:01.325 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-21T03:35:01.326 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-21T03:35:01.327 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-21T03:35:01.328 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-21T03:35:01.329 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-21T03:35:01.330 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-21T03:35:01.331 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-21T03:35:01.332 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-21T03:35:01.333 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-21T03:35:01.334 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-21T03:35:01.336 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-21T03:35:01.337 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-21T03:35:01.338 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-21T03:35:01.338 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-21T03:35:01.339 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-21T03:35:01.340 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-21T03:35:01.341 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-21T03:35:01.342 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-21T03:35:01.343 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-21T03:35:01.344 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-21T03:35:01.345 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-21T03:35:01.346 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-21T03:35:01.347 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-21T03:35:01.348 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-21T03:35:01.349 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-21T03:35:01.350 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-21T03:35:01.351 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-21T03:35:01.352 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-21T03:35:01.353 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-21T03:35:01.354 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-21T03:35:01.355 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-21T03:35:01.357 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/ 2024-09-21T03:35:01.359 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-21T03:35:01.360 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-21T03:35:01.361 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-21T03:35:01.362 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-21T03:35:01.363 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-21T03:35:01.364 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-21T03:35:01.365 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-21T03:35:01.366 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-21T03:35:01.367 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-21T03:35:01.368 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-21T03:35:01.369 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-21T03:35:01.370 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-21T03:35:01.372 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-21T03:35:01.373 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-21T03:35:01.374 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-21T03:35:01.375 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-21T03:35:01.376 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-21T03:35:01.377 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-21T03:35:01.377 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-21T03:35:01.378 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-21T03:35:01.379 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-21T03:35:01.380 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-21T03:35:01.381 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-21T03:35:01.382 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-21T03:35:01.383 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-21T03:35:01.384 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/ 2024-09-21T03:35:01.385 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-21T03:35:01.386 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-21T03:35:01.387 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-21T03:35:01.388 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-21T03:35:01.389 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-21T03:35:01.390 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-21T03:35:01.391 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-21T03:35:01.394 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-21T03:35:01.394 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-21T03:35:01.394 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-21T03:35:01.394 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-21T03:35:01.396 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-21T03:35:01.397 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-21T03:35:01.397 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-21T03:35:01.398 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-21T03:35:01.399 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-21T03:35:01.400 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-21T03:35:01.401 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-21T03:35:01.402 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-21T03:35:01.403 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-21T03:35:01.404 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-21T03:35:01.405 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-21T03:35:01.406 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-21T03:35:01.407 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-21T03:35:01.408 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-21T03:35:01.409 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-21T03:35:01.410 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-21T03:35:01.412 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-21T03:35:01.412 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-21T03:35:01.413 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-21T03:35:01.414 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-21T03:35:01.415 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-21T03:35:01.416 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-21T03:35:01.417 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-21T03:35:01.418 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/ 2024-09-21T03:35:01.419 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-21T03:35:01.420 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-21T03:35:01.421 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-21T03:35:01.422 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-21T03:35:01.423 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-21T03:35:01.424 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-21T03:35:01.425 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-21T03:35:01.426 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-21T03:35:01.427 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-21T03:35:01.428 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-21T03:35:01.429 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-21T03:35:01.430 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-21T03:35:01.431 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-21T03:35:01.433 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-21T03:35:01.434 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-21T03:35:01.434 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-21T03:35:01.435 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-21T03:35:01.436 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-21T03:35:01.437 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-21T03:35:01.438 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-21T03:35:01.439 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-21T03:35:01.440 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-21T03:35:01.441 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-21T03:35:01.442 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-21T03:35:01.443 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-21T03:35:01.444 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-21T03:35:01.445 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-21T03:35:01.446 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-21T03:35:01.447 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-21T03:35:01.448 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-21T03:35:01.449 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-21T03:35:01.450 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-21T03:35:01.451 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-21T03:35:01.452 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-21T03:35:01.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-21T03:35:01.454 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-21T03:35:01.455 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-21T03:35:01.456 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-21T03:35:01.457 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-21T03:35:01.458 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-21T03:35:01.459 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-21T03:35:01.460 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-21T03:35:01.461 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-21T03:35:01.462 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-21T03:35:01.463 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-21T03:35:01.464 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-21T03:35:01.465 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-21T03:35:01.466 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-21T03:35:01.467 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-21T03:35:01.468 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-21T03:35:01.469 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-21T03:35:01.470 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-21T03:35:01.471 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-21T03:35:01.472 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-21T03:35:01.473 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-21T03:35:01.474 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-21T03:35:01.475 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-21T03:35:01.476 INFO:tasks.workunit.client.0.smithi102.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-21T03:35:02.054 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:35:02.306 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 -- 172.21.15.102:0/2206026951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 msgr2=0x7f6fd0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/2206026951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd0102e70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009900 tx=0x7f6fc402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 -- 172.21.15.102:0/2206026951 shutdown_connections 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/2206026951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/2206026951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 0x7f6fd01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/2206026951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd0102e70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 -- 172.21.15.102:0/2206026951 >> 172.21.15.102:0/2206026951 conn(0x7f6fd0079730 msgr2=0x7f6fd0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 -- 172.21.15.102:0/2206026951 shutdown_connections 2024-09-21T03:35:02.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.956+0000 7f6fd70dc640 1 -- 172.21.15.102:0/2206026951 wait complete. 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 Processor -- start 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 -- start start 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 0x7f6fd019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0112aa0 con 0x7f6fd0102a60 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0112920 con 0x7f6fd01083a0 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd70dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd0112c20 con 0x7f6fd0108cf0 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd4e78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd4e78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45882/0 (socket says 172.21.15.102:45882) 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd4e78640 1 -- 172.21.15.102:0/1127919744 learned_addr learned my addr 172.21.15.102:0/1127919744 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fcffff640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 0x7f6fd019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.957+0000 7f6fd5679640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 -- 172.21.15.102:0/1127919744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 msgr2=0x7f6fd019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 -- 172.21.15.102:0/1127919744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 msgr2=0x7f6fd019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 0x7f6fd019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 -- 172.21.15.102:0/1127919744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fd01a04f0 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd5679640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4005ab0 tx=0x7f6fc40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fcdffb640 1 -- 172.21.15.102:0/1127919744 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc403f030 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fcdffb640 1 -- 172.21.15.102:0/1127919744 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6fc4003cd0 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fd01a0780 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fcdffb640 1 -- 172.21.15.102:0/1127919744 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4035070 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.958+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fd01a6f40 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fcdffb640 1 -- 172.21.15.102:0/1127919744 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f6fc4042030 con 0x7f6fd0102a60 2024-09-21T03:35:02.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 Processor -- start 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 -- start start 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc501b0 0x55736c020b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc58390 0x55736c0210d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55736bf96e50 con 0x55736bc79070 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55736bf86280 con 0x55736bc58390 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fdd650740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55736bf8a090 con 0x55736bc501b0 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45898/0 (socket says 172.21.15.102:45898) 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fd5679640 1 -- 172.21.15.102:0/382554661 learned_addr learned my addr 172.21.15.102:0/382554661 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.961+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc501b0 0x55736c020b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fcffff640 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc58390 0x55736c0210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 -- 172.21.15.102:0/382554661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc501b0 msgr2=0x55736c020b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc501b0 0x55736c020b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 -- 172.21.15.102:0/382554661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc58390 msgr2=0x55736c0210d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc58390 0x55736c0210d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 -- 172.21.15.102:0/382554661 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55736bce4650 con 0x55736bc79070 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fcdffb640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 0x7f6fc00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fcdffb640 1 -- 172.21.15.102:0/1127919744 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6fc4107c50 con 0x7f6fd0102a60 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.962+0000 7f6fd5679640 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009f30 tx=0x7f6fc8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357b43c3094f1986 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.963+0000 7f6fbaffd640 1 -- 172.21.15.102:0/382554661 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8016070 con 0x55736bc79070 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.963+0000 7f6fbaffd640 1 -- 172.21.15.102:0/382554661 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6fc801bb30 con 0x55736bc79070 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.963+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 0x7f6fc00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.963+0000 7f6fbaffd640 1 -- 172.21.15.102:0/382554661 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8012c20 con 0x55736bc79070 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- 172.21.15.102:0/382554661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 msgr2=0x55736c020650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:02.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fd4e78640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 0x7f6fc00b8b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4105440 tx=0x7f6fc410b7a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009f30 tx=0x7f6fc8010800 comp rx=0 tx=0).stop 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- 172.21.15.102:0/382554661 shutdown_connections 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc58390 0x55736c0210d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc501b0 0x55736c020b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 --2- 172.21.15.102:0/382554661 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc79070 0x55736c020650 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- 172.21.15.102:0/382554661 >> 172.21.15.102:0/382554661 conn(0x55736bc6d460 msgr2=0x55736c01e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- 172.21.15.102:0/382554661 shutdown_connections 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- 172.21.15.102:0/382554661 wait complete. 2024-09-21T03:35:02.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 -- start start 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.964+0000 7f6fdd650740 1 Processor -- start 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c02c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c038170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55736bde7700 con 0x55736bc501b0 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55736bf21110 con 0x55736bc79070 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55736c02ee80 con 0x55736bc58390 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fdd650740 10 client.0 _ll_register_callbacks cb 0x55736bf3a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45900/0 (socket says 172.21.15.102:45900) 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 -- 172.21.15.102:0/2274716750 learned_addr learned my addr 172.21.15.102:0/2274716750 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c038170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c02c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 -- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 msgr2=0x55736c02c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c02c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 -- 172.21.15.102:0/2274716750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 msgr2=0x55736c038170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c038170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 -- 172.21.15.102:0/2274716750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55736bf4ec40 con 0x55736bc501b0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8012800 tx=0x7f6fc8012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaf92a7ced02fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.965+0000 7f6faffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8016070 con 0x55736bc501b0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6fc8012c00 con 0x55736bc501b0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fc801bb30 con 0x55736bc501b0 2024-09-21T03:35:02.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6fc801b670 con 0x55736bc501b0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 10 client.15648 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55736c03ab70 con 0x55736bc501b0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6fc801bb30 con 0x55736bc501b0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6fc801bce0 con 0x55736bc501b0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 10 client.15648 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 20 client.15648 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc379f0 0x55736c03ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 4 client.15648 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.966+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55736bf98da0 con 0x55736bc379f0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.967+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc379f0 0x55736c03ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.967+0000 7f6faffff640 10 client.15648 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.967+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc379f0 0x55736c03ded0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d803b5e25728e90a server_cookie=340c9ab37ecf4b13 in_seq=0 out_seq=0 2024-09-21T03:35:02.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6faffff640 1 -- 172.21.15.102:0/2274716750 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55736bf98da0 con 0x55736bc379f0 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6faffff640 10 client.15648 handle_command_reply: tid=0 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 client.15648 shutdown 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 msgr2=0x55736c02bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8012800 tx=0x7f6fc8012700 comp rx=0 tx=0).stop 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 shutdown_connections 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c038170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c02c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc379f0 0x55736c03ded0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2274716750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c02bcf0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 >> 172.21.15.102:0/2274716750 conn(0x55736bc6d460 msgr2=0x55736c021680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6faffff640 0 client.15648 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 shutdown_connections 2024-09-21T03:35:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 1 -- 172.21.15.102:0/2274716750 wait complete. 2024-09-21T03:35:02.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.968+0000 7f6fdd650740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T03:35:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 Processor -- start 2024-09-21T03:35:02.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 -- start start 2024-09-21T03:35:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 0x55736c02dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc79070 0x55736c0380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01b2150 con 0x55736bc58390 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01afa20 con 0x55736bc501b0 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.992+0000 7f6fdd650740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01ad870 con 0x55736bc79070 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45910/0 (socket says 172.21.15.102:45910) 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 -- 172.21.15.102:0/3118380368 learned_addr learned my addr 172.21.15.102:0/3118380368 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fd5679640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc79070 0x55736c0380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fd5679640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 0x55736c02dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 -- 172.21.15.102:0/3118380368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc79070 msgr2=0x55736c0380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc79070 0x55736c0380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 -- 172.21.15.102:0/3118380368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 msgr2=0x55736c02dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:02.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 0x55736c02dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 -- 172.21.15.102:0/3118380368 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55736c02cfb0 con 0x55736bc58390 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fd5679640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 0x55736c02dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fcffff640 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a960 tx=0x7f6fbc00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b086a105eb535fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fba7fc640 1 -- 172.21.15.102:0/3118380368 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0142d0 con 0x55736bc58390 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fba7fc640 1 -- 172.21.15.102:0/3118380368 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6fbc012920 con 0x55736bc58390 2024-09-21T03:35:02.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.993+0000 7f6fba7fc640 1 -- 172.21.15.102:0/3118380368 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0119f0 con 0x55736bc58390 2024-09-21T03:35:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 -- 172.21.15.102:0/3118380368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 msgr2=0x55736c021d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc00a960 tx=0x7f6fbc00a2d0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 -- 172.21.15.102:0/3118380368 shutdown_connections 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc58390 0x55736c021d90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc79070 0x55736c0380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 --2- 172.21.15.102:0/3118380368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc501b0 0x55736c02dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 -- 172.21.15.102:0/3118380368 >> 172.21.15.102:0/3118380368 conn(0x55736bc6d460 msgr2=0x55736c021680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 -- 172.21.15.102:0/3118380368 shutdown_connections 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.994+0000 7f6fdd650740 1 -- 172.21.15.102:0/3118380368 wait complete. 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 -- start start 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 Processor -- start 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c03e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c03ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01adee0 con 0x55736bc501b0 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01af350 con 0x55736bc79070 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.995+0000 7f6fdd650740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6fd01ae5b0 con 0x55736bc58390 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fdd650740 10 client.0 _ll_register_callbacks cb 0x7f6fc410b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45920/0 (socket says 172.21.15.102:45920) 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 -- 172.21.15.102:0/2708839988 learned_addr learned my addr 172.21.15.102:0/2708839988 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c03e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c03ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 -- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 msgr2=0x55736c03e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c03e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 -- 172.21.15.102:0/2708839988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 msgr2=0x55736c03ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c03ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 -- 172.21.15.102:0/2708839988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55736c03f4f0 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fd5679640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000f80 tx=0x7f6fc8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e2922c384e223d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6faffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8038040 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6fc8012e00 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.996+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fbc012920 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6fc8046050 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 10 client.15654 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55736c0a8340 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6fbc012920 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f6fc800f040 con 0x55736bc501b0 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 10 client.15654 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 20 client.15654 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:03.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc0cda0 0x55736c0aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 4 client.15654 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55736bf94850 con 0x55736bc0cda0 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.997+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc0cda0 0x55736c0aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6faffff640 10 client.15654 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fcffff640 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc0cda0 0x55736c0aaa20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30574c32a53ce1e server_cookie=6b6c011d51cbdfd0 in_seq=0 out_seq=0 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6faffff640 1 -- 172.21.15.102:0/2708839988 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x55736bf94850 con 0x55736bc0cda0 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6faffff640 10 client.15654 handle_command_reply: tid=0 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 client.15654 shutdown 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 msgr2=0x55736c041520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000f80 tx=0x7f6fc8009280 comp rx=0 tx=0).stop 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 shutdown_connections 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55736bc79070 0x55736c03ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55736bc58390 0x55736c03e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55736bc0cda0 0x55736c0aaa20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6faffff640 0 client.15654 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 --2- 172.21.15.102:0/2708839988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55736bc501b0 0x55736c041520 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 >> 172.21.15.102:0/2708839988 conn(0x55736bc6d460 msgr2=0x55736c021f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.998+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 shutdown_connections 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fdd650740 1 -- 172.21.15.102:0/2708839988 wait complete. 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fdd650740 20 client.15654 trim_cache size 0 max 16384 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:35:03.005 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:03.006 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 msgr2=0x7f6fc00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 0x7f6fc00b8b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4105440 tx=0x7f6fc410b7a0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 msgr2=0x7f6fd019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4005ab0 tx=0x7f6fc40042f0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 shutdown_connections 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6fc00b6680 0x7f6fc00b8b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6fd0108cf0 0x7f6fd019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fd01083a0 0x7f6fd019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 --2- 172.21.15.102:0/1127919744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6fd0102a60 0x7f6fd019a580 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 >> 172.21.15.102:0/1127919744 conn(0x7f6fd0079730 msgr2=0x7f6fd01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:02.999+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 shutdown_connections 2024-09-21T03:35:03.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:03.000+0000 7f6fd70dc640 1 -- 172.21.15.102:0/1127919744 wait complete. 2024-09-21T03:35:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:03 smithi102 ceph-mon[31392]: pgmap v368: 97 pgs: 97 active+clean; 86 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.1 MiB/s wr, 32 op/s 2024-09-21T03:35:03.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:03 smithi148 ceph-mon[34651]: pgmap v368: 97 pgs: 97 active+clean; 86 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.1 MiB/s wr, 32 op/s 2024-09-21T03:35:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:03 smithi121 ceph-mon[34316]: pgmap v368: 97 pgs: 97 active+clean; 86 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 7.1 MiB/s wr, 32 op/s 2024-09-21T03:35:03.842 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:35:03.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:35:04.100 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:04.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 -- 172.21.15.102:0/3734606777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 msgr2=0x7f469c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 --2- 172.21.15.102:0/3734606777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102380 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f468c009900 tx=0x7f468c02a410 comp rx=0 tx=0).stop 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 -- 172.21.15.102:0/3734606777 shutdown_connections 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 --2- 172.21.15.102:0/3734606777 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 --2- 172.21.15.102:0/3734606777 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 --2- 172.21.15.102:0/3734606777 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102380 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 -- 172.21.15.102:0/3734606777 >> 172.21.15.102:0/3734606777 conn(0x7f469c077c60 msgr2=0x7f469c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 -- 172.21.15.102:0/3734606777 shutdown_connections 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.625+0000 7f46a0868640 1 -- 172.21.15.102:0/3734606777 wait complete. 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 Processor -- start 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 -- start start 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:04.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f469c113c00 con 0x7f469c101f70 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f469c113a80 con 0x7f469c1094b0 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.626+0000 7f46a0868640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f469c113d80 con 0x7f469c109e00 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57118/0 (socket says 172.21.15.102:57118) 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 -- 172.21.15.102:0/1444740625 learned_addr learned my addr 172.21.15.102:0/1444740625 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f4699d9b640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 -- 172.21.15.102:0/1444740625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 msgr2=0x7f469c103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469ad9d640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 -- 172.21.15.102:0/1444740625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 msgr2=0x7f469c103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 -- 172.21.15.102:0/1444740625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c1a88b0 con 0x7f469c101f70 2024-09-21T03:35:04.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f4699d9b640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469ad9d640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f469a59c640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f468c005ab0 tx=0x7f468c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03f030 con 0x7f469c101f70 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c1a8b40 con 0x7f469c101f70 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f468c003cd0 con 0x7f469c101f70 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.627+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c035070 con 0x7f469c101f70 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.628+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c1a9070 con 0x7f469c101f70 2024-09-21T03:35:04.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.629+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c102380 con 0x7f469c101f70 2024-09-21T03:35:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.630+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f468c042030 con 0x7f469c101f70 2024-09-21T03:35:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.631+0000 7f468b7fe640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 0x7f46840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.631+0000 7f4699d9b640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 0x7f46840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.631+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f468c107f90 con 0x7f469c101f70 2024-09-21T03:35:04.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.632+0000 7f4699d9b640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 0x7f46840b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f469c109c00 tx=0x7f4690005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:04.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.634+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f468c0ce4d0 con 0x7f469c101f70 2024-09-21T03:35:04.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.859+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f469c02e640 con 0x7f469c101f70 2024-09-21T03:35:04.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.860+0000 7f468b7fe640 1 -- 172.21.15.102:0/1444740625 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11933 (secure 0 0 0) 0x7f468c0d28b0 con 0x7f469c101f70 2024-09-21T03:35:04.863 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:35:04.863 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":24,"btime":"2024-09-21T03:33:38:357326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:33:37.868919+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:35:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 24 2024-09-21T03:35:04.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.862+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 msgr2=0x7f46840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.862+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 0x7f46840b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f469c109c00 tx=0x7f4690005e50 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.862+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 msgr2=0x7f469c102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.862+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f468c005ab0 tx=0x7f468c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 shutdown_connections 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f46840b6680 0x7f46840b8b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f469c109e00 0x7f469c103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f469c1094b0 0x7f469c103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 --2- 172.21.15.102:0/1444740625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f469c101f70 0x7f469c102f10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 >> 172.21.15.102:0/1444740625 conn(0x7f469c077c60 msgr2=0x7f469c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 shutdown_connections 2024-09-21T03:35:04.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:04.863+0000 7f46a0868640 1 -- 172.21.15.102:0/1444740625 wait complete. 2024-09-21T03:35:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:05 smithi102 ceph-mon[31392]: pgmap v369: 97 pgs: 97 active+clean; 87 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-09-21T03:35:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:05 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1444740625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:05.515 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:35:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:05 smithi148 ceph-mon[34651]: pgmap v369: 97 pgs: 97 active+clean; 87 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-09-21T03:35:05.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:05 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1444740625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:05.772 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:05 smithi121 ceph-mon[34316]: pgmap v369: 97 pgs: 97 active+clean; 87 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 7.2 MiB/s wr, 33 op/s 2024-09-21T03:35:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:05 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1444740625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:06.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 -- 172.21.15.102:0/570082605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42441021f0 msgr2=0x7f4244102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 --2- 172.21.15.102:0/570082605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42441021f0 0x7f4244102600 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f423402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:06.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 -- 172.21.15.102:0/570082605 shutdown_connections 2024-09-21T03:35:06.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 --2- 172.21.15.102:0/570082605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244108480 0x7f424410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 --2- 172.21.15.102:0/570082605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4244107b30 0x7f4244107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 --2- 172.21.15.102:0/570082605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42441021f0 0x7f4244102600 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 -- 172.21.15.102:0/570082605 >> 172.21.15.102:0/570082605 conn(0x7f4244077c60 msgr2=0x7f42440780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 -- 172.21.15.102:0/570082605 shutdown_connections 2024-09-21T03:35:06.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.275+0000 7f4249eea640 1 -- 172.21.15.102:0/570082605 wait complete. 2024-09-21T03:35:06.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 Processor -- start 2024-09-21T03:35:06.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 -- start start 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42441021f0 0x7f424419b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 0x7f424419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4244112ae0 con 0x7f4244108480 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4244112960 con 0x7f42441021f0 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4249eea640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4244112c60 con 0x7f4244107b30 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4243fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4243fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57136/0 (socket says 172.21.15.102:57136) 2024-09-21T03:35:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 0x7f424419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f4243fff640 1 -- 172.21.15.102:0/2211512272 learned_addr learned my addr 172.21.15.102:0/2211512272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.276+0000 7f42437fe640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42441021f0 0x7f424419b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 -- 172.21.15.102:0/2211512272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 msgr2=0x7f424419b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 0x7f424419b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 -- 172.21.15.102:0/2211512272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42441021f0 msgr2=0x7f424419b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42441021f0 0x7f424419b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 -- 172.21.15.102:0/2211512272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42441a6660 con 0x7f4244108480 2024-09-21T03:35:06.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4242ffd640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 0x7f424419b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4243fff640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f423c00eaa0 tx=0x7f423c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4240ff9640 1 -- 172.21.15.102:0/2211512272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c00cdb0 con 0x7f4244108480 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4244199220 con 0x7f4244108480 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4240ff9640 1 -- 172.21.15.102:0/2211512272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f423c005020 con 0x7f4244108480 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4240ff9640 1 -- 172.21.15.102:0/2211512272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c0116d0 con 0x7f4244108480 2024-09-21T03:35:06.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.277+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4244199710 con 0x7f4244108480 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 Processor -- start 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f4240ff9640 1 -- 172.21.15.102:0/2211512272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f423c0051d0 con 0x7f4244108480 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 -- start start 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a161b0 0x559225de6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225de7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559225d5cea0 con 0x559225a3f070 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559225d4c2d0 con 0x559225a161b0 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.280+0000 7f425045e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559225d500e0 con 0x559225a1e390 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57152/0 (socket says 172.21.15.102:57152) 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 -- 172.21.15.102:0/986467437 learned_addr learned my addr 172.21.15.102:0/986467437 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225de7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f42437fe640 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a161b0 0x559225de6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 -- 172.21.15.102:0/986467437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 msgr2=0x559225de7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225de7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 -- 172.21.15.102:0/986467437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a161b0 msgr2=0x559225de6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a161b0 0x559225de6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 -- 172.21.15.102:0/986467437 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559225aaa650 con 0x559225a3f070 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4240ff9640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 0x7f422c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4242ffd640 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f423800b620 tx=0x7f423800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8fad24a7220896 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f42437fe640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 0x7f422c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.281+0000 7f4240ff9640 1 -- 172.21.15.102:0/2211512272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f423c0e7870 con 0x7f4244108480 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.282+0000 7f4229ffb640 1 -- 172.21.15.102:0/986467437 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238004020 con 0x559225a3f070 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.282+0000 7f4229ffb640 1 -- 172.21.15.102:0/986467437 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f423800eda0 con 0x559225a3f070 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.282+0000 7f4229ffb640 1 -- 172.21.15.102:0/986467437 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238005440 con 0x559225a3f070 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.282+0000 7f425045e740 1 -- 172.21.15.102:0/986467437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 msgr2=0x559225de66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.282+0000 7f42437fe640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 0x7f422c0b8bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42441101d0 tx=0x7f42340058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f423800b620 tx=0x7f423800bbd0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 -- 172.21.15.102:0/986467437 shutdown_connections 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225de7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a161b0 0x559225de6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 --2- 172.21.15.102:0/986467437 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a3f070 0x559225de66a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 -- 172.21.15.102:0/986467437 >> 172.21.15.102:0/986467437 conn(0x559225a33460 msgr2=0x559225de4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 -- 172.21.15.102:0/986467437 shutdown_connections 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 -- 172.21.15.102:0/986467437 wait complete. 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 -- start start 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.283+0000 7f425045e740 1 Processor -- start 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225df22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225dfe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559225bad700 con 0x559225a161b0 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559225ce7160 con 0x559225a3f070 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559225df4e80 con 0x559225a1e390 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f425045e740 10 client.0 _ll_register_callbacks cb 0x559225d009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:06.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57154/0 (socket says 172.21.15.102:57154) 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 -- 172.21.15.102:0/4275251539 learned_addr learned my addr 172.21.15.102:0/4275251539 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f4243fff640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225dfe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f4242ffd640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225df22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 -- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 msgr2=0x559225df22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225df22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 -- 172.21.15.102:0/4275251539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 msgr2=0x559225dfe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225dfe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f42437fe640 1 -- 172.21.15.102:0/4275251539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559225d14c90 con 0x559225a161b0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.284+0000 7f4242ffd640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225df22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f42437fe640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f4234009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955062704b9e6ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423404c030 con 0x559225a161b0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f4234004250 con 0x559225a161b0 2024-09-21T03:35:06.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423800eda0 con 0x559225a161b0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4234035040 con 0x559225a161b0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f425045e740 10 client.15672 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559225e00b70 con 0x559225a161b0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f423800eda0 con 0x559225a161b0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.285+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4234048560 con 0x559225a161b0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 10 client.15672 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 10 client.15672 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 20 client.15672 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259fd9f0 0x559225e04110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 4 client.15672 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559225d5edf0 con 0x5592259fd9f0 2024-09-21T03:35:06.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f4242ffd640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259fd9f0 0x559225e04110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f4222ffd640 10 client.15672 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.286+0000 7f4242ffd640 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259fd9f0 0x559225e04110 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd0f6891c8fa6372 server_cookie=34874455e7127c0a in_seq=0 out_seq=0 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f4222ffd640 1 -- 172.21.15.102:0/4275251539 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559225d5edf0 con 0x5592259fd9f0 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f4222ffd640 10 client.15672 handle_command_reply: tid=0 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f425045e740 1 client.15672 shutdown 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 msgr2=0x559225df1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4234009900 tx=0x7f4234009260 comp rx=0 tx=0).stop 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 shutdown_connections 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.287+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259fd9f0 0x559225e04110 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225dfe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f4222ffd640 0 client.15672 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:06.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a1e390 0x559225df22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 --2- 172.21.15.102:0/4275251539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a161b0 0x559225df1da0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 >> 172.21.15.102:0/4275251539 conn(0x559225a33460 msgr2=0x559225de9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 shutdown_connections 2024-09-21T03:35:06.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 1 -- 172.21.15.102:0/4275251539 wait complete. 2024-09-21T03:35:06.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.288+0000 7f425045e740 20 client.15672 trim_cache size 0 max 16384 2024-09-21T03:35:06.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 Processor -- start 2024-09-21T03:35:06.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 -- start start 2024-09-21T03:35:06.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5592259fd9f0 0x559225df0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225de3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42441b4420 con 0x559225a1e390 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42441b1cf0 con 0x559225a3f070 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.301+0000 7f425045e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42441afb40 con 0x5592259fd9f0 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57160/0 (socket says 172.21.15.102:57160) 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 -- 172.21.15.102:0/1749587635 learned_addr learned my addr 172.21.15.102:0/1749587635 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4243fff640 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225de3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f42437fe640 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5592259fd9f0 0x559225df0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 -- 172.21.15.102:0/1749587635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5592259fd9f0 msgr2=0x559225df0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5592259fd9f0 0x559225df0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 -- 172.21.15.102:0/1749587635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 msgr2=0x559225de3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225de3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 -- 172.21.15.102:0/1749587635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559225dec9d0 con 0x559225a1e390 2024-09-21T03:35:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f4242ffd640 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f42380128b0 tx=0x7f423800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0b8164748ca19a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f42297fa640 1 -- 172.21.15.102:0/1749587635 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423802d020 con 0x559225a1e390 2024-09-21T03:35:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f42297fa640 1 -- 172.21.15.102:0/1749587635 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f423800eda0 con 0x559225a1e390 2024-09-21T03:35:06.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.302+0000 7f42297fa640 1 -- 172.21.15.102:0/1749587635 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4238004660 con 0x559225a1e390 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 -- 172.21.15.102:0/1749587635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 msgr2=0x559225de7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f42380128b0 tx=0x7f423800bf90 comp rx=0 tx=0).stop 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 -- 172.21.15.102:0/1749587635 shutdown_connections 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559225a1e390 0x559225de7de0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a3f070 0x559225de3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 --2- 172.21.15.102:0/1749587635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5592259fd9f0 0x559225df0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 -- 172.21.15.102:0/1749587635 >> 172.21.15.102:0/1749587635 conn(0x559225a33460 msgr2=0x559225de76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 -- 172.21.15.102:0/1749587635 shutdown_connections 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.303+0000 7f425045e740 1 -- 172.21.15.102:0/1749587635 wait complete. 2024-09-21T03:35:06.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 -- start start 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 Processor -- start 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 0x559225df6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a3f070 0x559225df6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42441b01b0 con 0x5592259fd9f0 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42441b1620 con 0x559225a1e390 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42441b0880 con 0x559225a3f070 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f425045e740 10 client.0 _ll_register_callbacks cb 0x7f4234009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f42437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f42437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57162/0 (socket says 172.21.15.102:57162) 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.304+0000 7f42437fe640 1 -- 172.21.15.102:0/2354861788 learned_addr learned my addr 172.21.15.102:0/2354861788 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4242ffd640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 0x559225df6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4243fff640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a3f070 0x559225df6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 -- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a3f070 msgr2=0x559225df6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a3f070 0x559225df6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 -- 172.21.15.102:0/2354861788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 msgr2=0x559225df6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 0x559225df6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 -- 172.21.15.102:0/2354861788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559225e6dad0 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4242ffd640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 0x559225df6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f42437fe640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4234009230 tx=0x7f4234004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0d4723133e37f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4222ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423405d070 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f4234048650 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423800eda0 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f423404c070 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f425045e740 10 client.15678 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.305+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559225e6ec70 con 0x5592259fd9f0 2024-09-21T03:35:06.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f423800eda0 con 0x5592259fd9f0 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4234062460 con 0x5592259fd9f0 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 10 client.15678 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 10 client.15678 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 20 client.15678 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259d2da0 0x559225e713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 4 client.15678 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559225d5a8a0 con 0x5592259d2da0 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.306+0000 7f4242ffd640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259d2da0 0x559225e713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f4222ffd640 10 client.15678 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f4242ffd640 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259d2da0 0x559225e713d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3654506ad986baf5 server_cookie=ca75354c802aedc6 in_seq=0 out_seq=0 2024-09-21T03:35:06.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f4222ffd640 1 -- 172.21.15.102:0/2354861788 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559225d5a8a0 con 0x5592259d2da0 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f4222ffd640 10 client.15678 handle_command_reply: tid=0 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 client.15678 shutdown 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 msgr2=0x559225df5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4234009230 tx=0x7f4234004480 comp rx=0 tx=0).stop 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 shutdown_connections 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5592259d2da0 0x559225e713d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559225a3f070 0x559225df6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559225a1e390 0x559225df6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 --2- 172.21.15.102:0/2354861788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5592259fd9f0 0x559225df5fd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f4222ffd640 0 client.15678 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 >> 172.21.15.102:0/2354861788 conn(0x559225a33460 msgr2=0x559225de8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 shutdown_connections 2024-09-21T03:35:06.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.307+0000 7f425045e740 1 -- 172.21.15.102:0/2354861788 wait complete. 2024-09-21T03:35:06.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f425045e740 20 client.15678 trim_cache size 0 max 16384 2024-09-21T03:35:06.318 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 msgr2=0x7f422c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 0x7f422c0b8bc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f42441101d0 tx=0x7f42340058d0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 msgr2=0x7f424419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f423c00eaa0 tx=0x7f423c00ef60 comp rx=0 tx=0).stop 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 shutdown_connections 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f422c0b66b0 0x7f422c0b8bc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4244108480 0x7f424419be50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4244107b30 0x7f424419b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 --2- 172.21.15.102:0/2211512272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f42441021f0 0x7f424419b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 >> 172.21.15.102:0/2211512272 conn(0x7f4244077c60 msgr2=0x7f4244105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 shutdown_connections 2024-09-21T03:35:06.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:06.308+0000 7f4249eea640 1 -- 172.21.15.102:0/2211512272 wait complete. 2024-09-21T03:35:06.378 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-21T03:35:06.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:35:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:07.491 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar xf doc.tar 2024-09-21T03:35:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:07 smithi102 ceph-mon[31392]: pgmap v370: 97 pgs: 97 active+clean; 90 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 7.5 MiB/s wr, 52 op/s 2024-09-21T03:35:07.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:07 smithi148 ceph-mon[34651]: pgmap v370: 97 pgs: 97 active+clean; 90 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 7.5 MiB/s wr, 52 op/s 2024-09-21T03:35:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:07 smithi121 ceph-mon[34316]: pgmap v370: 97 pgs: 97 active+clean; 90 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 7.5 MiB/s wr, 52 op/s 2024-09-21T03:35:08.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 -- 172.21.15.102:0/4058106695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 msgr2=0x7f2c0c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 --2- 172.21.15.102:0/4058106695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1087b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009900 tx=0x7f2bfc02a410 comp rx=0 tx=0).stop 2024-09-21T03:35:08.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 -- 172.21.15.102:0/4058106695 shutdown_connections 2024-09-21T03:35:08.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 --2- 172.21.15.102:0/4058106695 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1087b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 --2- 172.21.15.102:0/4058106695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 --2- 172.21.15.102:0/4058106695 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 -- 172.21.15.102:0/4058106695 >> 172.21.15.102:0/4058106695 conn(0x7f2c0c079730 msgr2=0x7f2c0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 -- 172.21.15.102:0/4058106695 shutdown_connections 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.876+0000 7f2c1458f640 1 -- 172.21.15.102:0/4058106695 wait complete. 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 Processor -- start 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 -- start start 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c19ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112a80 con 0x7f2c0c1083a0 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112900 con 0x7f2c0c108cf0 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.877+0000 7f2c1458f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c112c00 con 0x7f2c0c102a60 2024-09-21T03:35:08.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57176/0 (socket says 172.21.15.102:57176) 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 -- 172.21.15.102:0/1096248460 learned_addr learned my addr 172.21.15.102:0/1096248460 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c19ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 -- 172.21.15.102:0/1096248460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 msgr2=0x7f2c0c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 -- 172.21.15.102:0/1096248460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 msgr2=0x7f2c0c19ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c19ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 -- 172.21.15.102:0/1096248460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c19f3a0 con 0x7f2c0c1083a0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c19ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005940 tx=0x7f2bfc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c037fe640 1 -- 172.21.15.102:0/1096248460 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc03f030 con 0x7f2c0c1083a0 2024-09-21T03:35:08.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c19f630 con 0x7f2c0c1083a0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c037fe640 1 -- 172.21.15.102:0/1096248460 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2bfc004440 con 0x7f2c0c1083a0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c037fe640 1 -- 172.21.15.102:0/1096248460 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc035070 con 0x7f2c0c1083a0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.878+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a5df0 con 0x7f2c0c1083a0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 Processor -- start 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 -- start start 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 0x55d5f9d6b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d6c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9ce1ea0 con 0x55d5f999b1b0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9cd12d0 con 0x55d5f99c4070 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9cd50e0 con 0x55d5f99a3390 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c037fe640 1 -- 172.21.15.102:0/1096248460 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f2bfc042030 con 0x7f2c0c1083a0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.881+0000 7f2c1232b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57178/0 (socket says 172.21.15.102:57178) 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 -- 172.21.15.102:0/1177601282 learned_addr learned my addr 172.21.15.102:0/1177601282 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 0x55d5f9d6b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d6c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 -- 172.21.15.102:0/1177601282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 msgr2=0x55d5f9d6c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d6c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 -- 172.21.15.102:0/1177601282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 msgr2=0x55d5f9d6b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 0x55d5f9d6b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 -- 172.21.15.102:0/1177601282 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f9a2f650 con 0x55d5f999b1b0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 0x55d5f9d6b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c080115c0 tx=0x7f2c08011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6631b20afc8b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c00ff9640 1 -- 172.21.15.102:0/1177601282 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800f640 con 0x55d5f999b1b0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c00ff9640 1 -- 172.21.15.102:0/1177601282 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c0800fcb0 con 0x55d5f999b1b0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c00ff9640 1 -- 172.21.15.102:0/1177601282 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08019d30 con 0x55d5f999b1b0 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.882+0000 7f2c037fe640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 0x7f2bf80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 0x7f2bf80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c037fe640 1 -- 172.21.15.102:0/1096248460 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2bfc107b00 con 0x7f2c0c1083a0 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1177601282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 msgr2=0x55d5f9d6bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f2c080115c0 tx=0x7f2c08011a80 comp rx=0 tx=0).stop 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 0x7f2bf80b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005fd0 tx=0x7f2c04009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1177601282 shutdown_connections 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d6bbe0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d6c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1177601282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99c4070 0x55d5f9d6b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.883+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1177601282 >> 172.21.15.102:0/1177601282 conn(0x55d5f99b8460 msgr2=0x55d5f9d69590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1177601282 shutdown_connections 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1177601282 wait complete. 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- start start 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 Processor -- start 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d76d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d77280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9b32700 con 0x55d5f99c4070 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9c6c160 con 0x55d5f999b1b0 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d5f9d79e80 con 0x55d5f99a3390 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.884+0000 7f2c1ab03740 10 client.0 _ll_register_callbacks cb 0x55d5f9c859e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c11b2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d77280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57194/0 (socket says 172.21.15.102:57194) 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 -- 172.21.15.102:0/1699165600 learned_addr learned my addr 172.21.15.102:0/1699165600 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d76d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 -- 172.21.15.102:0/1699165600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 msgr2=0x55d5f9d77280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d77280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 -- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 msgr2=0x55d5f9d76d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d76d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 -- 172.21.15.102:0/1699165600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f9c99c90 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d77280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d76d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2c04010f80 tx=0x7f2c04004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9659f0377bee3c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2bf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0402c060 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2c04017030 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c0800fcb0 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2c04030420 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c1ab03740 10 client.15690 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.885+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5f9d85bb0 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c0800fcb0 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2c0401c3f0 con 0x55d5f99c4070 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 10 client.15690 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 10 client.15690 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:35:08.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 20 client.15690 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99829f0 0x55d5f9d89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 4 client.15690 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5f9ce3df0 con 0x55d5f99829f0 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.886+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99829f0 0x55d5f9d89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2c1232b640 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99829f0 0x55d5f9d89120 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf080887d4b2e074 server_cookie=7d87bc20be830d8c in_seq=0 out_seq=0 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2bf5ffb640 10 client.15690 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/1699165600 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5f9ce3df0 con 0x55d5f99829f0 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2bf5ffb640 10 client.15690 handle_command_reply: tid=0 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2c1ab03740 1 client.15690 shutdown 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 msgr2=0x55d5f9d77800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.887+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2c04010f80 tx=0x7f2c04004ab0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 shutdown_connections 2024-09-21T03:35:08.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99829f0 0x55d5f9d89120 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2bf5ffb640 0 client.15690 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99c4070 0x55d5f9d77800 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99a3390 0x55d5f9d77280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/1699165600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d76d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 >> 172.21.15.102:0/1699165600 conn(0x55d5f99b8460 msgr2=0x55d5f9d6e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 shutdown_connections 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 1 -- 172.21.15.102:0/1699165600 wait complete. 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.888+0000 7f2c1ab03740 20 client.15690 trim_cache size 0 max 16384 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 Processor -- start 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 -- start start 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d73f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d74470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1b0ff0 con 0x55d5f99a3390 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1ae8c0 con 0x55d5f999b1b0 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1ac710 con 0x55d5f99829f0 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57208/0 (socket says 172.21.15.102:57208) 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 -- 172.21.15.102:0/3051977006 learned_addr learned my addr 172.21.15.102:0/3051977006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1232b640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d73f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d74470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 -- 172.21.15.102:0/3051977006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 msgr2=0x55d5f9d73f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d73f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 -- 172.21.15.102:0/3051977006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 msgr2=0x55d5f9d74470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d74470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c12b2c640 1 -- 172.21.15.102:0/3051977006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5f9d79480 con 0x55d5f99a3390 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.901+0000 7f2c1232b640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d73f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:08.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.902+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2c04011590 tx=0x7f2c040049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8323a5d4262bbd57 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.902+0000 7f2bf7fff640 1 -- 172.21.15.102:0/3051977006 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0401cc80 con 0x55d5f99a3390 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.902+0000 7f2bf7fff640 1 -- 172.21.15.102:0/3051977006 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c0401ce50 con 0x55d5f99a3390 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.902+0000 7f2bf7fff640 1 -- 172.21.15.102:0/3051977006 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c04027670 con 0x55d5f99a3390 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- 172.21.15.102:0/3051977006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 msgr2=0x55d5f9d78260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2c04011590 tx=0x7f2c040049e0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- 172.21.15.102:0/3051977006 shutdown_connections 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f99a3390 0x55d5f9d78260 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f999b1b0 0x55d5f9d74470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/3051977006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d73f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- 172.21.15.102:0/3051977006 >> 172.21.15.102:0/3051977006 conn(0x55d5f99b8460 msgr2=0x55d5f9d755c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- 172.21.15.102:0/3051977006 shutdown_connections 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- 172.21.15.102:0/3051977006 wait complete. 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- start start 2024-09-21T03:35:08.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 Processor -- start 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d7f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 0x55d5f9d7b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1acd80 con 0x55d5f999b1b0 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1ae1f0 con 0x55d5f99a3390 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1ad450 con 0x55d5f99829f0 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.903+0000 7f2c1ab03740 10 client.0 _ll_register_callbacks cb 0x7f2c04011460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57210/0 (socket says 172.21.15.102:57210) 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 -- 172.21.15.102:0/4044139039 learned_addr learned my addr 172.21.15.102:0/4044139039 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c1232b640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d7f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 0x55d5f9d7b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 -- 172.21.15.102:0/4044139039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 msgr2=0x55d5f9d7f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d7f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 -- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 msgr2=0x55d5f9d7b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 0x55d5f9d7b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 -- 172.21.15.102:0/4044139039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5f9d7bab0 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c12b2c640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 0x55d5f9d7b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c11b2a640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0cd640 tx=0x7f2bfc005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f49a4f9baf13cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2bf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc049040 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2bfc0d70e0 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c0401ce50 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2bfc0b8050 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c1ab03740 10 client.15696 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.904+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d5f9df3a80 con 0x55d5f999b1b0 2024-09-21T03:35:08.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c0401ce50 con 0x55d5f999b1b0 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2bfc03bb00 con 0x55d5f999b1b0 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 10 client.15696 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 10 client.15696 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 20 client.15696 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99c4070 0x55d5f9df6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 4 client.15696 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d5f9cdf8a0 con 0x55d5f99c4070 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1232b640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99c4070 0x55d5f9df6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2bf5ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.905+0000 7f2c1232b640 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99c4070 0x55d5f9df6170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4322ff81d0de6b65 server_cookie=7c7bbf25ce977aeb in_seq=0 out_seq=0 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2bf5ffb640 1 -- 172.21.15.102:0/4044139039 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d5f9cdf8a0 con 0x55d5f99c4070 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2bf5ffb640 10 client.15696 handle_command_reply: tid=0 2024-09-21T03:35:08.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 client.15696 shutdown 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 msgr2=0x55d5f9d7ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0cd640 tx=0x7f2bfc005c90 comp rx=0 tx=0).stop 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 shutdown_connections 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d5f99c4070 0x55d5f9df6170 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d5f999b1b0 0x55d5f9d7ae00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d5f99a3390 0x55d5f9d7b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2bf5ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 --2- 172.21.15.102:0/4044139039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d5f99829f0 0x55d5f9d7f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 >> 172.21.15.102:0/4044139039 conn(0x55d5f99b8460 msgr2=0x55d5f9d781f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 shutdown_connections 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 1 -- 172.21.15.102:0/4044139039 wait complete. 2024-09-21T03:35:08.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1ab03740 20 client.15696 trim_cache size 0 max 16384 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 msgr2=0x7f2bf80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 0x7f2bf80b8b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c04005fd0 tx=0x7f2c04009500 comp rx=0 tx=0).stop 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 msgr2=0x7f2c0c1999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.906+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005940 tx=0x7f2bfc004040 comp rx=0 tx=0).stop 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 shutdown_connections 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2bf80b6680 0x7f2bf80b8b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c0c1083a0 0x7f2c0c1999d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c0c108cf0 0x7f2c0c19ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 --2- 172.21.15.102:0/1096248460 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c0c102a60 0x7f2c0c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:08.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 >> 172.21.15.102:0/1096248460 conn(0x7f2c0c079730 msgr2=0x7f2c0c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:08.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 shutdown_connections 2024-09-21T03:35:08.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:07.907+0000 7f2c1458f640 1 -- 172.21.15.102:0/1096248460 wait complete. 2024-09-21T03:35:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:09 smithi102 ceph-mon[31392]: pgmap v371: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.2 MiB/s wr, 77 op/s 2024-09-21T03:35:09.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:09 smithi148 ceph-mon[34651]: pgmap v371: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.2 MiB/s wr, 77 op/s 2024-09-21T03:35:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:09 smithi121 ceph-mon[34316]: pgmap v371: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 7.2 MiB/s wr, 77 op/s 2024-09-21T03:35:10.722 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:35:10.975 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:11.358 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:11 smithi102 ceph-mon[31392]: pgmap v372: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 3.9 MiB/s wr, 70 op/s 2024-09-21T03:35:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- 172.21.15.102:0/2139785049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 msgr2=0x7f1270104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 --2- 172.21.15.102:0/2139785049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f1270104040 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f126c009900 tx=0x7f126c02a410 comp rx=0 tx=0).stop 2024-09-21T03:35:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- 172.21.15.102:0/2139785049 shutdown_connections 2024-09-21T03:35:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 --2- 172.21.15.102:0/2139785049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 0x7f12701106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 --2- 172.21.15.102:0/2139785049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 0x7f1270109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 --2- 172.21.15.102:0/2139785049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f1270104040 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- 172.21.15.102:0/2139785049 >> 172.21.15.102:0/2139785049 conn(0x7f127007b8d0 msgr2=0x7f127007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- 172.21.15.102:0/2139785049 shutdown_connections 2024-09-21T03:35:11.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- 172.21.15.102:0/2139785049 wait complete. 2024-09-21T03:35:11.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 Processor -- start 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.566+0000 7f12777a3640 1 -- start start 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 0x7f127019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 0x7f127019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1270113c20 con 0x7f1270103c30 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1270113aa0 con 0x7f1270109570 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12777a3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1270113da0 con 0x7f1270109ec0 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57232/0 (socket says 172.21.15.102:57232) 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 -- 172.21.15.102:0/3960234788 learned_addr learned my addr 172.21.15.102:0/3960234788 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f1275d40640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 0x7f127019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f1274d3e640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 0x7f127019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 -- 172.21.15.102:0/3960234788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 msgr2=0x7f127019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 0x7f127019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 -- 172.21.15.102:0/3960234788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 msgr2=0x7f127019ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 0x7f127019ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 -- 172.21.15.102:0/3960234788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12701a0500 con 0x7f1270103c30 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f127553f640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f126c005ab0 tx=0x7f126c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.567+0000 7f12667fc640 1 -- 172.21.15.102:0/3960234788 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c03f030 con 0x7f1270103c30 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.568+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12701a0790 con 0x7f1270103c30 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.568+0000 7f12667fc640 1 -- 172.21.15.102:0/3960234788 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f126c003ac0 con 0x7f1270103c30 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.568+0000 7f12667fc640 1 -- 172.21.15.102:0/3960234788 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c035070 con 0x7f1270103c30 2024-09-21T03:35:11.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.568+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12701a6f50 con 0x7f1270103c30 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.570+0000 7f12667fc640 1 -- 172.21.15.102:0/3960234788 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f126c042030 con 0x7f1270103c30 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 Processor -- start 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 -- start start 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 0x5602d97d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5602d9743ea0 con 0x5602d9426070 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d97332d0 con 0x5602d9405390 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127dd17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602d97370e0 con 0x5602d93fd1b0 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f127553f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57238/0 (socket says 172.21.15.102:57238) 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f12667fc640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 0x7f125c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 -- 172.21.15.102:0/4248211055 learned_addr learned my addr 172.21.15.102:0/4248211055 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1274d3e640 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 0x5602d97d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 0x7f125c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 -- 172.21.15.102:0/4248211055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 msgr2=0x5602d97d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 -- 172.21.15.102:0/4248211055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 msgr2=0x5602d97d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 0x5602d97d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1275d40640 1 -- 172.21.15.102:0/4248211055 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d9491650 con 0x5602d9426070 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.571+0000 7f1274d3e640 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 0x5602d97d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.572+0000 7f12667fc640 1 -- 172.21.15.102:0/3960234788 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f126c107e50 con 0x7f1270103c30 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.572+0000 7f1275d40640 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1268005c40 tx=0x7f126800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9651fecf691cccc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.572+0000 7f125b7fe640 1 -- 172.21.15.102:0/4248211055 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268022020 con 0x5602d9426070 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.572+0000 7f125b7fe640 1 -- 172.21.15.102:0/4248211055 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1268013170 con 0x5602d9426070 2024-09-21T03:35:11.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.572+0000 7f125b7fe640 1 -- 172.21.15.102:0/4248211055 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268010750 con 0x5602d9426070 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 -- 172.21.15.102:0/4248211055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 msgr2=0x5602d97d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f1275d40640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 0x7f125c0b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1268023000 tx=0x7f1268021000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1268005c40 tx=0x7f126800f3c0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 -- 172.21.15.102:0/4248211055 shutdown_connections 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9405390 0x5602d97d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 --2- 172.21.15.102:0/4248211055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9426070 0x5602d97d1ab0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 -- 172.21.15.102:0/4248211055 >> 172.21.15.102:0/4248211055 conn(0x5602d941a460 msgr2=0x5602d97cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 -- 172.21.15.102:0/4248211055 shutdown_connections 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.573+0000 7f127dd17740 1 -- 172.21.15.102:0/4248211055 wait complete. 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 -- start start 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 Processor -- start 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5602d9594700 con 0x5602d9405390 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d96ce160 con 0x5602d9426070 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5602d97e0290 con 0x5602d93fd1b0 2024-09-21T03:35:11.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127dd17740 10 client.0 _ll_register_callbacks cb 0x5602d96e79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f127553f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57240/0 (socket says 172.21.15.102:57240) 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.574+0000 7f1274d3e640 1 -- 172.21.15.102:0/1404708736 learned_addr learned my addr 172.21.15.102:0/1404708736 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1275d40640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 -- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 msgr2=0x5602d97dd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 -- 172.21.15.102:0/1404708736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 msgr2=0x5602d97e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 -- 172.21.15.102:0/1404708736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d96fbc90 con 0x5602d9405390 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f127553f640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:11.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1260012700 tx=0x7f1260012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802e4e86bf93d567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1258ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000f920 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1268013170 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f126000fac0 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f126000fcc0 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f127dd17740 10 client.15708 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5602d97ec060 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.575+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1268013170 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f126001c420 con 0x5602d9405390 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 10 client.15708 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 10 client.15708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 20 client.15708 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:11.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93e49f0 0x5602d97ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 4 client.15708 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602d9745df0 con 0x5602d93e49f0 2024-09-21T03:35:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127553f640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93e49f0 0x5602d97ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f1258ff9640 10 client.15708 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:11.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.576+0000 7f127553f640 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93e49f0 0x5602d97ef5a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9adc1dcd66e3304b server_cookie=4dfdc401e6a9052d in_seq=0 out_seq=0 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f1258ff9640 1 -- 172.21.15.102:0/1404708736 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602d9745df0 con 0x5602d93e49f0 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f1258ff9640 10 client.15708 handle_command_reply: tid=0 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 client.15708 shutdown 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 msgr2=0x5602d97dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1260012700 tx=0x7f1260012bc0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 shutdown_connections 2024-09-21T03:35:11.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93e49f0 0x5602d97ef5a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97dd700 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 --2- 172.21.15.102:0/1404708736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 >> 172.21.15.102:0/1404708736 conn(0x5602d941a460 msgr2=0x5602d97d4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f1258ff9640 0 client.15708 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 shutdown_connections 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 1 -- 172.21.15.102:0/1404708736 wait complete. 2024-09-21T03:35:11.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.579+0000 7f127dd17740 20 client.15708 trim_cache size 0 max 16384 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 Processor -- start 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 -- start start 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97da3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12701aff70 con 0x5602d9405390 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ad840 con 0x5602d9426070 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f127dd17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ab690 con 0x5602d93fd1b0 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.593+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57254/0 (socket says 172.21.15.102:57254) 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 -- 172.21.15.102:0/1168762027 learned_addr learned my addr 172.21.15.102:0/1168762027 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1275d40640 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97da3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 -- 172.21.15.102:0/1168762027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 msgr2=0x5602d97dd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 -- 172.21.15.102:0/1168762027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 msgr2=0x5602d97da3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97da3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 -- 172.21.15.102:0/1168762027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d97d3da0 con 0x5602d9405390 2024-09-21T03:35:11.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f1274d3e640 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f126001c8e0 tx=0x7f126000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5bde3c4949a0f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f125affd640 1 -- 172.21.15.102:0/1168762027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260009d80 con 0x5602d9405390 2024-09-21T03:35:11.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f125affd640 1 -- 172.21.15.102:0/1168762027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12600055a0 con 0x5602d9405390 2024-09-21T03:35:11.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.594+0000 7f125affd640 1 -- 172.21.15.102:0/1168762027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260003950 con 0x5602d9405390 2024-09-21T03:35:11.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- 172.21.15.102:0/1168762027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 msgr2=0x5602d97e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f126001c8e0 tx=0x7f126000f810 comp rx=0 tx=0).stop 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- 172.21.15.102:0/1168762027 shutdown_connections 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e9480 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97da3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 --2- 172.21.15.102:0/1168762027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97dd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- 172.21.15.102:0/1168762027 >> 172.21.15.102:0/1168762027 conn(0x5602d941a460 msgr2=0x5602d97dcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- 172.21.15.102:0/1168762027 shutdown_connections 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- 172.21.15.102:0/1168762027 wait complete. 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.596+0000 7f127dd17740 1 -- start start 2024-09-21T03:35:11.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 Processor -- start 2024-09-21T03:35:11.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12701abd00 con 0x5602d9405390 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ad170 con 0x5602d9426070 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12701ac3d0 con 0x5602d93fd1b0 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127dd17740 10 client.0 _ll_register_callbacks cb 0x7f1260009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f1275d40640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f1274d3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57262/0 (socket says 172.21.15.102:57262) 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f1274d3e640 1 -- 172.21.15.102:0/911825644 learned_addr learned my addr 172.21.15.102:0/911825644 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.597+0000 7f127553f640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 -- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 msgr2=0x5602d97e16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97e16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 -- 172.21.15.102:0/911825644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 msgr2=0x5602d97e1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 -- 172.21.15.102:0/911825644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d98591d0 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1275d40640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e2180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1268003fd0 tx=0x7f1268003ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168357d0b7e7ae29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1258ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268038060 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f1268010630 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.598+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12600055a0 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1268022070 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 10 client.25226 fetch_fsmap learned FSMap version 24 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5602d985a450 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1268005050 con 0x5602d9426070 2024-09-21T03:35:11.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f126803c470 con 0x5602d9426070 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 10 client.25226 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 10 client.25226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 20 client.25226 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.599+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93b9da0 0x5602d985ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.600+0000 7f127dd17740 4 client.25226 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.600+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f12600055a0 con 0x5602d93b9da0 2024-09-21T03:35:11.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.601+0000 7f127553f640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93b9da0 0x5602d985ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.601+0000 7f1258ff9640 10 client.25226 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:11.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.601+0000 7f127553f640 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93b9da0 0x5602d985ca70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e87ec4a0134de6b server_cookie=759814835076f961 in_seq=0 out_seq=0 2024-09-21T03:35:11.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f1258ff9640 1 -- 172.21.15.102:0/911825644 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f12600055a0 con 0x5602d93b9da0 2024-09-21T03:35:11.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f1258ff9640 10 client.25226 handle_command_reply: tid=0 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 client.25226 shutdown 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 msgr2=0x5602d97e2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e2180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1268003fd0 tx=0x7f1268003ec0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 shutdown_connections 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5602d93b9da0 0x5602d985ca70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5602d9405390 0x5602d97e1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d9426070 0x5602d97e2180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 --2- 172.21.15.102:0/911825644 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5602d93fd1b0 0x5602d97e16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f1258ff9640 0 client.25226 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 >> 172.21.15.102:0/911825644 conn(0x5602d941a460 msgr2=0x5602d97de670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.605+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 shutdown_connections 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f127dd17740 1 -- 172.21.15.102:0/911825644 wait complete. 2024-09-21T03:35:11.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f127dd17740 20 client.25226 trim_cache size 0 max 16384 2024-09-21T03:35:11.609 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 msgr2=0x7f125c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 0x7f125c0b8b90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1268023000 tx=0x7f1268021000 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 msgr2=0x7f127019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f126c005ab0 tx=0x7f126c0040c0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 shutdown_connections 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f125c0b6680 0x7f125c0b8b90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1270109ec0 0x7f127019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1270109570 0x7f127019ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 --2- 172.21.15.102:0/3960234788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1270103c30 0x7f127019a590 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.606+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 >> 172.21.15.102:0/3960234788 conn(0x7f127007b8d0 msgr2=0x7f12701075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.607+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 shutdown_connections 2024-09-21T03:35:11.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:11.607+0000 7f12777a3640 1 -- 172.21.15.102:0/3960234788 wait complete. 2024-09-21T03:35:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:11 smithi148 ceph-mon[34651]: pgmap v372: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 3.9 MiB/s wr, 70 op/s 2024-09-21T03:35:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:11 smithi121 ceph-mon[34316]: pgmap v372: 97 pgs: 97 active+clean; 91 MiB data, 609 MiB used, 1.0 TiB / 1.0 TiB avail; 876 KiB/s rd, 3.9 MiB/s wr, 70 op/s 2024-09-21T03:35:13.392 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:35:13.393 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:35:13.653 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:13 smithi102 ceph-mon[31392]: pgmap v373: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 64 op/s 2024-09-21T03:35:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:13 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:13 smithi148 ceph-mon[34651]: pgmap v373: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 64 op/s 2024-09-21T03:35:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:13 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:13 smithi121 ceph-mon[34316]: pgmap v373: 97 pgs: 97 active+clean; 95 MiB data, 614 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 64 op/s 2024-09-21T03:35:13.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:13 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.140+0000 7f08d91be640 1 -- 172.21.15.102:0/1603350859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d4103b60 msgr2=0x7f08d4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.140+0000 7f08d91be640 1 --2- 172.21.15.102:0/1603350859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d4103b60 0x7f08d4103f70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009900 tx=0x7f08c402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:14.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.140+0000 7f08d91be640 1 -- 172.21.15.102:0/1603350859 shutdown_connections 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.140+0000 7f08d91be640 1 --2- 172.21.15.102:0/1603350859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4109df0 0x7f08d4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.140+0000 7f08d91be640 1 --2- 172.21.15.102:0/1603350859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d41094a0 0x7f08d41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.141+0000 7f08d91be640 1 --2- 172.21.15.102:0/1603350859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d4103b60 0x7f08d4103f70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.141+0000 7f08d91be640 1 -- 172.21.15.102:0/1603350859 >> 172.21.15.102:0/1603350859 conn(0x7f08d407b850 msgr2=0x7f08d407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.141+0000 7f08d91be640 1 -- 172.21.15.102:0/1603350859 shutdown_connections 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.141+0000 7f08d91be640 1 -- 172.21.15.102:0/1603350859 wait complete. 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.141+0000 7f08d91be640 1 Processor -- start 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 -- start start 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4103b60 0x7f08d419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d4109df0 0x7f08d419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08d4113bf0 con 0x7f08d41094a0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08d4113a70 con 0x7f08d4103b60 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d91be640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08d4113d70 con 0x7f08d4109df0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42202/0 (socket says 172.21.15.102:42202) 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 -- 172.21.15.102:0/3621353177 learned_addr learned my addr 172.21.15.102:0/3621353177 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d359e640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d4109df0 0x7f08d419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4103b60 0x7f08d419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 -- 172.21.15.102:0/3621353177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d4109df0 msgr2=0x7f08d419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d4109df0 0x7f08d419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 -- 172.21.15.102:0/3621353177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4103b60 msgr2=0x7f08d419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4103b60 0x7f08d419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.142+0000 7f08d259c640 1 -- 172.21.15.102:0/3621353177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08d41a0570 con 0x7f08d41094a0 2024-09-21T03:35:14.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08d259c640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08c800e9c0 tx=0x7f08c800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08bbfff640 1 -- 172.21.15.102:0/3621353177 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c800ccc0 con 0x7f08d41094a0 2024-09-21T03:35:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08d41a0860 con 0x7f08d41094a0 2024-09-21T03:35:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08bbfff640 1 -- 172.21.15.102:0/3621353177 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08c80054f0 con 0x7f08d41094a0 2024-09-21T03:35:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08d41a6fc0 con 0x7f08d41094a0 2024-09-21T03:35:14.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.143+0000 7f08bbfff640 1 -- 172.21.15.102:0/3621353177 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c8010430 con 0x7f08d41094a0 2024-09-21T03:35:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 Processor -- start 2024-09-21T03:35:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 -- start start 2024-09-21T03:35:14.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08bbfff640 1 -- 172.21.15.102:0/3621353177 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f08c8010710 con 0x7f08d41094a0 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b53970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 0x55da78b53eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55da78ac9e60 con 0x55da7878b670 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55da78ab9290 con 0x55da78783490 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08df732740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55da78abd0a0 con 0x55da787ac350 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 0x55da78b53eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:40784/0 (socket says 172.21.15.102:40784) 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 -- 172.21.15.102:0/1320508577 learned_addr learned my addr 172.21.15.102:0/1320508577 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b53970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 -- 172.21.15.102:0/1320508577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 msgr2=0x55da78b53970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b53970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 -- 172.21.15.102:0/1320508577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 msgr2=0x55da78b53eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.146+0000 7f08d359e640 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 0x55da78b53eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08d359e640 1 -- 172.21.15.102:0/1320508577 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78817930 con 0x55da787ac350 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08d259c640 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 0x55da78b53eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08d359e640 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00ae90 tx=0x7f08cc00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bf985af658f030 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08b97fa640 1 -- 172.21.15.102:0/1320508577 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc003b70 con 0x55da787ac350 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08b97fa640 1 -- 172.21.15.102:0/1320508577 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08cc003d10 con 0x55da787ac350 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08b97fa640 1 -- 172.21.15.102:0/1320508577 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc010ba0 con 0x55da787ac350 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08bbfff640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 0x7f08bc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 0x7f08bc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.147+0000 7f08bbfff640 1 -- 172.21.15.102:0/3621353177 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f08c80e7b40 con 0x7f08d41094a0 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 -- 172.21.15.102:0/1320508577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 msgr2=0x55da78b53430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 0x7f08bc0b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55da78b520b0 tx=0x7f08c4005ed0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00ae90 tx=0x7f08cc00f790 comp rx=0 tx=0).stop 2024-09-21T03:35:14.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 -- 172.21.15.102:0/1320508577 shutdown_connections 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da7878b670 0x55da78b53eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b53970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 --2- 172.21.15.102:0/1320508577 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da787ac350 0x55da78b53430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 -- 172.21.15.102:0/1320508577 >> 172.21.15.102:0/1320508577 conn(0x55da787a0740 msgr2=0x55da78b51320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 -- 172.21.15.102:0/1320508577 shutdown_connections 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.148+0000 7f08df732740 1 -- 172.21.15.102:0/1320508577 wait complete. 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 -- start start 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 Processor -- start 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da7878b670 0x55da78b5f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b6af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55da7891a890 con 0x55da787ac350 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55da78a53d40 con 0x55da7878b670 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55da78b61c10 con 0x55da78783490 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08df732740 10 client.0 _ll_register_callbacks cb 0x55da78ab7c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:40790/0 (socket says 172.21.15.102:40790) 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 -- 172.21.15.102:0/4146006033 learned_addr learned my addr 172.21.15.102:0/4146006033 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b6af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d259c640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da7878b670 0x55da78b5f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 -- 172.21.15.102:0/4146006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da7878b670 msgr2=0x55da78b5f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da7878b670 0x55da78b5f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 -- 172.21.15.102:0/4146006033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 msgr2=0x55da78b6af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b6af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d2d9d640 1 -- 172.21.15.102:0/4146006033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da78b6b470 con 0x55da78783490 2024-09-21T03:35:14.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.149+0000 7f08d359e640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08c4033000 tx=0x7f08c4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea633fb98a501aae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:35:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c404c070 con 0x55da78783490 2024-09-21T03:35:14.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f08c4005250 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08cc003d10 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08c4058050 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08df732740 10 client.25282 fetch_fsmap learned FSMap version 25 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da78b6dd80 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08cc003d10 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.150+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f08c40035f0 con 0x55da78783490 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 10 client.25282 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 10 client.25282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 20 client.25282 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da7876acd0 0x55da78b712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 4 client.25282 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da78acbdb0 con 0x55da7876acd0 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08d259c640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da7876acd0 0x55da78b712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08b6ff5640 10 client.25282 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.151+0000 7f08d259c640 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da7876acd0 0x55da78b712f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d419c69b80186580 server_cookie=20583b32ffccda38 in_seq=0 out_seq=0 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08b6ff5640 1 -- 172.21.15.102:0/4146006033 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da78acbdb0 con 0x55da7876acd0 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08b6ff5640 10 client.25282 handle_command_reply: tid=0 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 client.25282 shutdown 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 msgr2=0x55da78b5ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f08c4033000 tx=0x7f08c4009260 comp rx=0 tx=0).stop 2024-09-21T03:35:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 shutdown_connections 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da7876acd0 0x55da78b712f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b6af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da7878b670 0x55da78b5f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 --2- 172.21.15.102:0/4146006033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da78783490 0x55da78b5ef50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08b6ff5640 0 client.25282 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 >> 172.21.15.102:0/4146006033 conn(0x55da787a0740 msgr2=0x55da78b565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 shutdown_connections 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 1 -- 172.21.15.102:0/4146006033 wait complete. 2024-09-21T03:35:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.154+0000 7f08df732740 20 client.25282 trim_cache size 0 max 16384 2024-09-21T03:35:14.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.172+0000 7f08df732740 1 Processor -- start 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 -- start start 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b6ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b54e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41b22e0 con 0x55da787ac350 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41afbb0 con 0x55da78783490 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08df732740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41ada00 con 0x55da7878b670 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42226/0 (socket says 172.21.15.102:42226) 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 -- 172.21.15.102:0/2883370436 learned_addr learned my addr 172.21.15.102:0/2883370436 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d259c640 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b54e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b6ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 -- 172.21.15.102:0/2883370436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 msgr2=0x55da78b54e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b54e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 -- 172.21.15.102:0/2883370436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 msgr2=0x55da78b6ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b6ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.173+0000 7f08d359e640 1 -- 172.21.15.102:0/2883370436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da78b59a90 con 0x55da787ac350 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08d359e640 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00adb0 tx=0x7f08cc004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fc66113133ecd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08b8ff9640 1 -- 172.21.15.102:0/2883370436 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc027020 con 0x55da787ac350 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08b8ff9640 1 -- 172.21.15.102:0/2883370436 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08cc010cc0 con 0x55da787ac350 2024-09-21T03:35:14.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08b8ff9640 1 -- 172.21.15.102:0/2883370436 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc01d040 con 0x55da787ac350 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08df732740 1 -- 172.21.15.102:0/2883370436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 msgr2=0x55da78b59550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.174+0000 7f08df732740 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00adb0 tx=0x7f08cc004920 comp rx=0 tx=0).stop 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- 172.21.15.102:0/2883370436 shutdown_connections 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b59550 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b54e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- 172.21.15.102:0/2883370436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b6ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- 172.21.15.102:0/2883370436 >> 172.21.15.102:0/2883370436 conn(0x55da787a0740 msgr2=0x55da78b60270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- 172.21.15.102:0/2883370436 shutdown_connections 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- 172.21.15.102:0/2883370436 wait complete. 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- start start 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 Processor -- start 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b62ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b63410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41ae070 con 0x55da787ac350 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41af4e0 con 0x55da78783490 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f08d41ae740 con 0x55da7878b670 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.175+0000 7f08df732740 10 client.0 _ll_register_callbacks cb 0x7f08c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d259c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b63410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42232/0 (socket says 172.21.15.102:42232) 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 -- 172.21.15.102:0/2783073330 learned_addr learned my addr 172.21.15.102:0/2783073330 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b62ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 -- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 msgr2=0x55da78b63410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b63410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 -- 172.21.15.102:0/2783073330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 msgr2=0x55da78b62ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b62ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 -- 172.21.15.102:0/2783073330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da78bdad70 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08d359e640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00f7d0 tx=0x7f08cc018a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe92d43cb94ba4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08b6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08cc030070 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f08cc018b80 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08cc010cc0 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f08cc027070 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08df732740 10 client.15732 fetch_fsmap learned FSMap version 25 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.176+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da78bdc010 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f08cc010cc0 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f08cc02c840 con 0x55da787ac350 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 10 client.15732 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:35:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 20 client.15732 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da78740080 0x55da78bde5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 4 client.15732 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55da78ac7860 con 0x55da78740080 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da78740080 0x55da78bde5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.177+0000 7f08b6ff5640 10 client.15732 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.178+0000 7f08d2d9d640 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da78740080 0x55da78bde5a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c14a0496bfcb2ac server_cookie=dd2db54652fced3e in_seq=0 out_seq=0 2024-09-21T03:35:14.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.467+0000 7f08b6ff5640 1 -- 172.21.15.102:0/2783073330 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55da78ac7860 con 0x55da78740080 2024-09-21T03:35:14.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.467+0000 7f08b6ff5640 10 client.15732 handle_command_reply: tid=0 2024-09-21T03:35:14.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.467+0000 7f08df732740 1 client.15732 shutdown 2024-09-21T03:35:14.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.467+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 msgr2=0x55da78b63950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.467+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00f7d0 tx=0x7f08cc018a10 comp rx=0 tx=0).stop 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 shutdown_connections 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55da78740080 0x55da78bde5a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55da787ac350 0x55da78b63950 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55da7878b670 0x55da78b63410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08b6ff5640 0 client.15732 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 --2- 172.21.15.102:0/2783073330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55da78783490 0x55da78b62ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 >> 172.21.15.102:0/2783073330 conn(0x55da787a0740 msgr2=0x55da78b60bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 shutdown_connections 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 1 -- 172.21.15.102:0/2783073330 wait complete. 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08df732740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T03:35:14.471 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:14.472 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:35:14.472 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "84fcc7fe-4906-449e-afd5-1286ab9f97df", 2024-09-21T03:35:14.472 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:35:14.472 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 msgr2=0x7f08bc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 0x7f08bc0b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55da78b520b0 tx=0x7f08c4005ed0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 msgr2=0x7f08d419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.468+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08c800e9c0 tx=0x7f08c800ee80 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 shutdown_connections 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f08bc0b6680 0x7f08bc0b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08d41094a0 0x7f08d419aba0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f08d4109df0 0x7f08d419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 --2- 172.21.15.102:0/3621353177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f08d4103b60 0x7f08d419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 >> 172.21.15.102:0/3621353177 conn(0x7f08d407b850 msgr2=0x7f08d4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 shutdown_connections 2024-09-21T03:35:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:14.469+0000 7f08d91be640 1 -- 172.21.15.102:0/3621353177 wait complete. 2024-09-21T03:35:15.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:35:15.415 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:15.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:15 smithi102 ceph-mon[31392]: pgmap v374: 97 pgs: 97 active+clean; 98 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-09-21T03:35:15.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:15 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:35:15.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:15 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:15.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:15 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:15 smithi148 ceph-mon[34651]: pgmap v374: 97 pgs: 97 active+clean; 98 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-09-21T03:35:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:15 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:35:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:15 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:15 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:15 smithi121 ceph-mon[34316]: pgmap v374: 97 pgs: 97 active+clean; 98 MiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-09-21T03:35:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:15 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:35:15.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:15 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:15.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:15 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:15.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 -- 172.21.15.102:0/2170210403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0108cf0 msgr2=0x7ffae010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 --2- 172.21.15.102:0/2170210403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0108cf0 0x7ffae010f520 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009ca0 tx=0x7ffad802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 -- 172.21.15.102:0/2170210403 shutdown_connections 2024-09-21T03:35:15.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 --2- 172.21.15.102:0/2170210403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0108cf0 0x7ffae010f520 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 --2- 172.21.15.102:0/2170210403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 0x7ffae01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 --2- 172.21.15.102:0/2170210403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0102a60 0x7ffae0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 -- 172.21.15.102:0/2170210403 >> 172.21.15.102:0/2170210403 conn(0x7ffae0079730 msgr2=0x7ffae0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 -- 172.21.15.102:0/2170210403 shutdown_connections 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.923+0000 7ffae4861640 1 -- 172.21.15.102:0/2170210403 wait complete. 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.924+0000 7ffae4861640 1 Processor -- start 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.924+0000 7ffae4861640 1 -- start start 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.924+0000 7ffae4861640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 0x7ffae00ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0108cf0 0x7ffae01000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112aa0 con 0x7ffae0102a60 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112920 con 0x7ffae0108cf0 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae0112c20 con 0x7ffae01083a0 2024-09-21T03:35:15.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42252/0 (socket says 172.21.15.102:42252) 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 -- 172.21.15.102:0/2467503457 learned_addr learned my addr 172.21.15.102:0/2467503457 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 0x7ffae00ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffaded9d640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0108cf0 0x7ffae01000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 -- 172.21.15.102:0/2467503457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 msgr2=0x7ffae00ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 0x7ffae00ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 -- 172.21.15.102:0/2467503457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0108cf0 msgr2=0x7ffae01000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0108cf0 0x7ffae01000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 -- 172.21.15.102:0/2467503457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae01a87a0 con 0x7ffae0102a60 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffade59c640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d950 tx=0x7ffad000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffad77fe640 1 -- 172.21.15.102:0/2467503457 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0017070 con 0x7ffae0102a60 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffad77fe640 1 -- 172.21.15.102:0/2467503457 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffad0009c30 con 0x7ffae0102a60 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffad77fe640 1 -- 172.21.15.102:0/2467503457 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad000f6b0 con 0x7ffae0102a60 2024-09-21T03:35:15.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae01a8a90 con 0x7ffae0102a60 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.925+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae01a8f80 con 0x7ffae0102a60 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.928+0000 7ffaeadd5740 1 Processor -- start 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.928+0000 7ffaeadd5740 1 -- start start 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.928+0000 7ffad77fe640 1 -- 172.21.15.102:0/2467503457 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ffad00109c0 con 0x7ffae0102a60 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cb5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cb57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac97c2be50 con 0x55ac978e51b0 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ac97c1b280 con 0x55ac9790e070 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac97c1f090 con 0x55ac978ed390 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cb57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:40830/0 (socket says 172.21.15.102:40830) 2024-09-21T03:35:15.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1429659877 learned_addr learned my addr 172.21.15.102:0/1429659877 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaded9d640 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cb5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1429659877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 msgr2=0x55ac97cb5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cb5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1429659877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 msgr2=0x55ac97cb57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cb57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1429659877 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac97979650 con 0x55ac978ed390 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffaded9d640 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cb5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.929+0000 7ffad77fe640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 0x7ffacc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b6c0 tx=0x7ffac800bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef6167f00a944f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffaded9d640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 0x7ffacc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffad77fe640 1 -- 172.21.15.102:0/2467503457 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ffad00e72e0 con 0x7ffae0102a60 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffad4ff9640 1 -- 172.21.15.102:0/1429659877 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8003bd0 con 0x55ac978ed390 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffad4ff9640 1 -- 172.21.15.102:0/1429659877 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffac8015070 con 0x55ac978ed390 2024-09-21T03:35:15.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.930+0000 7ffad4ff9640 1 -- 172.21.15.102:0/1429659877 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8004e10 con 0x55ac978ed390 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1429659877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 msgr2=0x55ac97cb5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaded9d640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 0x7ffacc0b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad802f500 tx=0x7ffad8009820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b6c0 tx=0x7ffac800bb80 comp rx=0 tx=0).stop 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1429659877 shutdown_connections 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cb57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb5cf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1429659877 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cb5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1429659877 >> 172.21.15.102:0/1429659877 conn(0x55ac97902460 msgr2=0x55ac97cb3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1429659877 shutdown_connections 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1429659877 wait complete. 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 -- start start 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.931+0000 7ffaeadd5740 1 Processor -- start 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac97a7c700 con 0x55ac978ed390 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ac97bb6110 con 0x55ac9790e070 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ac97cc3a50 con 0x55ac978e51b0 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42278/0 (socket says 172.21.15.102:42278) 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffade59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 -- 172.21.15.102:0/3242721642 learned_addr learned my addr 172.21.15.102:0/3242721642 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaeadd5740 10 client.0 _ll_register_callbacks cb 0x55ac97bcf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaded9d640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 -- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 msgr2=0x55ac97cc0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 -- 172.21.15.102:0/3242721642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 msgr2=0x55ac97cccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 -- 172.21.15.102:0/3242721642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac97be3c40 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffade59c640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.932+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dc0d698a799a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8003ea0 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ffac8011440 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffac8015070 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffac8011640 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac97ccf760 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffac8015070 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ffac8025a50 con 0x55ac978ed390 2024-09-21T03:35:15.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 20 client.15744 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978cc9f0 0x55ac97cd2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 4 client.15744 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.933+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac97c2dda0 con 0x55ac978cc9f0 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.934+0000 7ffade59c640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978cc9f0 0x55ac97cd2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.934+0000 7ffac5ffb640 10 client.15744 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.934+0000 7ffade59c640 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978cc9f0 0x55ac97cd2b70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8afb45ac414b81d2 server_cookie=b518b9ba0032a4b7 in_seq=0 out_seq=0 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.936+0000 7ffac5ffb640 1 -- 172.21.15.102:0/3242721642 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac97c2dda0 con 0x55ac978cc9f0 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.936+0000 7ffac5ffb640 10 client.15744 handle_command_reply: tid=0 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 client.15744 shutdown 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 msgr2=0x55ac97cc0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac80048f0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 shutdown_connections 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978cc9f0 0x55ac97cd2b70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc0e70 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3242721642 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffac5ffb640 0 client.15744 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 >> 172.21.15.102:0/3242721642 conn(0x55ac97902460 msgr2=0x55ac97cb8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 shutdown_connections 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3242721642 wait complete. 2024-09-21T03:35:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.937+0000 7ffaeadd5740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 Processor -- start 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 -- start start 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b4290 con 0x55ac978e51b0 2024-09-21T03:35:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b1b60 con 0x55ac9790e070 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01af9b0 con 0x55ac978ed390 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42284/0 (socket says 172.21.15.102:42284) 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 -- 172.21.15.102:0/3395185715 learned_addr learned my addr 172.21.15.102:0/3395185715 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffaded9d640 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 -- 172.21.15.102:0/3395185715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 msgr2=0x55ac97cb2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 -- 172.21.15.102:0/3395185715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 msgr2=0x55ac97cccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.956+0000 7ffade59c640 1 -- 172.21.15.102:0/3395185715 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac97cbf890 con 0x55ac978e51b0 2024-09-21T03:35:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.957+0000 7ffade59c640 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffad00ad160 tx=0x7ffad00eae30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0314ca8c87db7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.957+0000 7ffac7fff640 1 -- 172.21.15.102:0/3395185715 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad00e6070 con 0x55ac978e51b0 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.957+0000 7ffac7fff640 1 -- 172.21.15.102:0/3395185715 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffad00acce0 con 0x55ac978e51b0 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.957+0000 7ffac7fff640 1 -- 172.21.15.102:0/3395185715 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0020040 con 0x55ac978e51b0 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3395185715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 msgr2=0x55ac97cc0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffad00ad160 tx=0x7ffad00eae30 comp rx=0 tx=0).stop 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3395185715 shutdown_connections 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978ed390 0x55ac97cb2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/3395185715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978e51b0 0x55ac97cc0df0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3395185715 >> 172.21.15.102:0/3395185715 conn(0x55ac97902460 msgr2=0x55ac97cc06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3395185715 shutdown_connections 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- 172.21.15.102:0/3395185715 wait complete. 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.958+0000 7ffaeadd5740 1 -- start start 2024-09-21T03:35:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 Processor -- start 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cc4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b0020 con 0x55ac978ed390 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b1490 con 0x55ac9790e070 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae01b06f0 con 0x55ac978e51b0 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaeadd5740 10 client.0 _ll_register_callbacks cb 0x7ffad00ead00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:42290/0 (socket says 172.21.15.102:42290) 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1681245006 learned_addr learned my addr 172.21.15.102:0/1681245006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffade59c640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaded9d640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cc4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 msgr2=0x55ac97cc94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1681245006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 msgr2=0x55ac97cc4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cc4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.959+0000 7ffaddd9b640 1 -- 172.21.15.102:0/1681245006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac97cc5690 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaddd9b640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffac8001eb0 tx=0x7ffac8004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c5701feb748632 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac8011440 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ffac8019820 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad00acce0 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffac8019a20 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 10 client.15750 fetch_fsmap learned FSMap version 25 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac97d3d400 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffad00acce0 con 0x55ac978ed390 2024-09-21T03:35:15.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7ffac8025550 con 0x55ac978ed390 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 10 client.15750 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 10 client.15750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 20 client.15750 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978a1da0 0x55ac97d3fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 4 client.15750 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.960+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac97c29850 con 0x55ac978a1da0 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.961+0000 7ffade59c640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978a1da0 0x55ac97d3fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.961+0000 7ffac5ffb640 10 client.15750 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.961+0000 7ffade59c640 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978a1da0 0x55ac97d3fad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f5ba216f474642 server_cookie=6e69833fe8ab6a00 in_seq=0 out_seq=0 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffac5ffb640 1 -- 172.21.15.102:0/1681245006 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1146 (crc 0 0 0) 0x55ac97c29850 con 0x55ac978a1da0 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffac5ffb640 10 client.15750 handle_command_reply: tid=0 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 client.15750 shutdown 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 msgr2=0x55ac97cc4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffac8001eb0 tx=0x7ffac8004560 comp rx=0 tx=0).stop 2024-09-21T03:35:15.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 shutdown_connections 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ac978a1da0 0x55ac97d3fad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac978ed390 0x55ac97cc4980 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ac9790e070 0x55ac97cc4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 --2- 172.21.15.102:0/1681245006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ac978e51b0 0x55ac97cc94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 >> 172.21.15.102:0/1681245006 conn(0x55ac97902460 msgr2=0x55ac97cc06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffac5ffb640 0 client.15750 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 shutdown_connections 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 1 -- 172.21.15.102:0/1681245006 wait complete. 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.963+0000 7ffaeadd5740 20 client.15750 trim_cache size 0 max 16384 2024-09-21T03:35:15.968 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "scrub active (863 inodes in the stack)", 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "84fcc7fe-4906-449e-afd5-1286ab9f97df", 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:35:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:15.971 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 msgr2=0x7ffacc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 0x7ffacc0b8b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad802f500 tx=0x7ffad8009820 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 msgr2=0x7ffae00ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d950 tx=0x7ffad000de10 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 shutdown_connections 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffacc0b6680 0x7ffacc0b8b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae0108cf0 0x7ffae01000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae01083a0 0x7ffae00ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 --2- 172.21.15.102:0/2467503457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae0102a60 0x7ffae00ff670 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 >> 172.21.15.102:0/2467503457 conn(0x7ffae0079730 msgr2=0x7ffae006b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 shutdown_connections 2024-09-21T03:35:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:15.964+0000 7ffae4861640 1 -- 172.21.15.102:0/2467503457 wait complete. 2024-09-21T03:35:16.731 INFO:tasks.cephfs.filesystem:scrub status for tag:84fcc7fe-4906-449e-afd5-1286ab9f97df - {'path': '/', 'tag': '84fcc7fe-4906-449e-afd5-1286ab9f97df', 'options': 'recursive,force'} 2024-09-21T03:35:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:17 smithi102 ceph-mon[31392]: pgmap v375: 97 pgs: 97 active+clean; 137 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2024-09-21T03:35:17.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:17 smithi148 ceph-mon[34651]: pgmap v375: 97 pgs: 97 active+clean; 137 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2024-09-21T03:35:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:17 smithi121 ceph-mon[34316]: pgmap v375: 97 pgs: 97 active+clean; 137 MiB data, 717 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.4 MiB/s wr, 330 op/s 2024-09-21T03:35:18.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:18 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:18.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:18 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:18.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:18 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:18 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:18.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:18 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:18.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:18 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.709 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: pgmap v376: 97 pgs: 97 active+clean; 159 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 450 op/s 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.710 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.711 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.712 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.713 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.713 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.751 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: pgmap v376: 97 pgs: 97 active+clean; 159 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 450 op/s 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.752 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.754 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.755 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.755 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.755 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.755 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.755 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.793 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: pgmap v376: 97 pgs: 97 active+clean; 159 MiB data, 753 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.0 MiB/s wr, 450 op/s 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.794 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.796 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.797 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.797 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.797 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.797 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.797 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.798 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:19.798 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:19.798 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.704 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.705 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.706 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.707 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.708 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:20 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.747 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.749 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.750 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:20 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.788 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.791 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:20.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:20.792 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:20 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:21.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:21 smithi102 ceph-mon[31392]: pgmap v377: 97 pgs: 97 active+clean; 169 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-09-21T03:35:21.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:21 smithi148 ceph-mon[34651]: pgmap v377: 97 pgs: 97 active+clean; 169 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-09-21T03:35:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:21 smithi121 ceph-mon[34316]: pgmap v377: 97 pgs: 97 active+clean; 169 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-09-21T03:35:22.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:22 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:22 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:22 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:23.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:23 smithi102 ceph-mon[31392]: pgmap v378: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 579 op/s 2024-09-21T03:35:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:23 smithi148 ceph-mon[34651]: pgmap v378: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 579 op/s 2024-09-21T03:35:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:23 smithi121 ceph-mon[34316]: pgmap v378: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.2 MiB/s wr, 579 op/s 2024-09-21T03:35:24.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:24 smithi102 ceph-mon[31392]: pgmap v379: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-09-21T03:35:24.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:24 smithi148 ceph-mon[34651]: pgmap v379: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-09-21T03:35:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:24 smithi121 ceph-mon[34316]: pgmap v379: 97 pgs: 97 active+clean; 174 MiB data, 791 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 6.9 MiB/s wr, 579 op/s 2024-09-21T03:35:27.600 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:27 smithi102 ceph-mon[31392]: pgmap v380: 97 pgs: 97 active+clean; 178 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 607 op/s 2024-09-21T03:35:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:27 smithi148 ceph-mon[34651]: pgmap v380: 97 pgs: 97 active+clean; 178 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 607 op/s 2024-09-21T03:35:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:27 smithi121 ceph-mon[34316]: pgmap v380: 97 pgs: 97 active+clean; 178 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 607 op/s 2024-09-21T03:35:29.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:29 smithi102 ceph-mon[31392]: pgmap v381: 97 pgs: 97 active+clean; 182 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 393 op/s 2024-09-21T03:35:29.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:29 smithi148 ceph-mon[34651]: pgmap v381: 97 pgs: 97 active+clean; 182 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 393 op/s 2024-09-21T03:35:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:29 smithi121 ceph-mon[34316]: pgmap v381: 97 pgs: 97 active+clean; 182 MiB data, 809 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 4.0 MiB/s wr, 393 op/s 2024-09-21T03:35:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:31 smithi102 ceph-mon[31392]: pgmap v382: 97 pgs: 97 active+clean; 186 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 304 op/s 2024-09-21T03:35:31.737 INFO:tasks.workunit.client.0.smithi102.stderr:+ sync 2024-09-21T03:35:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:31 smithi148 ceph-mon[34651]: pgmap v382: 97 pgs: 97 active+clean; 186 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 304 op/s 2024-09-21T03:35:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:31 smithi121 ceph-mon[34316]: pgmap v382: 97 pgs: 97 active+clean; 186 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.5 MiB/s wr, 304 op/s 2024-09-21T03:35:32.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:32 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:35:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:32 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:35:32.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:32 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:35:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:32 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:35:32.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:32 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:35:32.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:32 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:35:33.391 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar c linux-4.0.5 2024-09-21T03:35:33.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:33 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:35:33.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:33 smithi102 ceph-mon[31392]: pgmap v383: 97 pgs: 97 active+clean; 195 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T03:35:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:33 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:35:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:33 smithi148 ceph-mon[34651]: pgmap v383: 97 pgs: 97 active+clean; 195 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T03:35:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:33 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:35:33.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:33 smithi121 ceph-mon[34316]: pgmap v383: 97 pgs: 97 active+clean; 195 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 261 op/s 2024-09-21T03:35:33.962 INFO:tasks.workunit.client.0.smithi102.stderr:+ rm -rf linux-4.0.5 2024-09-21T03:35:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:35 smithi102 ceph-mon[31392]: pgmap v384: 97 pgs: 97 active+clean; 199 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-21T03:35:35.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:35 smithi148 ceph-mon[34651]: pgmap v384: 97 pgs: 97 active+clean; 199 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-21T03:35:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:35 smithi121 ceph-mon[34316]: pgmap v384: 97 pgs: 97 active+clean; 199 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 220 op/s 2024-09-21T03:35:37.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:37 smithi102 ceph-mon[31392]: pgmap v385: 97 pgs: 97 active+clean; 212 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 425 op/s 2024-09-21T03:35:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:37 smithi148 ceph-mon[34651]: pgmap v385: 97 pgs: 97 active+clean; 212 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 425 op/s 2024-09-21T03:35:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:37 smithi121 ceph-mon[34316]: pgmap v385: 97 pgs: 97 active+clean; 212 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.4 MiB/s wr, 425 op/s 2024-09-21T03:35:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:39 smithi102 ceph-mon[31392]: pgmap v386: 97 pgs: 97 active+clean; 225 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 483 op/s 2024-09-21T03:35:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:39 smithi148 ceph-mon[34651]: pgmap v386: 97 pgs: 97 active+clean; 225 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 483 op/s 2024-09-21T03:35:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:39 smithi121 ceph-mon[34316]: pgmap v386: 97 pgs: 97 active+clean; 225 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 4.2 MiB/s wr, 483 op/s 2024-09-21T03:35:41.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:41 smithi102 ceph-mon[31392]: pgmap v387: 97 pgs: 97 active+clean; 224 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-21T03:35:41.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:41 smithi148 ceph-mon[34651]: pgmap v387: 97 pgs: 97 active+clean; 224 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-21T03:35:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:41 smithi121 ceph-mon[34316]: pgmap v387: 97 pgs: 97 active+clean; 224 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 3.9 MiB/s wr, 502 op/s 2024-09-21T03:35:43.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:43 smithi102 ceph-mon[31392]: pgmap v388: 97 pgs: 97 active+clean; 233 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 552 op/s 2024-09-21T03:35:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:43 smithi148 ceph-mon[34651]: pgmap v388: 97 pgs: 97 active+clean; 233 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 552 op/s 2024-09-21T03:35:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:43 smithi121 ceph-mon[34316]: pgmap v388: 97 pgs: 97 active+clean; 233 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.5 MiB/s wr, 552 op/s 2024-09-21T03:35:45.213 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar xf doc.tar 2024-09-21T03:35:45.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:45 smithi102 ceph-mon[31392]: pgmap v389: 97 pgs: 97 active+clean; 231 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 520 op/s 2024-09-21T03:35:45.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:45 smithi148 ceph-mon[34651]: pgmap v389: 97 pgs: 97 active+clean; 231 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 520 op/s 2024-09-21T03:35:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:45 smithi121 ceph-mon[34316]: pgmap v389: 97 pgs: 97 active+clean; 231 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 520 op/s 2024-09-21T03:35:46.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:35:47.012 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:47.415 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:47 smithi102 ceph-mon[31392]: pgmap v390: 97 pgs: 97 active+clean; 227 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 582 op/s 2024-09-21T03:35:47.416 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:47 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 -- 172.21.15.102:0/2165363140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f4108d00 msgr2=0x7f44f410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 --2- 172.21.15.102:0/2165363140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f4108d00 0x7f44f410f530 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009900 tx=0x7f44f002a410 comp rx=0 tx=0).stop 2024-09-21T03:35:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 -- 172.21.15.102:0/2165363140 shutdown_connections 2024-09-21T03:35:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 --2- 172.21.15.102:0/2165363140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f4108d00 0x7f44f410f530 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 --2- 172.21.15.102:0/2165363140 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f41083b0 0x7f44f41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 --2- 172.21.15.102:0/2165363140 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 -- 172.21.15.102:0/2165363140 >> 172.21.15.102:0/2165363140 conn(0x7f44f4079730 msgr2=0x7f44f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 -- 172.21.15.102:0/2165363140 shutdown_connections 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.515+0000 7f44fb44c640 1 -- 172.21.15.102:0/2165363140 wait complete. 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.516+0000 7f44fb44c640 1 Processor -- start 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.516+0000 7f44fb44c640 1 -- start start 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.516+0000 7f44fb44c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f410ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.516+0000 7f44fb44c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.516+0000 7f44fb44c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 0x7f44f4110a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44fb44c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4113bb0 con 0x7f44f41083b0 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44fb44c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4113a30 con 0x7f44f4102a70 2024-09-21T03:35:47.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44fb44c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44f4113d30 con 0x7f44f4108d00 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36818/0 (socket says 172.21.15.102:36818) 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 -- 172.21.15.102:0/1053285606 learned_addr learned my addr 172.21.15.102:0/1053285606 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 0x7f44f4110a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f91e8640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f410ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 -- 172.21.15.102:0/1053285606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 msgr2=0x7f44f4110a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 0x7f44f4110a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 -- 172.21.15.102:0/1053285606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 msgr2=0x7f44f410ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f410ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 -- 172.21.15.102:0/1053285606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f41a8800 con 0x7f44f41083b0 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f99e9640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 0x7f44f4110a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f91e8640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f410ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:47.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44f89e7640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44e800e9c0 tx=0x7f44e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.517+0000 7f44e67fc640 1 -- 172.21.15.102:0/1053285606 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e800cd80 con 0x7f44f41083b0 2024-09-21T03:35:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.518+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f41a8af0 con 0x7f44f41083b0 2024-09-21T03:35:47.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.518+0000 7f44e67fc640 1 -- 172.21.15.102:0/1053285606 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44e80054f0 con 0x7f44f41083b0 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.518+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f41a9080 con 0x7f44f41083b0 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.518+0000 7f44e67fc640 1 -- 172.21.15.102:0/1053285606 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8018630 con 0x7f44f41083b0 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.520+0000 7f45019c0740 1 Processor -- start 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.520+0000 7f45019c0740 1 -- start start 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.520+0000 7f45019c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.520+0000 7f45019c0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737883b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f45019c0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x5617378840d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f45019c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5617377f9e50 con 0x5617374dc070 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f45019c0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5617377e9280 con 0x5617374bb390 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f45019c0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5617377ed090 con 0x5617374b31b0 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36822/0 (socket says 172.21.15.102:36822) 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 -- 172.21.15.102:0/525537950 learned_addr learned my addr 172.21.15.102:0/525537950 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f91e8640 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737883b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44e67fc640 1 -- 172.21.15.102:0/1053285606 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f44e80046c0 con 0x7f44f41083b0 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 -- 172.21.15.102:0/525537950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 msgr2=0x561737883b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737883b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 -- 172.21.15.102:0/525537950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 msgr2=0x5617378840d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x5617378840d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 -- 172.21.15.102:0/525537950 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737547650 con 0x5617374dc070 2024-09-21T03:35:47.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f91e8640 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737883b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.521+0000 7f44f99e9640 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f44f0033000 tx=0x7f44f0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f295436480aeeee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.522+0000 7f44df7fe640 1 -- 172.21.15.102:0/525537950 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0040070 con 0x5617374dc070 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.522+0000 7f44df7fe640 1 -- 172.21.15.102:0/525537950 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f0031790 con 0x5617374dc070 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.522+0000 7f44df7fe640 1 -- 172.21.15.102:0/525537950 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f0035040 con 0x5617374dc070 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.522+0000 7f44e67fc640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 0x7f44e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.522+0000 7f44e67fc640 1 -- 172.21.15.102:0/1053285606 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44e80e7c60 con 0x7f44f41083b0 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 -- 172.21.15.102:0/525537950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 msgr2=0x561737883650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f44f0033000 tx=0x7f44f0005e50 comp rx=0 tx=0).stop 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f44f91e8640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 0x7f44e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 -- 172.21.15.102:0/525537950 shutdown_connections 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x5617378840d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737883b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 --2- 172.21.15.102:0/525537950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737883650 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 -- 172.21.15.102:0/525537950 >> 172.21.15.102:0/525537950 conn(0x5617374d0460 msgr2=0x561737881540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 -- 172.21.15.102:0/525537950 shutdown_connections 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.523+0000 7f45019c0740 1 -- 172.21.15.102:0/525537950 wait complete. 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.524+0000 7f44f91e8640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 0x7f44e00b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5617378822d0 tx=0x7f44ec009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.524+0000 7f45019c0740 1 -- start start 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.524+0000 7f45019c0740 1 Processor -- start 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 0x56173788edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 0x56173789b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56173764a700 con 0x5617374b31b0 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561737784110 con 0x5617374bb390 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561737891dd0 con 0x5617374dc070 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f45019c0740 10 client.0 _ll_register_callbacks cb 0x56173779d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:47.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f91e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 0x56173788edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36634/0 (socket says 172.21.15.102:36634) 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 -- 172.21.15.102:0/2700333238 learned_addr learned my addr 172.21.15.102:0/2700333238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f99e9640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 0x56173789b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 -- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 msgr2=0x56173789b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 0x56173789b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 -- 172.21.15.102:0/2700333238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 msgr2=0x56173788edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 0x56173788edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f89e7640 1 -- 172.21.15.102:0/2700333238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617377b1c40 con 0x5617374bb390 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f91e8640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 0x56173788edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.525+0000 7f44f99e9640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 0x56173789b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44f89e7640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad7a0 tx=0x7f44e80aa1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc2a73e0bdcd6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:47.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e80ad210 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44e80b2170 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f0031790 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f44e80ad5b0 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f45019c0740 10 client.25268 fetch_fsmap learned FSMap version 27 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56173789dc00 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f0031790 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.526+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f44e80cfab0 con 0x5617374bb390 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 10 client.25268 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 10 client.25268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 20 client.25268 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173749a9f0 0x5617378a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 4 client.25268 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617377fbda0 con 0x56173749a9f0 2024-09-21T03:35:47.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f44f91e8640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173749a9f0 0x5617378a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f44dcff9640 10 client.25268 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:47.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.527+0000 7f44f91e8640 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173749a9f0 0x5617378a10d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea55db7dac39675 server_cookie=139803c2f3de351e in_seq=0 out_seq=0 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f44dcff9640 1 -- 172.21.15.102:0/2700333238 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617377fbda0 con 0x56173749a9f0 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f44dcff9640 10 client.25268 handle_command_reply: tid=0 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 client.25268 shutdown 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 msgr2=0x56173788f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad7a0 tx=0x7f44e80aa1f0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 shutdown_connections 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374dc070 0x56173789b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x56173788f300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173749a9f0 0x5617378a10d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 --2- 172.21.15.102:0/2700333238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374b31b0 0x56173788edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f44dcff9640 0 client.25268 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 >> 172.21.15.102:0/2700333238 conn(0x5617374d0460 msgr2=0x561737886830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 shutdown_connections 2024-09-21T03:35:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.529+0000 7f45019c0740 1 -- 172.21.15.102:0/2700333238 wait complete. 2024-09-21T03:35:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.530+0000 7f45019c0740 20 client.25268 trim_cache size 0 max 16384 2024-09-21T03:35:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 Processor -- start 2024-09-21T03:35:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 -- start start 2024-09-21T03:35:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 0x561737886750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 0x561737886c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b43d0 con 0x5617374dc070 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b1c40 con 0x5617374b31b0 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f45019c0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41afa90 con 0x5617374bb390 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.547+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 0x561737886c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36842/0 (socket says 172.21.15.102:36842) 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f99e9640 1 -- 172.21.15.102:0/3912149770 learned_addr learned my addr 172.21.15.102:0/3912149770 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f91e8640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 0x561737886750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 -- 172.21.15.102:0/3912149770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 msgr2=0x561737886750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 0x561737886750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 -- 172.21.15.102:0/3912149770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 msgr2=0x56173788bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 -- 172.21.15.102:0/3912149770 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561737885da0 con 0x5617374bb390 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f91e8640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 0x561737886750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f99e9640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44f89e7640 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 0x561737886c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad750 tx=0x7f44e8095050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bee6a1cd3394ac0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44deffd640 1 -- 172.21.15.102:0/3912149770 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e80ad210 con 0x5617374bb390 2024-09-21T03:35:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44deffd640 1 -- 172.21.15.102:0/3912149770 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44e80ae1a0 con 0x5617374bb390 2024-09-21T03:35:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.548+0000 7f44deffd640 1 -- 172.21.15.102:0/3912149770 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e80ac770 con 0x5617374bb390 2024-09-21T03:35:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- 172.21.15.102:0/3912149770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 msgr2=0x561737886c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 0x561737886c90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad750 tx=0x7f44e8095050 comp rx=0 tx=0).stop 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- 172.21.15.102:0/3912149770 shutdown_connections 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x56173788bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374bb390 0x561737886c90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 --2- 172.21.15.102:0/3912149770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374b31b0 0x561737886750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- 172.21.15.102:0/3912149770 >> 172.21.15.102:0/3912149770 conn(0x5617374d0460 msgr2=0x56173788d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- 172.21.15.102:0/3912149770 shutdown_connections 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- 172.21.15.102:0/3912149770 wait complete. 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 -- start start 2024-09-21T03:35:47.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.550+0000 7f45019c0740 1 Processor -- start 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f45019c0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737897a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f45019c0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f45019c0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f44f91e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737897a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f44f91e8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737897a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:37396/0 (socket says 172.21.15.102:37396) 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f44f89e7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36656/0 (socket says 172.21.15.102:36656) 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.551+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f99e9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36846/0 (socket says 172.21.15.102:36846) 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b0100 con 0x5617374dc070 2024-09-21T03:35:47.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f91e8640 1 -- 172.21.15.102:0/363481305 learned_addr learned my addr 172.21.15.102:0/363481305 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b1570 con 0x5617374bb390 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44f41b07d0 con 0x5617374b31b0 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f45019c0740 10 client.0 _ll_register_callbacks cb 0x7f44e8004a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 -- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 msgr2=0x561737897a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737897a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 -- 172.21.15.102:0/363481305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 msgr2=0x561737893690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56173789b860 con 0x5617374bb390 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f99e9640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e80ae1a0 con 0x5617374bb390 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44f89e7640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad750 tx=0x7f44e800efb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=628185d0c0ec0d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44dcff9640 10 client.25274 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:47.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.552+0000 7f44dcff9640 1 -- 172.21.15.102:0/363481305 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e80ad210 con 0x5617374bb390 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f44dcff9640 1 -- 172.21.15.102:0/363481305 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44e80a93f0 con 0x5617374bb390 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f44dcff9640 1 -- 172.21.15.102:0/363481305 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f44e80a95f0 con 0x5617374bb390 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 10 client.25274 fetch_fsmap learned FSMap version 27 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=27}) -- 0x56173789b860 con 0x5617374bb390 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f44dcff9640 1 -- 172.21.15.102:0/363481305 <== mon.2 v2:172.21.15.121:3300/0 4 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f44e80ac770 con 0x5617374bb390 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 10 client.25274 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 10 client.25274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 20 client.25274 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173746fda0 0x56173790da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 4 client.25274 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617377f7850 con 0x56173746fda0 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.553+0000 7f44f91e8640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173746fda0 0x56173790da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:47.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.554+0000 7f44f91e8640 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173746fda0 0x56173790da90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a77339c25e06aba server_cookie=df12b5470e313e1 in_seq=0 out_seq=0 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.554+0000 7f44dcff9640 10 client.25274 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.554+0000 7f44dcff9640 1 -- 172.21.15.102:0/363481305 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x5617377f7850 con 0x56173746fda0 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.554+0000 7f44dcff9640 10 client.25274 handle_command_reply: tid=0 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.554+0000 7f45019c0740 1 client.25274 shutdown 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 msgr2=0x561737892f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f44e80ad750 tx=0x7f44e800efb0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 shutdown_connections 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56173746fda0 0x56173790da90 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5617374dc070 0x561737893690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5617374bb390 0x561737892f80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f44dcff9640 0 client.25274 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 --2- 172.21.15.102:0/363481305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5617374b31b0 0x561737897a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 >> 172.21.15.102:0/363481305 conn(0x5617374d0460 msgr2=0x561737884680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 shutdown_connections 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 1 -- 172.21.15.102:0/363481305 wait complete. 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f45019c0740 20 client.25274 trim_cache size 0 max 16384 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:47.561 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:35:47.562 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:47.563 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 msgr2=0x7f44e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 0x7f44e00b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x5617378822d0 tx=0x7f44ec009500 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 msgr2=0x7f44f4110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.555+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f44e800e9c0 tx=0x7f44e800ee80 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 shutdown_connections 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44e00b6680 0x7f44e00b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44f41083b0 0x7f44f4110500 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44f4108d00 0x7f44f4110a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 --2- 172.21.15.102:0/1053285606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44f4102a70 0x7f44f410ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 >> 172.21.15.102:0/1053285606 conn(0x7f44f4079730 msgr2=0x7f44f4105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 shutdown_connections 2024-09-21T03:35:47.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:47.556+0000 7f44fb44c640 1 -- 172.21.15.102:0/1053285606 wait complete. 2024-09-21T03:35:47.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:47 smithi148 ceph-mon[34651]: pgmap v390: 97 pgs: 97 active+clean; 227 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 582 op/s 2024-09-21T03:35:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:47 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:47.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:47 smithi121 ceph-mon[34316]: pgmap v390: 97 pgs: 97 active+clean; 227 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.6 MiB/s wr, 582 op/s 2024-09-21T03:35:47.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:47 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:48.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:35:48.350 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:35:48.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:48 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:48.612 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:48 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:48 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 -- 172.21.15.102:0/2341770489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68102a70 msgr2=0x7f0f68102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 --2- 172.21.15.102:0/2341770489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68102a70 0x7f0f68102e80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009900 tx=0x7f0f6402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 -- 172.21.15.102:0/2341770489 shutdown_connections 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 --2- 172.21.15.102:0/2341770489 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68108d00 0x7f0f6810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 --2- 172.21.15.102:0/2341770489 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 0x7f0f681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 --2- 172.21.15.102:0/2341770489 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68102a70 0x7f0f68102e80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.125+0000 7f0f6f555640 1 -- 172.21.15.102:0/2341770489 >> 172.21.15.102:0/2341770489 conn(0x7f0f68079730 msgr2=0x7f0f68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.126+0000 7f0f6f555640 1 -- 172.21.15.102:0/2341770489 shutdown_connections 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.126+0000 7f0f6f555640 1 -- 172.21.15.102:0/2341770489 wait complete. 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.126+0000 7f0f6f555640 1 Processor -- start 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.126+0000 7f0f6f555640 1 -- start start 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68102a70 0x7f0f68199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 0x7f0f68199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112ab0 con 0x7f0f68108d00 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112930 con 0x7f0f681083b0 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6f555640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0f68112c30 con 0x7f0f68102a70 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36872/0 (socket says 172.21.15.102:36872) 2024-09-21T03:35:49.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 -- 172.21.15.102:0/3298549856 learned_addr learned my addr 172.21.15.102:0/3298549856 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6d2f1640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68102a70 0x7f0f68199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6caf0640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 0x7f0f68199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 -- 172.21.15.102:0/3298549856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68102a70 msgr2=0x7f0f68199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68102a70 0x7f0f68199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 -- 172.21.15.102:0/3298549856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 msgr2=0x7f0f68199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 0x7f0f68199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 -- 172.21.15.102:0/3298549856 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6819f3b0 con 0x7f0f68108d00 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f6daf2640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000eb10 tx=0x7f0f6000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.127+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60004b20 con 0x7f0f68108d00 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.128+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6819f6a0 con 0x7f0f68108d00 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.128+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0f60004cc0 con 0x7f0f68108d00 2024-09-21T03:35:49.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.128+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60010720 con 0x7f0f68108d00 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.128+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6806bae0 con 0x7f0f68108d00 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.129+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f68103cf0 con 0x7f0f68108d00 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.131+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f0f60005020 con 0x7f0f68108d00 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.132+0000 7f0f5e7fc640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 0x7f0f540b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.132+0000 7f0f6d2f1640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 0x7f0f540b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.132+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f0f600e7eb0 con 0x7f0f68108d00 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.132+0000 7f0f6d2f1640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 0x7f0f540b8bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009230 tx=0x7f0f640058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:49.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.135+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f60056710 con 0x7f0f68108d00 2024-09-21T03:35:49.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.355+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f68102e80 con 0x7f0f68108d00 2024-09-21T03:35:49.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.356+0000 7f0f5e7fc640 1 -- 172.21.15.102:0/3298549856 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11938 (secure 0 0 0) 0x7f0f68102e80 con 0x7f0f68108d00 2024-09-21T03:35:49.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:35:49.358 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":27,"btime":"2024-09-21T03:35:47:365175+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:35:46.412099+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:35:49.359 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 27 2024-09-21T03:35:49.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 msgr2=0x7f0f540b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:49.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 0x7f0f540b8bc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009230 tx=0x7f0f640058d0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 msgr2=0x7f0f6819ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:49.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000eb10 tx=0x7f0f6000c2d0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 shutdown_connections 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f0f540b66b0 0x7f0f540b8bc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f68108d00 0x7f0f6819ed40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0f681083b0 0x7f0f68199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 --2- 172.21.15.102:0/3298549856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0f68102a70 0x7f0f68199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 >> 172.21.15.102:0/3298549856 conn(0x7f0f68079730 msgr2=0x7f0f68101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 shutdown_connections 2024-09-21T03:35:49.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:49.358+0000 7f0f6f555640 1 -- 172.21.15.102:0/3298549856 wait complete. 2024-09-21T03:35:49.671 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:49 smithi102 ceph-mon[31392]: pgmap v391: 97 pgs: 97 active+clean; 227 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 437 op/s 2024-09-21T03:35:49.671 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:49 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3298549856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:49 smithi148 ceph-mon[34651]: pgmap v391: 97 pgs: 97 active+clean; 227 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 437 op/s 2024-09-21T03:35:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:49 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3298549856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:49 smithi121 ceph-mon[34316]: pgmap v391: 97 pgs: 97 active+clean; 227 MiB data, 846 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.8 MiB/s wr, 437 op/s 2024-09-21T03:35:49.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:49 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3298549856' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:35:50.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:35:50.259 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- 172.21.15.102:0/3518965199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa510103b60 msgr2=0x7fa510103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 --2- 172.21.15.102:0/3518965199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa510103b60 0x7fa510103f70 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa500009900 tx=0x7fa50002a410 comp rx=0 tx=0).stop 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- 172.21.15.102:0/3518965199 shutdown_connections 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 --2- 172.21.15.102:0/3518965199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510109df0 0x7fa510110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 --2- 172.21.15.102:0/3518965199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5101094a0 0x7fa5101098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 --2- 172.21.15.102:0/3518965199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa510103b60 0x7fa510103f70 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- 172.21.15.102:0/3518965199 >> 172.21.15.102:0/3518965199 conn(0x7fa51007b850 msgr2=0x7fa51007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- 172.21.15.102:0/3518965199 shutdown_connections 2024-09-21T03:35:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- 172.21.15.102:0/3518965199 wait complete. 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 Processor -- start 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.742+0000 7fa515d67640 1 -- start start 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510103b60 0x7fa51019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa510109df0 0x7fa51019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa510113c50 con 0x7fa5101094a0 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa510113ad0 con 0x7fa510109df0 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa515d67640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa510113dd0 con 0x7fa510103b60 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36896/0 (socket says 172.21.15.102:36896) 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 -- 172.21.15.102:0/3590261246 learned_addr learned my addr 172.21.15.102:0/3590261246 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa50ffff640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa510109df0 0x7fa51019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510103b60 0x7fa51019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 -- 172.21.15.102:0/3590261246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510103b60 msgr2=0x7fa51019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510103b60 0x7fa51019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 -- 172.21.15.102:0/3590261246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa510109df0 msgr2=0x7fa51019ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa510109df0 0x7fa51019ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.743+0000 7fa506ffd640 1 -- 172.21.15.102:0/3590261246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5101a0570 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa506ffd640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c8c0 tx=0x7fa4f800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa50d7fa640 1 -- 172.21.15.102:0/3590261246 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007bb0 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa50d7fa640 1 -- 172.21.15.102:0/3590261246 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4f8007d50 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5101a0860 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa50d7fa640 1 -- 172.21.15.102:0/3590261246 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80188c0 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.744+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101a7080 con 0x7fa5101094a0 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.746+0000 7fa51c2db740 1 Processor -- start 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.746+0000 7fa51c2db740 1 -- start start 2024-09-21T03:35:50.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.746+0000 7fa50d7fa640 1 -- 172.21.15.102:0/3590261246 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa4f800fb60 con 0x7fa5101094a0 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128301be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d128302120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d128277ea0 con 0x55d127f5a070 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d1282672d0 con 0x55d127f39390 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa51c2db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d12826b0e0 con 0x55d127f311b0 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36898/0 (socket says 172.21.15.102:36898) 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 -- 172.21.15.102:0/276802299 learned_addr learned my addr 172.21.15.102:0/276802299 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa506ffd640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d128302120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128301be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 -- 172.21.15.102:0/276802299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 msgr2=0x55d128301be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128301be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 -- 172.21.15.102:0/276802299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 msgr2=0x55d128302120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d128302120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 -- 172.21.15.102:0/276802299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d127fc5650 con 0x55d127f5a070 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa506ffd640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d128302120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50ffff640 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a430 tx=0x7fa508009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1729f6772e058b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50d7fa640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 0x7fa4fc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 0x7fa4fc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.747+0000 7fa505ffb640 1 -- 172.21.15.102:0/276802299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508013790 con 0x55d127f5a070 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa505ffb640 1 -- 172.21.15.102:0/276802299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa508019070 con 0x55d127f5a070 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa505ffb640 1 -- 172.21.15.102:0/276802299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508014d90 con 0x55d127f5a070 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa50d7fa640 1 -- 172.21.15.102:0/3590261246 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa4f80e7800 con 0x7fa5101094a0 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 -- 172.21.15.102:0/276802299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 msgr2=0x55d1283016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 0x7fa4fc0b8bc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55d128300320 tx=0x7fa500009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa50800a430 tx=0x7fa508009650 comp rx=0 tx=0).stop 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 -- 172.21.15.102:0/276802299 shutdown_connections 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d128302120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128301be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 --2- 172.21.15.102:0/276802299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d1283016a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 -- 172.21.15.102:0/276802299 >> 172.21.15.102:0/276802299 conn(0x55d127f4e460 msgr2=0x55d1282ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 -- 172.21.15.102:0/276802299 shutdown_connections 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.748+0000 7fa51c2db740 1 -- 172.21.15.102:0/276802299 wait complete. 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.749+0000 7fa51c2db740 1 -- start start 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.749+0000 7fa51c2db740 1 Processor -- start 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.749+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128311160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.749+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.749+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa51c2db740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d1280c8700 con 0x55d127f5a070 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa51c2db740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d128202160 con 0x55d127f39390 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa51c2db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d1283141e0 con 0x55d127f311b0 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa51c2db740 10 client.0 _ll_register_callbacks cb 0x55d12821b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36904/0 (socket says 172.21.15.102:36904) 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa506ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36688/0 (socket says 172.21.15.102:36688) 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 -- 172.21.15.102:0/1641037649 learned_addr learned my addr 172.21.15.102:0/1641037649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128311160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 -- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 msgr2=0x55d128311160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128311160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 -- 172.21.15.102:0/1641037649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 msgr2=0x55d1283116a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 -- 172.21.15.102:0/1641037649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d12822fc90 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa506ffd640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa50ffff640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa50800afd0 tx=0x7fa508014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0d8e376bb4e457 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa4eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508015de0 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa508013590 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.750+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa508019070 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa508013790 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 10 client.15786 fetch_fsmap learned FSMap version 27 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d12831fef0 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa508019070 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa508027a00 con 0x55d127f5a070 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 10 client.15786 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:35:50.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 10 client.15786 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 20 client.15786 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127f189f0 0x55d128323360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 4 client.15786 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d128279df0 con 0x55d127f189f0 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.751+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127f189f0 0x55d128323360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.752+0000 7fa4eeffd640 10 client.15786 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:50.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.752+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127f189f0 0x55d128323360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7ec31ad07b4acdb server_cookie=1ffb1e5ebf21c6eb in_seq=0 out_seq=0 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa4eeffd640 1 -- 172.21.15.102:0/1641037649 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d128279df0 con 0x55d127f189f0 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa4eeffd640 10 client.15786 handle_command_reply: tid=0 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 client.15786 shutdown 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 msgr2=0x55d12831d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa50800afd0 tx=0x7fa508014650 comp rx=0 tx=0).stop 2024-09-21T03:35:50.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 shutdown_connections 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127f189f0 0x55d128323360 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d12831d510 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d1283116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa4eeffd640 0 client.15786 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 --2- 172.21.15.102:0/1641037649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f311b0 0x55d128311160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 >> 172.21.15.102:0/1641037649 conn(0x55d127f4e460 msgr2=0x55d1282fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 shutdown_connections 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 1 -- 172.21.15.102:0/1641037649 wait complete. 2024-09-21T03:35:50.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.753+0000 7fa51c2db740 20 client.15786 trim_cache size 0 max 16384 2024-09-21T03:35:50.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 Processor -- start 2024-09-21T03:35:50.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 -- start start 2024-09-21T03:35:50.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d12831d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f5a070 0x55d12830e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101b00c0 con 0x55d127f311b0 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101ad930 con 0x55d127f39390 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa51c2db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101ab780 con 0x55d127f5a070 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa50f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa50f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36908/0 (socket says 172.21.15.102:36908) 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.766+0000 7fa50f7fe640 1 -- 172.21.15.102:0/2089915878 learned_addr learned my addr 172.21.15.102:0/2089915878 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50ffff640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f5a070 0x55d12830e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa506ffd640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d12831d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 -- 172.21.15.102:0/2089915878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f5a070 msgr2=0x55d12830e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f5a070 0x55d12830e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 -- 172.21.15.102:0/2089915878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 msgr2=0x55d12831d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d12831d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 -- 172.21.15.102:0/2089915878 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1283044d0 con 0x55d127f311b0 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa506ffd640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d12831d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa50002a930 tx=0x7fa50003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81431092aee011fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa5057fa640 1 -- 172.21.15.102:0/2089915878 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500054070 con 0x55d127f311b0 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa5057fa640 1 -- 172.21.15.102:0/2089915878 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5000041c0 con 0x55d127f311b0 2024-09-21T03:35:50.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.767+0000 7fa5057fa640 1 -- 172.21.15.102:0/2089915878 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500035050 con 0x55d127f311b0 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- 172.21.15.102:0/2089915878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 msgr2=0x55d128302de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa50002a930 tx=0x7fa50003f000 comp rx=0 tx=0).stop 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- 172.21.15.102:0/2089915878 shutdown_connections 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f5a070 0x55d12830e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f39390 0x55d12831d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2089915878 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f311b0 0x55d128302de0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- 172.21.15.102:0/2089915878 >> 172.21.15.102:0/2089915878 conn(0x55d127f4e460 msgr2=0x55d1283026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- 172.21.15.102:0/2089915878 shutdown_connections 2024-09-21T03:35:50.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- 172.21.15.102:0/2089915878 wait complete. 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.768+0000 7fa51c2db740 1 -- start start 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 Processor -- start 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f311b0 0x55d128319cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f39390 0x55d128315170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101abdf0 con 0x55d127f5a070 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101ad260 con 0x55d127f311b0 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101ac4c0 con 0x55d127f39390 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa51c2db740 10 client.0 _ll_register_callbacks cb 0x7fa508009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36922/0 (socket says 172.21.15.102:36922) 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 -- 172.21.15.102:0/2244221797 learned_addr learned my addr 172.21.15.102:0/2244221797 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:50.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f311b0 0x55d128319cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa506ffd640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f39390 0x55d128315170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 -- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f39390 msgr2=0x55d128315170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f39390 0x55d128315170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 -- 172.21.15.102:0/2244221797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f311b0 msgr2=0x55d128319cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f311b0 0x55d128319cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.769+0000 7fa50ffff640 1 -- 172.21.15.102:0/2244221797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d128315ea0 con 0x55d127f5a070 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa50ffff640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa508027dc0 tx=0x7fa508013b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507495f3ea708da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5080146c0 con 0x55d127f5a070 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa508014860 con 0x55d127f5a070 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5000041c0 con 0x55d127f5a070 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa508014a60 con 0x55d127f5a070 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa51c2db740 10 client.15792 fetch_fsmap learned FSMap version 27 2024-09-21T03:35:50.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d12838dc00 con 0x55d127f5a070 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5000041c0 con 0x55d127f5a070 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.770+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fa508036070 con 0x55d127f5a070 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 10 client.15792 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 10 client.15792 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 20 client.15792 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127eedda0 0x55d128390180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 4 client.15792 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1282758a0 con 0x55d127eedda0 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127eedda0 0x55d128390180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa4eeffd640 10 client.15792 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.771+0000 7fa50f7fe640 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127eedda0 0x55d128390180 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=805648e1c03ec4de server_cookie=b2b3a3eb14d1676c in_seq=0 out_seq=0 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa4eeffd640 1 -- 172.21.15.102:0/2244221797 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1282758a0 con 0x55d127eedda0 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa4eeffd640 10 client.15792 handle_command_reply: tid=0 2024-09-21T03:35:50.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 client.15792 shutdown 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 msgr2=0x55d128315710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa508027dc0 tx=0x7fa508013b60 comp rx=0 tx=0).stop 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 shutdown_connections 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d127eedda0 0x55d128390180 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa4eeffd640 0 client.15792 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d127f5a070 0x55d128315710 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d127f39390 0x55d128315170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 --2- 172.21.15.102:0/2244221797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d127f311b0 0x55d128319cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 >> 172.21.15.102:0/2244221797 conn(0x55d127f4e460 msgr2=0x55d128307200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 shutdown_connections 2024-09-21T03:35:50.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 1 -- 172.21.15.102:0/2244221797 wait complete. 2024-09-21T03:35:50.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.772+0000 7fa51c2db740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T03:35:50.780 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 msgr2=0x7fa4fc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 0x7fa4fc0b8bc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55d128300320 tx=0x7fa500009680 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 msgr2=0x7fa51019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c8c0 tx=0x7fa4f800cd80 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 shutdown_connections 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4fc0b66b0 0x7fa4fc0b8bc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5101094a0 0x7fa51019ac60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa510109df0 0x7fa51019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 --2- 172.21.15.102:0/3590261246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa510103b60 0x7fa51019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 >> 172.21.15.102:0/3590261246 conn(0x7fa51007b850 msgr2=0x7fa5101075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:50.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 shutdown_connections 2024-09-21T03:35:50.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:50.773+0000 7fa515d67640 1 -- 172.21.15.102:0/3590261246 wait complete. 2024-09-21T03:35:51.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:51 smithi102 ceph-mon[31392]: pgmap v392: 97 pgs: 97 active+clean; 227 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T03:35:51.609 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:35:51.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:51 smithi148 ceph-mon[34651]: pgmap v392: 97 pgs: 97 active+clean; 227 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T03:35:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:51 smithi121 ceph-mon[34316]: pgmap v392: 97 pgs: 97 active+clean; 227 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 345 op/s 2024-09-21T03:35:51.862 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:52.263 INFO:tasks.workunit.client.0.smithi102.stderr:+ sync 2024-09-21T03:35:52.515 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:52 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:52.515 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:52 smithi102 ceph-mon[31392]: pgmap v393: 97 pgs: 97 active+clean; 230 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-21T03:35:52.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:52 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:52.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:52 smithi148 ceph-mon[34651]: pgmap v393: 97 pgs: 97 active+clean; 230 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-21T03:35:52.789 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:52 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:52.790 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:52 smithi121 ceph-mon[34316]: pgmap v393: 97 pgs: 97 active+clean; 230 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-21T03:35:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:53 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 -- 172.21.15.102:0/2354469750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58103b60 msgr2=0x7f5d58103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/2354469750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58103b60 0x7f5d58103f70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009900 tx=0x7f5d5402a410 comp rx=0 tx=0).stop 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 -- 172.21.15.102:0/2354469750 shutdown_connections 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/2354469750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d58109df0 0x7f5d58110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/2354469750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d581094a0 0x7f5d581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/2354469750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58103b60 0x7f5d58103f70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 -- 172.21.15.102:0/2354469750 >> 172.21.15.102:0/2354469750 conn(0x7f5d580ff5d0 msgr2=0x7f5d58101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 -- 172.21.15.102:0/2354469750 shutdown_connections 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.511+0000 7f5d5fe77640 1 -- 172.21.15.102:0/2354469750 wait complete. 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.513+0000 7f5d5fe77640 1 Processor -- start 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.513+0000 7f5d5fe77640 1 -- start start 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.514+0000 7f5d5fe77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.514+0000 7f5d5fe77640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.514+0000 7f5d5fe77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58109df0 0x7f5d5819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.515+0000 7f5d5dc13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.515+0000 7f5d5dc13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36708/0 (socket says 172.21.15.102:36708) 2024-09-21T03:35:53.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5d412640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5fe77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58113ca0 con 0x7f5d58109df0 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5fe77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58113b20 con 0x7f5d58103b60 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5fe77640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d58113e20 con 0x7f5d581094a0 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5d412640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:37510/0 (socket says 172.21.15.102:37510) 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.517+0000 7f5d5d412640 1 -- 172.21.15.102:0/1759389102 learned_addr learned my addr 172.21.15.102:0/1759389102 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.518+0000 7f5d5d412640 1 -- 172.21.15.102:0/1759389102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 msgr2=0x7f5d5819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.518+0000 7f5d5d412640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.518+0000 7f5d5d412640 1 -- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58109df0 msgr2=0x7f5d5819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.518+0000 7f5d5d412640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58109df0 0x7f5d5819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.518+0000 7f5d5d412640 1 -- 172.21.15.102:0/1759389102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d581a0330 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.520+0000 7f5d5d412640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d4800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.523+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.523+0000 7f5d4effd640 1 -- 172.21.15.102:0/1759389102 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48011830 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.523+0000 7f5d4effd640 1 -- 172.21.15.102:0/1759389102 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d48016070 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.523+0000 7f5d4effd640 1 -- 172.21.15.102:0/1759389102 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800f2e0 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.524+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d581a0620 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.524+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d581a6d80 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.530+0000 7f5d4effd640 1 -- 172.21.15.102:0/1759389102 <== mon.1 v2:172.21.15.148:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f5d480119d0 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.533+0000 7f5d4effd640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 0x7f5d440b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.533+0000 7f5d4effd640 1 -- 172.21.15.102:0/1759389102 <== mon.1 v2:172.21.15.148:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5d480e6700 con 0x7f5d581094a0 2024-09-21T03:35:53.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.534+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 0x7f5d440b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.534+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 0x7f5d440b8ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400b230 tx=0x7f5d5400b040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.535+0000 7f5d663eb740 1 Processor -- start 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.538+0000 7f5d663eb740 1 -- start start 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 0x55cd4975cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 0x55cd4975d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cd496d2ea0 con 0x55cd4938c1b0 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd496c22d0 con 0x55cd49394390 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.539+0000 7f5d663eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cd496c60e0 con 0x55cd493b5070 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.540+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 0x55cd4975d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.540+0000 7f5d5dc13640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.540+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 0x55cd4975d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36718/0 (socket says 172.21.15.102:36718) 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.540+0000 7f5d5e414640 1 -- 172.21.15.102:0/2083025728 learned_addr learned my addr 172.21.15.102:0/2083025728 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.540+0000 7f5d5d412640 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 0x55cd4975cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.541+0000 7f5d5d412640 1 -- 172.21.15.102:0/2083025728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 msgr2=0x55cd4975c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.541+0000 7f5d5d412640 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.541+0000 7f5d5d412640 1 -- 172.21.15.102:0/2083025728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 msgr2=0x55cd4975d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.541+0000 7f5d5d412640 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 0x55cd4975d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.541+0000 7f5d5d412640 1 -- 172.21.15.102:0/2083025728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd49420650 con 0x55cd4938c1b0 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.543+0000 7f5d5d412640 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 0x55cd4975cbe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d480e3e40 tx=0x7f5d480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ee23eb513aaf75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.545+0000 7f5d43fff640 1 -- 172.21.15.102:0/2083025728 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d48010ed0 con 0x55cd4938c1b0 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.545+0000 7f5d43fff640 1 -- 172.21.15.102:0/2083025728 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d480ac0e0 con 0x55cd4938c1b0 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.545+0000 7f5d43fff640 1 -- 172.21.15.102:0/2083025728 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480a8180 con 0x55cd4938c1b0 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 -- 172.21.15.102:0/2083025728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 msgr2=0x55cd4975cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 0x55cd4975cbe0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d480e3e40 tx=0x7f5d480046c0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 -- 172.21.15.102:0/2083025728 shutdown_connections 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd4938c1b0 0x55cd4975cbe0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd49394390 0x55cd4975d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 --2- 172.21.15.102:0/2083025728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.547+0000 7f5d663eb740 1 -- 172.21.15.102:0/2083025728 >> 172.21.15.102:0/2083025728 conn(0x55cd493a9460 msgr2=0x55cd4975a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.548+0000 7f5d663eb740 1 -- 172.21.15.102:0/2083025728 shutdown_connections 2024-09-21T03:35:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.549+0000 7f5d663eb740 1 -- 172.21.15.102:0/2083025728 wait complete. 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.550+0000 7f5d663eb740 1 -- start start 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.550+0000 7f5d663eb740 1 Processor -- start 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.551+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.551+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd49768340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d5dc13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d5dc13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:36722/0 (socket says 172.21.15.102:36722) 2024-09-21T03:35:53.832 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:53 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:53.832 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d5d412640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd49768340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d5d412640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd49768340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:37528/0 (socket says 172.21.15.102:37528) 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d5dc13640 1 -- 172.21.15.102:0/3795696967 learned_addr learned my addr 172.21.15.102:0/3795696967 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd49774170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cd49523700 con 0x55cd493b5070 2024-09-21T03:35:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cd4965d160 con 0x55cd4938c1b0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.552+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cd4976ae80 con 0x55cd49394390 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d663eb740 10 client.0 _ll_register_callbacks cb 0x55cd496769e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 -- 172.21.15.102:0/3795696967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 msgr2=0x55cd49768340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd49768340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 -- 172.21.15.102:0/3795696967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 msgr2=0x55cd49774170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd49774170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4968ac90 con 0x55cd4938c1b0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.553+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009900 tx=0x7f5d54005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99d2b2e7487696bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.554+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d480ac0e0 con 0x55cd4938c1b0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.554+0000 7f5d417fa640 10 client.25298 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.554+0000 7f5d417fa640 1 -- 172.21.15.102:0/3795696967 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d54035070 con 0x55cd4938c1b0 2024-09-21T03:35:53.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.554+0000 7f5d417fa640 1 -- 172.21.15.102:0/3795696967 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5d540048d0 con 0x55cd4938c1b0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.555+0000 7f5d417fa640 1 -- 172.21.15.102:0/3795696967 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d54059050 con 0x55cd4938c1b0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.556+0000 7f5d663eb740 10 client.25298 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.556+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({fsmap=29}) -- 0x55cd49776b70 con 0x55cd4938c1b0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d417fa640 1 -- 172.21.15.102:0/3795696967 <== mon.2 v2:172.21.15.121:3300/0 4 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5d54004ad0 con 0x55cd4938c1b0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 10 client.25298 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 10 client.25298 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 20 client.25298 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd493739f0 0x55cd4977a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 4 client.25298 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.558+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5d480ac0e0 con 0x55cd493739f0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.563+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd493739f0 0x55cd4977a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.573+0000 7f5d417fa640 10 client.25298 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:53.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.573+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd493739f0 0x55cd4977a4e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36c105379977a401 server_cookie=cfebf83d5a40a00b in_seq=0 out_seq=0 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.579+0000 7f5d417fa640 1 -- 172.21.15.102:0/3795696967 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5d480ac0e0 con 0x55cd493739f0 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.579+0000 7f5d417fa640 10 client.25298 handle_command_reply: tid=0 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.579+0000 7f5d663eb740 1 client.25298 shutdown 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 msgr2=0x55cd49767e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009900 tx=0x7f5d54005fd0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 shutdown_connections 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd493739f0 0x55cd4977a4e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d417fa640 0 client.25298 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd49774170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd49768340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3795696967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49767e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 >> 172.21.15.102:0/3795696967 conn(0x55cd493a9460 msgr2=0x55cd4975f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 shutdown_connections 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 1 -- 172.21.15.102:0/3795696967 wait complete. 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.580+0000 7f5d663eb740 20 client.25298 trim_cache size 0 max 16384 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.607+0000 7f5d663eb740 1 Processor -- start 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.607+0000 7f5d663eb740 1 -- start start 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.607+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49769a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd49394390 0x55cd49759bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d663eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581b01b0 con 0x55cd49394390 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d663eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581ad9c0 con 0x55cd4938c1b0 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d663eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581ab810 con 0x55cd493b5070 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:37532/0 (socket says 172.21.15.102:37532) 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d5e414640 1 -- 172.21.15.102:0/3358745875 learned_addr learned my addr 172.21.15.102:0/3358745875 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd49394390 0x55cd49759bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.608+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49769a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 -- 172.21.15.102:0/3358745875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 msgr2=0x55cd49769a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49769a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 -- 172.21.15.102:0/3358745875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd49394390 msgr2=0x55cd49759bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd49394390 0x55cd49759bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 -- 172.21.15.102:0/3358745875 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd4976a3e0 con 0x55cd493b5070 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.609+0000 7f5d5e414640 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d50005c10 tx=0x7f5d500117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55976044b4068157 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.611+0000 7f5d437fe640 1 -- 172.21.15.102:0/3358745875 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50004d20 con 0x55cd493b5070 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.611+0000 7f5d437fe640 1 -- 172.21.15.102:0/3358745875 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d50016070 con 0x55cd493b5070 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.611+0000 7f5d437fe640 1 -- 172.21.15.102:0/3358745875 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d50005020 con 0x55cd493b5070 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.613+0000 7f5d663eb740 1 -- 172.21.15.102:0/3358745875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 msgr2=0x55cd4975a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.613+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5d50005c10 tx=0x7f5d500117b0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.615+0000 7f5d663eb740 1 -- 172.21.15.102:0/3358745875 shutdown_connections 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.615+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd49394390 0x55cd49759bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.615+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd493b5070 0x55cd4975a100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.615+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3358745875 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49769a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.615+0000 7f5d663eb740 1 -- 172.21.15.102:0/3358745875 >> 172.21.15.102:0/3358745875 conn(0x55cd493a9460 msgr2=0x55cd49769320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.616+0000 7f5d663eb740 1 -- 172.21.15.102:0/3358745875 shutdown_connections 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.616+0000 7f5d663eb740 1 -- 172.21.15.102:0/3358745875 wait complete. 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.616+0000 7f5d663eb740 1 -- start start 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.616+0000 7f5d663eb740 1 Processor -- start 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49770940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd4976bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd4976c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581abe80 con 0x55cd493b5070 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581ad2f0 con 0x55cd4938c1b0 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5d581ac550 con 0x55cd49394390 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d663eb740 10 client.0 _ll_register_callbacks cb 0x7f5d54004170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd4976c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d5e414640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd4976c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36984/0 (socket says 172.21.15.102:36984) 2024-09-21T03:35:53.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.617+0000 7f5d5e414640 1 -- 172.21.15.102:0/3830676678 learned_addr learned my addr 172.21.15.102:0/3830676678 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.618+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd4976bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.618+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49770940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.619+0000 7f5d5d412640 1 -- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 msgr2=0x55cd49770940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.619+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49770940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.619+0000 7f5d5d412640 1 -- 172.21.15.102:0/3830676678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 msgr2=0x55cd4976c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.619+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd4976c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.619+0000 7f5d5d412640 1 -- 172.21.15.102:0/3830676678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd4976cb40 con 0x55cd49394390 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.620+0000 7f5d5d412640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd4976bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bde0 tx=0x7f5d4800bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbf2fc602b652360 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.620+0000 7f5d417fa640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:35:53.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.620+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d480be070 con 0x55cd49394390 2024-09-21T03:35:53.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.620+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d50016070 con 0x55cd49394390 2024-09-21T03:35:53.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.620+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5d480c7b90 con 0x55cd49394390 2024-09-21T03:35:53.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.623+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5d480ac0e0 con 0x55cd49394390 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.623+0000 7f5d663eb740 10 client.25360 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.623+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cd497fe6c0 con 0x55cd49394390 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5d50016070 con 0x55cd49394390 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5d480a7f20 con 0x55cd49394390 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 10 client.25360 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 10 client.25360 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:35:53.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 20 client.25360 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd49348da0 0x55cd49800e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 4 client.25360 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.624+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cd496d4df0 con 0x55cd49348da0 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.625+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd49348da0 0x55cd49800e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.625+0000 7f5d417fa640 10 client.25360 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.626+0000 7f5d5dc13640 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd49348da0 0x55cd49800e50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edfb974f892b31ba server_cookie=a1cc398fc67fc522 in_seq=0 out_seq=0 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.626+0000 7f5d417fa640 1 -- 172.21.15.102:0/3830676678 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cd496d4df0 con 0x55cd49348da0 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.626+0000 7f5d417fa640 10 client.25360 handle_command_reply: tid=0 2024-09-21T03:35:53.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.627+0000 7f5d663eb740 1 client.25360 shutdown 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.628+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 msgr2=0x55cd4976bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.628+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd4976bdf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800bde0 tx=0x7f5d4800bf90 comp rx=0 tx=0).stop 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 shutdown_connections 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cd49348da0 0x55cd49800e50 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cd493b5070 0x55cd4976c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cd49394390 0x55cd4976bdf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 --2- 172.21.15.102:0/3830676678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cd4938c1b0 0x55cd49770940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 >> 172.21.15.102:0/3830676678 conn(0x55cd493a9460 msgr2=0x55cd49768340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d417fa640 0 client.25360 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 shutdown_connections 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 1 -- 172.21.15.102:0/3830676678 wait complete. 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.629+0000 7f5d663eb740 20 client.25360 trim_cache size 0 max 16384 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 msgr2=0x7f5d440b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 0x7f5d440b8ce0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5d5400b230 tx=0x7f5d5400b040 comp rx=0 tx=0).stop 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 msgr2=0x7f5d5819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d4800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 shutdown_connections 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5d440b67d0 0x7f5d440b8ce0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d58109df0 0x7f5d5819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5d581094a0 0x7f5d5819a960 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5d48006fd0 tx=0x7f5d4800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 --2- 172.21.15.102:0/1759389102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5d58103b60 0x7f5d5819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:53.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 >> 172.21.15.102:0/1759389102 conn(0x7f5d580ff5d0 msgr2=0x7f5d581072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:53.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 shutdown_connections 2024-09-21T03:35:53.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:52.632+0000 7f5d5fe77640 1 -- 172.21.15.102:0/1759389102 wait complete. 2024-09-21T03:35:53.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:53 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:35:54.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:54 smithi121 ceph-mon[34316]: pgmap v394: 97 pgs: 97 active+clean; 233 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 247 op/s 2024-09-21T03:35:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:54 smithi102 ceph-mon[31392]: pgmap v394: 97 pgs: 97 active+clean; 233 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 247 op/s 2024-09-21T03:35:54.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:54 smithi148 ceph-mon[34651]: pgmap v394: 97 pgs: 97 active+clean; 233 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 247 op/s 2024-09-21T03:35:55.004 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:35:55.256 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.722+0000 7f1724851640 1 -- 172.21.15.102:0/1902807477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720108e30 msgr2=0x7f172010f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.722+0000 7f1724851640 1 --2- 172.21.15.102:0/1902807477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720108e30 0x7f172010f660 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1718009ca0 tx=0x7f171802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 -- 172.21.15.102:0/1902807477 shutdown_connections 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 --2- 172.21.15.102:0/1902807477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720108e30 0x7f172010f660 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 --2- 172.21.15.102:0/1902807477 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 0x7f17201088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 --2- 172.21.15.102:0/1902807477 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720103190 0x7f17201035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 -- 172.21.15.102:0/1902807477 >> 172.21.15.102:0/1902807477 conn(0x7f1720079ec0 msgr2=0x7f172007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 -- 172.21.15.102:0/1902807477 shutdown_connections 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 -- 172.21.15.102:0/1902807477 wait complete. 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 Processor -- start 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.723+0000 7f1724851640 1 -- start start 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 0x7f172019ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720108e30 0x7f172019ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1720112c30 con 0x7f1720103190 2024-09-21T03:35:55.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1720112ab0 con 0x7f17201084e0 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f1724851640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1720112db0 con 0x7f1720108e30 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55808/0 (socket says 172.21.15.102:55808) 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 -- 172.21.15.102:0/1002632866 learned_addr learned my addr 172.21.15.102:0/1002632866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171dd9b640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 0x7f172019ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171ed9d640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720108e30 0x7f172019ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 -- 172.21.15.102:0/1002632866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720108e30 msgr2=0x7f172019ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720108e30 0x7f172019ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 -- 172.21.15.102:0/1002632866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 msgr2=0x7f172019ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 0x7f172019ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 -- 172.21.15.102:0/1002632866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17201a06e0 con 0x7f1720103190 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f171e59c640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f171000d770 tx=0x7f171000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.724+0000 7f170f7fe640 1 -- 172.21.15.102:0/1002632866 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710017070 con 0x7f1720103190 2024-09-21T03:35:55.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.725+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17201a09d0 con 0x7f1720103190 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.725+0000 7f170f7fe640 1 -- 172.21.15.102:0/1002632866 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17100054f0 con 0x7f1720103190 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.725+0000 7f170f7fe640 1 -- 172.21.15.102:0/1002632866 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710004de0 con 0x7f1720103190 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.725+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17201a7130 con 0x7f1720103190 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.727+0000 7f172adc5740 1 Processor -- start 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.727+0000 7f172adc5740 1 -- start start 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f170f7fe640 1 -- 172.21.15.102:0/1002632866 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1710004f80 con 0x7f1720103190 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f96f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f93231b0 0x5601f96f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601f9669ea0 con 0x5601f932b390 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5601f96592d0 con 0x5601f934c070 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f172adc5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5601f965d0e0 con 0x5601f93231b0 2024-09-21T03:35:55.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55820/0 (socket says 172.21.15.102:55820) 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 -- 172.21.15.102:0/41012207 learned_addr learned my addr 172.21.15.102:0/41012207 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171e59c640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f93231b0 0x5601f96f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171ed9d640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f96f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 -- 172.21.15.102:0/41012207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f93231b0 msgr2=0x5601f96f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f93231b0 0x5601f96f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 -- 172.21.15.102:0/41012207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 msgr2=0x5601f96f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f96f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171dd9b640 1 -- 172.21.15.102:0/41012207 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f93b7650 con 0x5601f932b390 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f171ed9d640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f96f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.728+0000 7f170f7fe640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 0x7f17080b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f171dd9b640 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1714009ba0 tx=0x7f1714011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8688b2e2570fb0de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f171ed9d640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 0x7f17080b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f170cff9640 1 -- 172.21.15.102:0/41012207 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714004230 con 0x5601f932b390 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f170f7fe640 1 -- 172.21.15.102:0/1002632866 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f17100e7250 con 0x7f1720103190 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f170cff9640 1 -- 172.21.15.102:0/41012207 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1714009e10 con 0x5601f932b390 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.729+0000 7f170cff9640 1 -- 172.21.15.102:0/41012207 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714004da0 con 0x5601f932b390 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- 172.21.15.102:0/41012207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 msgr2=0x5601f96f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f171ed9d640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 0x7f17080b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17180094e0 tx=0x7f17180093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f1714009ba0 tx=0x7f1714011810 comp rx=0 tx=0).stop 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- 172.21.15.102:0/41012207 shutdown_connections 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96f4120 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f93231b0 0x5601f96f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 --2- 172.21.15.102:0/41012207 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f96f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- 172.21.15.102:0/41012207 >> 172.21.15.102:0/41012207 conn(0x5601f9340460 msgr2=0x5601f96f1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- 172.21.15.102:0/41012207 shutdown_connections 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- 172.21.15.102:0/41012207 wait complete. 2024-09-21T03:35:55.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 -- start start 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.730+0000 7f172adc5740 1 Processor -- start 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f96fec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f96ff700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601f94ba700 con 0x5601f932b390 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5601f95f4160 con 0x5601f93231b0 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5601f9701e80 con 0x5601f934c070 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f172adc5740 10 client.0 _ll_register_callbacks cb 0x5601f960d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55828/0 (socket says 172.21.15.102:55828) 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171dd9b640 1 -- 172.21.15.102:0/800912088 learned_addr learned my addr 172.21.15.102:0/800912088 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f96fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171ed9d640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f96ff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 -- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 msgr2=0x5601f96ff700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f96ff700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 -- 172.21.15.102:0/800912088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 msgr2=0x5601f96ff1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 -- 172.21.15.102:0/800912088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f9621c90 con 0x5601f93231b0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171dd9b640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171ed9d640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f96ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f171e59c640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f96fec80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f17100e4990 tx=0x7f17100ea990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c48d9f81c992ba09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.731+0000 7f1705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020050 con 0x5601f93231b0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f17100a9300 con 0x5601f93231b0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1714009e10 con 0x5601f93231b0 2024-09-21T03:35:55.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1710092e60 con 0x5601f93231b0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 10 client.25316 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5601f970dab0 con 0x5601f93231b0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1714009e10 con 0x5601f93231b0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f17100981a0 con 0x5601f93231b0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 10 client.25316 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 20 client.25316 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f930a9f0 0x5601f9710fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 4 client.25316 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601f966bdf0 con 0x5601f930a9f0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.732+0000 7f171dd9b640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f930a9f0 0x5601f9710fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.733+0000 7f1705ffb640 10 client.25316 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.733+0000 7f171dd9b640 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f930a9f0 0x5601f9710fb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bf94dc8c8dec5dc server_cookie=7ed6b9288ad34b34 in_seq=0 out_seq=0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f1705ffb640 1 -- 172.21.15.102:0/800912088 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601f966bdf0 con 0x5601f930a9f0 2024-09-21T03:35:55.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f1705ffb640 10 client.25316 handle_command_reply: tid=0 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 client.25316 shutdown 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 msgr2=0x5601f96fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f96fec80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f17100e4990 tx=0x7f17100ea990 comp rx=0 tx=0).stop 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 shutdown_connections 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f930a9f0 0x5601f9710fb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f96ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f96ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f1705ffb640 0 client.25316 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 --2- 172.21.15.102:0/800912088 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f96fec80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 >> 172.21.15.102:0/800912088 conn(0x5601f9340460 msgr2=0x5601f96f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 shutdown_connections 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 1 -- 172.21.15.102:0/800912088 wait complete. 2024-09-21T03:35:55.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.734+0000 7f172adc5740 20 client.25316 trim_cache size 0 max 16384 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 Processor -- start 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 -- start start 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f932b390 0x5601f9700650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f9700b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17201b22d0 con 0x5601f93231b0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f17201afae0 con 0x5601f934c070 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f172adc5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f17201ad930 con 0x5601f932b390 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.747+0000 7f171e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55844/0 (socket says 172.21.15.102:55844) 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 -- 172.21.15.102:0/2225482064 learned_addr learned my addr 172.21.15.102:0/2225482064 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171ed9d640 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f9700b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171dd9b640 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f932b390 0x5601f9700650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 -- 172.21.15.102:0/2225482064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f932b390 msgr2=0x5601f9700650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f932b390 0x5601f9700650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 -- 172.21.15.102:0/2225482064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 msgr2=0x5601f9700b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f9700b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 -- 172.21.15.102:0/2225482064 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601f96fd180 con 0x5601f93231b0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f171e59c640 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f17100eaa00 tx=0x7f1710005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44789bd1829a8be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f1707fff640 1 -- 172.21.15.102:0/2225482064 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710014020 con 0x5601f93231b0 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f1707fff640 1 -- 172.21.15.102:0/2225482064 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17100e7020 con 0x5601f93231b0 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.748+0000 7f1707fff640 1 -- 172.21.15.102:0/2225482064 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1710020070 con 0x5601f93231b0 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- 172.21.15.102:0/2225482064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 msgr2=0x5601f96f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f17100eaa00 tx=0x7f1710005480 comp rx=0 tx=0).stop 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- 172.21.15.102:0/2225482064 shutdown_connections 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f934c070 0x5601f9700b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f932b390 0x5601f9700650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 --2- 172.21.15.102:0/2225482064 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f93231b0 0x5601f96f5090 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- 172.21.15.102:0/2225482064 >> 172.21.15.102:0/2225482064 conn(0x5601f9340460 msgr2=0x5601f96fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- 172.21.15.102:0/2225482064 shutdown_connections 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- 172.21.15.102:0/2225482064 wait complete. 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 -- start start 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.749+0000 7f172adc5740 1 Processor -- start 2024-09-21T03:35:55.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f97078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f9703330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f17201adfa0 con 0x5601f932b390 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f17201af410 con 0x5601f93231b0 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f17201ae670 con 0x5601f934c070 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f172adc5740 10 client.0 _ll_register_callbacks cb 0x7f17100eaf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55858/0 (socket says 172.21.15.102:55858) 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 -- 172.21.15.102:0/970521608 learned_addr learned my addr 172.21.15.102:0/970521608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171e59c640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f97078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171ed9d640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f9703330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 -- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 msgr2=0x5601f9703330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f9703330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 -- 172.21.15.102:0/970521608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 msgr2=0x5601f97078d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f97078d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 -- 172.21.15.102:0/970521608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601f9703ac0 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171e59c640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f97078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f171dd9b640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f17140096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c4048918ffdd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.750+0000 7f1705ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171401e040 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f17140035f0 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17100e7020 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f171403a050 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 10 client.15822 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5601f977b910 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f17100e7020 con 0x5601f932b390 2024-09-21T03:35:55.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1714018070 con 0x5601f932b390 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 10 client.15822 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 20 client.15822 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f92dfda0 0x5601f977dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 4 client.15822 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601f96678a0 con 0x5601f92dfda0 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.751+0000 7f171e59c640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f92dfda0 0x5601f977dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f1705ffb640 10 client.15822 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f171e59c640 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f92dfda0 0x5601f977dfe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8adee4fdb39e43c4 server_cookie=965bbd00683e496b in_seq=0 out_seq=0 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f1705ffb640 1 -- 172.21.15.102:0/970521608 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601f96678a0 con 0x5601f92dfda0 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f1705ffb640 10 client.15822 handle_command_reply: tid=0 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 client.15822 shutdown 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 msgr2=0x5601f9702dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f17140096d0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 shutdown_connections 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5601f92dfda0 0x5601f977dfe0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601f932b390 0x5601f9702dd0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5601f934c070 0x5601f9703330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 --2- 172.21.15.102:0/970521608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5601f93231b0 0x5601f97078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 >> 172.21.15.102:0/970521608 conn(0x5601f9340460 msgr2=0x5601f9700900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f1705ffb640 0 client.15822 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 shutdown_connections 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 1 -- 172.21.15.102:0/970521608 wait complete. 2024-09-21T03:35:55.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.752+0000 7f172adc5740 20 client.15822 trim_cache size 0 max 16384 2024-09-21T03:35:55.762 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:35:55.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 msgr2=0x7f17080b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 0x7f17080b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17180094e0 tx=0x7f17180093f0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 msgr2=0x7f172019a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f171000d770 tx=0x7f171000dc30 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 shutdown_connections 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f17080b6680 0x7f17080b8b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1720108e30 0x7f172019ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17201084e0 0x7f172019ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 --2- 172.21.15.102:0/1002632866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1720103190 0x7f172019a770 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 >> 172.21.15.102:0/1002632866 conn(0x7f1720079ec0 msgr2=0x7f1720101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 shutdown_connections 2024-09-21T03:35:55.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:55.753+0000 7f1724851640 1 -- 172.21.15.102:0/1002632866 wait complete. 2024-09-21T03:35:56.659 INFO:tasks.workunit.client.0.smithi102.stderr:+ tar c linux-4.0.5 2024-09-21T03:35:57.032 INFO:tasks.workunit.client.0.smithi102.stdout:Ok 2024-09-21T03:35:57.033 INFO:tasks.workunit.client.0.smithi102.stderr:+ echo Ok 2024-09-21T03:35:57.033 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T03:35:57.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T03:35:57.409 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:35:57.409 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:35:57.661 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:57 smithi102 ceph-mon[31392]: pgmap v395: 97 pgs: 97 active+clean; 246 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 393 op/s 2024-09-21T03:35:57.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:57 smithi148 ceph-mon[34651]: pgmap v395: 97 pgs: 97 active+clean; 246 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 393 op/s 2024-09-21T03:35:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:57 smithi121 ceph-mon[34316]: pgmap v395: 97 pgs: 97 active+clean; 246 MiB data, 906 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.6 MiB/s wr, 393 op/s 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.236+0000 7f145ef13640 1 -- 172.21.15.102:0/2328077435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108340 msgr2=0x7f1458108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.236+0000 7f145ef13640 1 --2- 172.21.15.102:0/2328077435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108340 0x7f1458108750 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1448009900 tx=0x7f144802a410 comp rx=0 tx=0).stop 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 -- 172.21.15.102:0/2328077435 shutdown_connections 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 --2- 172.21.15.102:0/2328077435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108340 0x7f1458108750 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 --2- 172.21.15.102:0/2328077435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1458108c90 0x7f145810f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 --2- 172.21.15.102:0/2328077435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14581076a0 0x7f1458107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 -- 172.21.15.102:0/2328077435 >> 172.21.15.102:0/2328077435 conn(0x7f1458077800 msgr2=0x7f1458077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 -- 172.21.15.102:0/2328077435 shutdown_connections 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 -- 172.21.15.102:0/2328077435 wait complete. 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 Processor -- start 2024-09-21T03:35:58.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 -- start start 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.237+0000 7f145ef13640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 0x7f145819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 0x7f145819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112b00 con 0x7f1458108c90 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112980 con 0x7f1458108340 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1458112c80 con 0x7f14581076a0 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 0x7f145819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f144ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 0x7f145819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55874/0 (socket says 172.21.15.102:55874) 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 -- 172.21.15.102:0/2841805811 learned_addr learned my addr 172.21.15.102:0/2841805811 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 0x7f145819c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:48964/0 (socket says 172.21.15.102:48964) 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 -- 172.21.15.102:0/2841805811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 msgr2=0x7f145819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 0x7f145819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 -- 172.21.15.102:0/2841805811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 msgr2=0x7f145819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 0x7f145819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 -- 172.21.15.102:0/2841805811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14581a2790 con 0x7f1458108c90 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f144ffff640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 0x7f145819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145d4b0640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1450009fd0 tx=0x7f145000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f144dffb640 1 -- 172.21.15.102:0/2841805811 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450017070 con 0x7f1458108c90 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14581a2a80 con 0x7f1458108c90 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f144dffb640 1 -- 172.21.15.102:0/2841805811 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1450003e40 con 0x7f1458108c90 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.238+0000 7f144dffb640 1 -- 172.21.15.102:0/2841805811 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450004820 con 0x7f1458108c90 2024-09-21T03:35:58.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.239+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14581a91e0 con 0x7f1458108c90 2024-09-21T03:35:58.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.241+0000 7f1465487740 1 Processor -- start 2024-09-21T03:35:58.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.241+0000 7f144dffb640 1 -- 172.21.15.102:0/2841805811 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1450003970 con 0x7f1458108c90 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.241+0000 7f1465487740 1 -- start start 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cc1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4c37e60 con 0x55d8f48f1490 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4c27290 con 0x55d8f48f9670 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f1465487740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4c2b0a0 con 0x55d8f491a350 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:48968/0 (socket says 172.21.15.102:48968) 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 -- 172.21.15.102:0/2570488050 learned_addr learned my addr 172.21.15.102:0/2570488050 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f145ccaf640 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cc1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 -- 172.21.15.102:0/2570488050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 msgr2=0x55d8f4cc1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 -- 172.21.15.102:0/2570488050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 msgr2=0x55d8f4cc1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cc1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144ffff640 1 -- 172.21.15.102:0/2570488050 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f4985930 con 0x55d8f491a350 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.242+0000 7f144dffb640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 0x7f14400b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f144ffff640 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1448009230 tx=0x7f1448009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d454a8ceb30209f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f145ccaf640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 0x7f14400b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f144dffb640 1 -- 172.21.15.102:0/2841805811 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f14500e7420 con 0x7f1458108c90 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f143effd640 1 -- 172.21.15.102:0/2570488050 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448044070 con 0x55d8f491a350 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f143effd640 1 -- 172.21.15.102:0/2570488050 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14480054f0 con 0x55d8f491a350 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.243+0000 7f143effd640 1 -- 172.21.15.102:0/2570488050 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448035040 con 0x55d8f491a350 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- 172.21.15.102:0/2570488050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 msgr2=0x55d8f4cc1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1448009230 tx=0x7f1448009600 comp rx=0 tx=0).stop 2024-09-21T03:35:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f145ccaf640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 0x7f14400b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55d8f4cc00b0 tx=0x7f145400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- 172.21.15.102:0/2570488050 shutdown_connections 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cc1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 --2- 172.21.15.102:0/2570488050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f491a350 0x55d8f4cc1430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- 172.21.15.102:0/2570488050 >> 172.21.15.102:0/2570488050 conn(0x55d8f490e740 msgr2=0x55d8f4cbf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- 172.21.15.102:0/2570488050 shutdown_connections 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- 172.21.15.102:0/2570488050 wait complete. 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 -- start start 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.244+0000 7f1465487740 1 Processor -- start 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 0x55d8f4ccd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f491a350 0x55d8f4cd8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4a88890 con 0x55d8f48f1490 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4bc1d40 con 0x55d8f491a350 2024-09-21T03:35:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d8f4ccfbb0 con 0x55d8f48f9670 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f1465487740 10 client.0 _ll_register_callbacks cb 0x55d8f4c25c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 0x55d8f4ccd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55890/0 (socket says 172.21.15.102:55890) 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f145ccaf640 1 -- 172.21.15.102:0/3157065628 learned_addr learned my addr 172.21.15.102:0/3157065628 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f145d4b0640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f491a350 0x55d8f4cd8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 -- 172.21.15.102:0/3157065628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f491a350 msgr2=0x55d8f4cd8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f491a350 0x55d8f4cd8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 -- 172.21.15.102:0/3157065628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 msgr2=0x55d8f4cccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f144ffff640 1 -- 172.21.15.102:0/3157065628 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f4cd9410 con 0x55d8f48f9670 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.245+0000 7f145ccaf640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f144ffff640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 0x55d8f4ccd4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f144802a930 tx=0x7f14480052d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f73e23e4447c042 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144804e070 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14480054f0 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f1448004cb0 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f144805a050 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 10 client.25387 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8f4cdbcd0 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14480054f0 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1448048c70 con 0x55d8f48f9670 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 10 client.25387 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 10 client.25387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.246+0000 7f1465487740 20 client.25387 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48d8cd0 0x55d8f4cdf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f1465487740 4 client.25387 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8f4c39db0 con 0x55d8f48d8cd0 2024-09-21T03:35:58.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f145ccaf640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48d8cd0 0x55d8f4cdf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f1437fff640 10 client.25387 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:58.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.247+0000 7f145ccaf640 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48d8cd0 0x55d8f4cdf030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f28b7dc57db5cda server_cookie=e63a7852f87cff49 in_seq=0 out_seq=0 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1437fff640 1 -- 172.21.15.102:0/3157065628 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8f4c39db0 con 0x55d8f48d8cd0 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1437fff640 10 client.25387 handle_command_reply: tid=0 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 client.25387 shutdown 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 msgr2=0x55d8f4ccd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 0x55d8f4ccd4a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f144802a930 tx=0x7f14480052d0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 shutdown_connections 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f491a350 0x55d8f4cd8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f9670 0x55d8f4ccd4a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48d8cd0 0x55d8f4cdf030 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 --2- 172.21.15.102:0/3157065628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f48f1490 0x55d8f4cccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1437fff640 0 client.25387 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 >> 172.21.15.102:0/3157065628 conn(0x55d8f490e740 msgr2=0x55d8f4cc45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.248+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 shutdown_connections 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.249+0000 7f1465487740 1 -- 172.21.15.102:0/3157065628 wait complete. 2024-09-21T03:35:58.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.249+0000 7f1465487740 20 client.25387 trim_cache size 0 max 16384 2024-09-21T03:35:58.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 Processor -- start 2024-09-21T03:35:58.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 -- start start 2024-09-21T03:35:58.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4cc6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14581b4290 con 0x55d8f491a350 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14581b1aa0 con 0x55d8f48f9670 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f1465487740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14581af8f0 con 0x55d8f48f1490 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4cc6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f144ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55904/0 (socket says 172.21.15.102:55904) 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4cc6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:48986/0 (socket says 172.21.15.102:48986) 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 -- 172.21.15.102:0/1126557625 learned_addr learned my addr 172.21.15.102:0/1126557625 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 -- 172.21.15.102:0/1126557625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 msgr2=0x55d8f4cc6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4cc6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 -- 172.21.15.102:0/1126557625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 msgr2=0x55d8f4cc6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f145d4b0640 1 -- 172.21.15.102:0/1126557625 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8f4cc85f0 con 0x55d8f491a350 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.267+0000 7f144ffff640 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.268+0000 7f145d4b0640 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14500aa580 tx=0x7f14500aca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a52835b1529e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.268+0000 7f143e7fc640 1 -- 172.21.15.102:0/1126557625 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450020030 con 0x55d8f491a350 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.268+0000 7f143e7fc640 1 -- 172.21.15.102:0/1126557625 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1450003c60 con 0x55d8f491a350 2024-09-21T03:35:58.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.268+0000 7f143e7fc640 1 -- 172.21.15.102:0/1126557625 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14500ac240 con 0x55d8f491a350 2024-09-21T03:35:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- 172.21.15.102:0/1126557625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 msgr2=0x55d8f4cbe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f14500aa580 tx=0x7f14500aca80 comp rx=0 tx=0).stop 2024-09-21T03:35:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- 172.21.15.102:0/1126557625 shutdown_connections 2024-09-21T03:35:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4cbe860 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4cc6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 --2- 172.21.15.102:0/1126557625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4cc6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- 172.21.15.102:0/1126557625 >> 172.21.15.102:0/1126557625 conn(0x55d8f490e740 msgr2=0x55d8f4ccb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- 172.21.15.102:0/1126557625 shutdown_connections 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- 172.21.15.102:0/1126557625 wait complete. 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 -- start start 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.269+0000 7f1465487740 1 Processor -- start 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4ce0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4ce0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4d42780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14581aff60 con 0x55d8f491a350 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14581b13d0 con 0x55d8f48f9670 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14581b0630 con 0x55d8f48f1490 2024-09-21T03:35:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1465487740 10 client.0 _ll_register_callbacks cb 0x7f1448005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4d42780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4ce0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145d4b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4d42780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55916/0 (socket says 172.21.15.102:55916) 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145d4b0640 1 -- 172.21.15.102:0/1403043838 learned_addr learned my addr 172.21.15.102:0/1403043838 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f144ffff640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4ce0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 -- 172.21.15.102:0/1403043838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 msgr2=0x55d8f4ce0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4ce0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 -- 172.21.15.102:0/1403043838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 msgr2=0x55d8f4d42780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4d42780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 -- 172.21.15.102:0/1403043838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8f4d42df0 con 0x55d8f48f1490 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f145ccaf640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4ce0970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55d8f4bc1d70 tx=0x7f14540046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb5b40285a381294 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.270+0000 7f1437fff640 10 client.0 ms_handle_connect on v2:172.21.15.148:3300/0 2024-09-21T03:35:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1454035060 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mon.1 v2:172.21.15.148:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f145401eb80 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1450003c60 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f145401ed80 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 10 client.25393 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d8f4d4a190 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mon.1 v2:172.21.15.148:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1450003c60 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mon.1 v2:172.21.15.148:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1454039520 con 0x55d8f48f1490 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 10 client.25393 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 10 client.25393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 20 client.25393 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48ae080 0x55d8f4d4c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 4 client.25393 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d8f4c35860 con 0x55d8f48ae080 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.271+0000 7f144ffff640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48ae080 0x55d8f4d4c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.272+0000 7f1437fff640 10 client.25393 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.272+0000 7f144ffff640 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48ae080 0x55d8f4d4c960 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f6bc3d27a85602 server_cookie=7b515cd0c8058e27 in_seq=0 out_seq=0 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1437fff640 1 -- 172.21.15.102:0/1403043838 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d8f4c35860 con 0x55d8f48ae080 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1437fff640 10 client.25393 handle_command_reply: tid=0 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 client.25393 shutdown 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 msgr2=0x55d8f4ce0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4ce0970 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55d8f4bc1d70 tx=0x7f14540046c0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 shutdown_connections 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8f48ae080 0x55d8f4d4c960 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8f491a350 0x55d8f4d42780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8f48f9670 0x55d8f4ce0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1437fff640 0 client.25393 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 --2- 172.21.15.102:0/1403043838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d8f48f1490 0x55d8f4ce0970 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 >> 172.21.15.102:0/1403043838 conn(0x55d8f490e740 msgr2=0x55d8f4cc6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 shutdown_connections 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 1 -- 172.21.15.102:0/1403043838 wait complete. 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.274+0000 7f1465487740 20 client.25393 trim_cache size 0 max 16384 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:35:58.281 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "d7e65926-e4d9-4f43-a96e-87473c176505", 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 msgr2=0x7f14400b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 0x7f14400b8c10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55d8f4cc00b0 tx=0x7f145400b390 comp rx=0 tx=0).stop 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 msgr2=0x7f14581a2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1450009fd0 tx=0x7f145000b260 comp rx=0 tx=0).stop 2024-09-21T03:35:58.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 shutdown_connections 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f14400b6700 0x7f14400b8c10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1458108c90 0x7f14581a2060 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1458108340 0x7f145819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 --2- 172.21.15.102:0/2841805811 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14581076a0 0x7f145819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 >> 172.21.15.102:0/2841805811 conn(0x7f1458077800 msgr2=0x7f14581053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 shutdown_connections 2024-09-21T03:35:58.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:58.275+0000 7f145ef13640 1 -- 172.21.15.102:0/2841805811 wait complete. 2024-09-21T03:35:59.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:35:59.295 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:35:59.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:59 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:35:59.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:59 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:59.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:59 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:35:59.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:59 smithi102 ceph-mon[31392]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-21T03:35:59.687 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:35:59 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:59 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:59 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:59 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:59 smithi148 ceph-mon[34651]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-21T03:35:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:35:59 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:59 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:35:59.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:59 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:35:59.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:59 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:35:59.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:59 smithi121 ceph-mon[34316]: pgmap v396: 97 pgs: 97 active+clean; 258 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 428 op/s 2024-09-21T03:35:59.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:35:59 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:35:59.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 -- 172.21.15.102:0/3886521602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 msgr2=0x7f7b4c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/3886521602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c10d8d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009900 tx=0x7f7b3402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 -- 172.21.15.102:0/3886521602 shutdown_connections 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/3886521602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c10d8d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/3886521602 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c10de10 0x7f7b4c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/3886521602 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c104860 0x7f7b4c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 -- 172.21.15.102:0/3886521602 >> 172.21.15.102:0/3886521602 conn(0x7f7b4c079730 msgr2=0x7f7b4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 -- 172.21.15.102:0/3886521602 shutdown_connections 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.778+0000 7f7b51e4e640 1 -- 172.21.15.102:0/3886521602 wait complete. 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.779+0000 7f7b51e4e640 1 Processor -- start 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.779+0000 7f7b51e4e640 1 -- start start 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 0x7f7b4c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c10de10 0x7f7b4c19fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55938/0 (socket says 172.21.15.102:55938) 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b4affd640 1 -- 172.21.15.102:0/2116362648 learned_addr learned my addr 172.21.15.102:0/2116362648 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 0x7f7b4c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c113b80 con 0x7f7b4c105290 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c113a00 con 0x7f7b4c104860 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c113d00 con 0x7f7b4c10de10 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.780+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c10de10 0x7f7b4c19fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 -- 172.21.15.102:0/2116362648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c10de10 msgr2=0x7f7b4c19fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c10de10 0x7f7b4c19fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 -- 172.21.15.102:0/2116362648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 msgr2=0x7f7b4c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 0x7f7b4c19a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c1a0540 con 0x7f7b4c105290 2024-09-21T03:35:59.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 0x7f7b4c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7b34005940 tx=0x7f7b34004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b48ff9640 1 -- 172.21.15.102:0/2116362648 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3403f030 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b48ff9640 1 -- 172.21.15.102:0/2116362648 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b34004440 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.781+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c1a07d0 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.782+0000 7f7b48ff9640 1 -- 172.21.15.102:0/2116362648 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34035070 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.782+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c1a6f90 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.785+0000 7f7b48ff9640 1 -- 172.21.15.102:0/2116362648 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7b34042030 con 0x7f7b4c105290 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.785+0000 7f7b583c2740 1 Processor -- start 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.785+0000 7f7b583c2740 1 -- start start 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b48ff9640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 0x7f7b380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 0x5624c96960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92d0390 0x5624c96a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5624c960ee50 con 0x5624c92c81b0 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5624c95fe280 con 0x5624c92f1070 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b583c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5624c9602090 con 0x5624c92d0390 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55950/0 (socket says 172.21.15.102:55950) 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 0x7f7b380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 -- 172.21.15.102:0/2431788961 learned_addr learned my addr 172.21.15.102:0/2431788961 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 0x5624c96960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92d0390 0x5624c96a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b48ff9640 1 -- 172.21.15.102:0/2116362648 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7b34107640 con 0x7f7b4c105290 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 -- 172.21.15.102:0/2431788961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92d0390 msgr2=0x5624c96a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92d0390 0x5624c96a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 -- 172.21.15.102:0/2431788961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 msgr2=0x5624c96960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 0x5624c96960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4affd640 1 -- 172.21.15.102:0/2431788961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624c935c650 con 0x5624c92c81b0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.786+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 0x5624c96960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.787+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 0x7f7b380b8c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005fd0 tx=0x7f7b44009e90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.787+0000 7f7b4affd640 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7b340b4b20 tx=0x7f7b3403b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd6ca175d834343 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.787+0000 7f7b41ffb640 1 -- 172.21.15.102:0/2431788961 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34049070 con 0x5624c92c81b0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.787+0000 7f7b41ffb640 1 -- 172.21.15.102:0/2431788961 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b340cd040 con 0x5624c92c81b0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.787+0000 7f7b41ffb640 1 -- 172.21.15.102:0/2431788961 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b340d6ea0 con 0x5624c92c81b0 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- 172.21.15.102:0/2431788961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 msgr2=0x5624c9696610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7b340b4b20 tx=0x7f7b3403b5d0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- 172.21.15.102:0/2431788961 shutdown_connections 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c9696610 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92d0390 0x5624c96a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 --2- 172.21.15.102:0/2431788961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92f1070 0x5624c96960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- 172.21.15.102:0/2431788961 >> 172.21.15.102:0/2431788961 conn(0x5624c92e5460 msgr2=0x5624c96985d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- 172.21.15.102:0/2431788961 shutdown_connections 2024-09-21T03:35:59.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- 172.21.15.102:0/2431788961 wait complete. 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 -- start start 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.788+0000 7f7b583c2740 1 Processor -- start 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c96aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 0x5624c96b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5624c945f700 con 0x5624c92f1070 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5624c9599110 con 0x5624c92d0390 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5624c96a92e0 con 0x5624c92c81b0 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b583c2740 10 client.0 _ll_register_callbacks cb 0x5624c95b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 0x5624c96b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c96aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:32840/0 (socket says 172.21.15.102:32840) 2024-09-21T03:35:59.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 -- 172.21.15.102:0/4277806020 learned_addr learned my addr 172.21.15.102:0/4277806020 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 -- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 msgr2=0x5624c96aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c96aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 -- 172.21.15.102:0/4277806020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 msgr2=0x5624c96b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 0x5624c96b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4affd640 1 -- 172.21.15.102:0/4277806020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624c95c6c40 con 0x5624c92d0390 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 0x5624c96b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.789+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c96aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b4affd640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b34104e30 tx=0x7f7b34105230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=708f92a6018d11b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34049070 con 0x5624c92d0390 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7b340e3630 con 0x5624c92d0390 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b340cd040 con 0x5624c92d0390 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b340ccca0 con 0x5624c92d0390 2024-09-21T03:35:59.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 10 client.25352 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624c96bafa0 con 0x5624c92d0390 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b340cd040 con 0x5624c92d0390 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7b3404c060 con 0x5624c92d0390 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 10 client.25352 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 10 client.25352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 20 client.25352 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92af9f0 0x5624c96be300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 4 client.25352 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.790+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624c9610da0 con 0x5624c92af9f0 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.791+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92af9f0 0x5624c96be300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.791+0000 7f7b2affd640 10 client.25352 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:59.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.791+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92af9f0 0x5624c96be300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa2aafbf084845f3 server_cookie=fab443b836c6d021 in_seq=0 out_seq=0 2024-09-21T03:35:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.794+0000 7f7b2affd640 1 -- 172.21.15.102:0/4277806020 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624c9610da0 con 0x5624c92af9f0 2024-09-21T03:35:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.794+0000 7f7b2affd640 10 client.25352 handle_command_reply: tid=0 2024-09-21T03:35:59.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.794+0000 7f7b583c2740 1 client.25352 shutdown 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 msgr2=0x5624c96ad030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7b34104e30 tx=0x7f7b34105230 comp rx=0 tx=0).stop 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 shutdown_connections 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92af9f0 0x5624c96be300 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92f1070 0x5624c96b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b2affd640 0 client.25352 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92d0390 0x5624c96ad030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 --2- 172.21.15.102:0/4277806020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c96aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 >> 172.21.15.102:0/4277806020 conn(0x5624c92e5460 msgr2=0x5624c9695520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 shutdown_connections 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 1 -- 172.21.15.102:0/4277806020 wait complete. 2024-09-21T03:35:59.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.795+0000 7f7b583c2740 20 client.25352 trim_cache size 0 max 16384 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 Processor -- start 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 -- start start 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92af9f0 0x5624c9698780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c9696050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1b0020 con 0x5624c92e5460 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1ad830 con 0x5624c92af9f0 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.812+0000 7f7b583c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1ab680 con 0x5624c92c81b0 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55974/0 (socket says 172.21.15.102:55974) 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 -- 172.21.15.102:0/3738158078 learned_addr learned my addr 172.21.15.102:0/3738158078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4affd640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92af9f0 0x5624c9698780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c9696050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 -- 172.21.15.102:0/3738158078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 msgr2=0x5624c9696050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c9696050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 -- 172.21.15.102:0/3738158078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92af9f0 msgr2=0x5624c9698780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92af9f0 0x5624c9698780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 -- 172.21.15.102:0/3738158078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624c96aad70 con 0x5624c92e5460 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c9696050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:35:59.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c012e50 tx=0x7f7b3c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c6a38c051e51c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b417fa640 1 -- 172.21.15.102:0/3738158078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c00fcd0 con 0x5624c92e5460 2024-09-21T03:35:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b417fa640 1 -- 172.21.15.102:0/3738158078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b3c00fe70 con 0x5624c92e5460 2024-09-21T03:35:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.813+0000 7f7b417fa640 1 -- 172.21.15.102:0/3738158078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c004a00 con 0x5624c92e5460 2024-09-21T03:35:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- 172.21.15.102:0/3738158078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 msgr2=0x5624c9698240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c012e50 tx=0x7f7b3c005f90 comp rx=0 tx=0).stop 2024-09-21T03:35:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- 172.21.15.102:0/3738158078 shutdown_connections 2024-09-21T03:35:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92c81b0 0x5624c9696050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92af9f0 0x5624c9698780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 --2- 172.21.15.102:0/3738158078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92e5460 0x5624c9698240 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- 172.21.15.102:0/3738158078 >> 172.21.15.102:0/3738158078 conn(0x5624c9699b00 msgr2=0x5624c96a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- 172.21.15.102:0/3738158078 shutdown_connections 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- 172.21.15.102:0/3738158078 wait complete. 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.814+0000 7f7b583c2740 1 -- start start 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 Processor -- start 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92af9f0 0x5624c96c2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 0x5624c96c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1abcf0 con 0x5624c92c81b0 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1ad160 con 0x5624c92e5460 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c1ac3c0 con 0x5624c92af9f0 2024-09-21T03:35:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b583c2740 10 client.0 _ll_register_callbacks cb 0x7f7b3c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4b7fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92af9f0 0x5624c96c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55976/0 (socket says 172.21.15.102:55976) 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4affd640 1 -- 172.21.15.102:0/1880964361 learned_addr learned my addr 172.21.15.102:0/1880964361 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 0x5624c96c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4bfff640 1 -- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92af9f0 msgr2=0x5624c96c2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92af9f0 0x5624c96c2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4bfff640 1 -- 172.21.15.102:0/1880964361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 msgr2=0x5624c96c2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.815+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b4bfff640 1 -- 172.21.15.102:0/1880964361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624c96c3850 con 0x5624c92e5460 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b4affd640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b4bfff640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 0x5624c96c3310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009b40 tx=0x7f7b44009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f097af53aa94318f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b2affd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:35:59.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b44026040 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b3c00fe70 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7b4401a070 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b44037050 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b583c2740 10 client.25358 fetch_fsmap learned FSMap version 29 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5624c9728d30 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.816+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b3c00fe70 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7b440053b0 con 0x5624c92e5460 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 10 client.25358 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 10 client.25358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 20 client.25358 populate_metadata read hostname 'smithi102' 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92d0390 0x5624c972b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 4 client.25358 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5624c960c850 con 0x5624c92d0390 2024-09-21T03:35:59.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92d0390 0x5624c972b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:35:59.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b2affd640 10 client.25358 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:59.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.817+0000 7f7b4b7fe640 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92d0390 0x5624c972b600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe3cdec0a3b574b server_cookie=c1450902b19438f5 in_seq=0 out_seq=0 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.820+0000 7f7b2affd640 1 -- 172.21.15.102:0/1880964361 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1431 (crc 0 0 0) 0x5624c960c850 con 0x5624c92d0390 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.820+0000 7f7b2affd640 10 client.25358 handle_command_reply: tid=0 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 client.25358 shutdown 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 msgr2=0x5624c96c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 0x5624c96c3310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009b40 tx=0x7f7b44009500 comp rx=0 tx=0).stop 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 shutdown_connections 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5624c92d0390 0x5624c972b600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5624c92c81b0 0x5624c96c2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b2affd640 0 client.25358 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:35:59.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5624c92e5460 0x5624c96c3310 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 --2- 172.21.15.102:0/1880964361 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5624c92af9f0 0x5624c96c2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 >> 172.21.15.102:0/1880964361 conn(0x5624c9699b00 msgr2=0x5624c96a7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 shutdown_connections 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 1 -- 172.21.15.102:0/1880964361 wait complete. 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.821+0000 7f7b583c2740 20 client.25358 trim_cache size 0 max 16384 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "scrub active (1057 inodes in the stack)", 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:59.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "d7e65926-e4d9-4f43-a96e-87473c176505", 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:35:59.826 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:59.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:35:59.828 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 msgr2=0x7f7b380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 0x7f7b380b8c10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005fd0 tx=0x7f7b44009e90 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 msgr2=0x7f7b4c19ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7b34005940 tx=0x7f7b34004040 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 shutdown_connections 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b380b6700 0x7f7b380b8c10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b4c105290 0x7f7b4c19ab70 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b4c10de10 0x7f7b4c19fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 --2- 172.21.15.102:0/2116362648 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b4c104860 0x7f7b4c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 >> 172.21.15.102:0/2116362648 conn(0x7f7b4c079730 msgr2=0x7f7b4c0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 shutdown_connections 2024-09-21T03:35:59.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:35:59.822+0000 7f7b51e4e640 1 -- 172.21.15.102:0/2116362648 wait complete. 2024-09-21T03:36:00.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:00.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:00.604 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:36:00.605 INFO:tasks.cephfs.filesystem:scrub status for tag:d7e65926-e4d9-4f43-a96e-87473c176505 - {'path': '/', 'tag': 'd7e65926-e4d9-4f43-a96e-87473c176505', 'options': 'recursive,force'} 2024-09-21T03:36:00.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:36:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:36:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:36:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:36:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:01 smithi102 ceph-mon[31392]: pgmap v397: 97 pgs: 97 active+clean; 250 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 396 op/s 2024-09-21T03:36:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:01 smithi148 ceph-mon[34651]: pgmap v397: 97 pgs: 97 active+clean; 250 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 396 op/s 2024-09-21T03:36:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:01 smithi121 ceph-mon[34316]: pgmap v397: 97 pgs: 97 active+clean; 250 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 396 op/s 2024-09-21T03:36:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:02 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:02.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:02 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:02 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:03 smithi102 ceph-mon[31392]: pgmap v398: 97 pgs: 97 active+clean; 241 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 419 op/s 2024-09-21T03:36:03.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:03 smithi148 ceph-mon[34651]: pgmap v398: 97 pgs: 97 active+clean; 241 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 419 op/s 2024-09-21T03:36:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:03 smithi121 ceph-mon[34316]: pgmap v398: 97 pgs: 97 active+clean; 241 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 419 op/s 2024-09-21T03:36:05.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:05 smithi102 ceph-mon[31392]: pgmap v399: 97 pgs: 97 active+clean; 241 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 409 op/s 2024-09-21T03:36:05.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:05 smithi148 ceph-mon[34651]: pgmap v399: 97 pgs: 97 active+clean; 241 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 409 op/s 2024-09-21T03:36:05.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:05 smithi121 ceph-mon[34316]: pgmap v399: 97 pgs: 97 active+clean; 241 MiB data, 923 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 409 op/s 2024-09-21T03:36:07.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:07 smithi102 ceph-mon[31392]: pgmap v400: 97 pgs: 97 active+clean; 248 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 547 op/s 2024-09-21T03:36:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:07 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:36:07.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:07 smithi148 ceph-mon[34651]: pgmap v400: 97 pgs: 97 active+clean; 248 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 547 op/s 2024-09-21T03:36:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:07 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:36:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:07 smithi121 ceph-mon[34316]: pgmap v400: 97 pgs: 97 active+clean; 248 MiB data, 942 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 547 op/s 2024-09-21T03:36:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:07 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:36:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:09 smithi102 ceph-mon[31392]: pgmap v401: 97 pgs: 97 active+clean; 248 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 384 op/s 2024-09-21T03:36:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:09 smithi148 ceph-mon[34651]: pgmap v401: 97 pgs: 97 active+clean; 248 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 384 op/s 2024-09-21T03:36:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:09 smithi121 ceph-mon[34316]: pgmap v401: 97 pgs: 97 active+clean; 248 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 384 op/s 2024-09-21T03:36:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:11 smithi102 ceph-mon[31392]: pgmap v402: 97 pgs: 97 active+clean; 248 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 304 op/s 2024-09-21T03:36:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:11 smithi148 ceph-mon[34651]: pgmap v402: 97 pgs: 97 active+clean; 248 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 304 op/s 2024-09-21T03:36:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:11 smithi121 ceph-mon[34316]: pgmap v402: 97 pgs: 97 active+clean; 248 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 304 op/s 2024-09-21T03:36:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:13 smithi102 ceph-mon[31392]: pgmap v403: 97 pgs: 97 active+clean; 256 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-21T03:36:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:13 smithi148 ceph-mon[34651]: pgmap v403: 97 pgs: 97 active+clean; 256 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-21T03:36:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:13 smithi121 ceph-mon[34316]: pgmap v403: 97 pgs: 97 active+clean; 256 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 352 op/s 2024-09-21T03:36:14.915 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-21T03:36:14.915 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T03:36:15.193 DEBUG:teuthology.parallel:result is None 2024-09-21T03:36:15.193 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:36:15.227 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T03:36:15.227 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T03:36:15.247 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T03:36:15.247 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T03:36:15.247 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:36:15.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T03:36:15.295 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T03:36:15.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:15 smithi102 ceph-mon[31392]: pgmap v404: 97 pgs: 97 active+clean; 262 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-09-21T03:36:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:15 smithi148 ceph-mon[34651]: pgmap v404: 97 pgs: 97 active+clean; 262 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-09-21T03:36:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:15 smithi121 ceph-mon[34316]: pgmap v404: 97 pgs: 97 active+clean; 262 MiB data, 965 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 335 op/s 2024-09-21T03:36:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:17 smithi102 ceph-mon[31392]: pgmap v405: 97 pgs: 97 active+clean; 267 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 414 op/s 2024-09-21T03:36:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:17 smithi148 ceph-mon[34651]: pgmap v405: 97 pgs: 97 active+clean; 267 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 414 op/s 2024-09-21T03:36:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:17 smithi121 ceph-mon[34316]: pgmap v405: 97 pgs: 97 active+clean; 267 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 414 op/s 2024-09-21T03:36:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:19 smithi102 ceph-mon[31392]: pgmap v406: 97 pgs: 97 active+clean; 269 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 275 op/s 2024-09-21T03:36:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:19 smithi148 ceph-mon[34651]: pgmap v406: 97 pgs: 97 active+clean; 269 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 275 op/s 2024-09-21T03:36:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:19 smithi121 ceph-mon[34316]: pgmap v406: 97 pgs: 97 active+clean; 269 MiB data, 944 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 275 op/s 2024-09-21T03:36:21.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:21 smithi102 ceph-mon[31392]: pgmap v407: 97 pgs: 97 active+clean; 270 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 297 op/s 2024-09-21T03:36:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:21 smithi148 ceph-mon[34651]: pgmap v407: 97 pgs: 97 active+clean; 270 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 297 op/s 2024-09-21T03:36:21.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:21 smithi121 ceph-mon[34316]: pgmap v407: 97 pgs: 97 active+clean; 270 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 297 op/s 2024-09-21T03:36:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:23 smithi102 ceph-mon[31392]: pgmap v408: 97 pgs: 97 active+clean; 270 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 267 op/s 2024-09-21T03:36:23.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:23 smithi148 ceph-mon[34651]: pgmap v408: 97 pgs: 97 active+clean; 270 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 267 op/s 2024-09-21T03:36:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:23 smithi121 ceph-mon[34316]: pgmap v408: 97 pgs: 97 active+clean; 270 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.9 MiB/s wr, 267 op/s 2024-09-21T03:36:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:24 smithi102 ceph-mon[31392]: pgmap v409: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 193 op/s 2024-09-21T03:36:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:24 smithi148 ceph-mon[34651]: pgmap v409: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 193 op/s 2024-09-21T03:36:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:24 smithi121 ceph-mon[34316]: pgmap v409: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 193 op/s 2024-09-21T03:36:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:27 smithi102 ceph-mon[31392]: pgmap v410: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 718 KiB/s wr, 167 op/s 2024-09-21T03:36:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:27 smithi148 ceph-mon[34651]: pgmap v410: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 718 KiB/s wr, 167 op/s 2024-09-21T03:36:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:27 smithi121 ceph-mon[34316]: pgmap v410: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 718 KiB/s wr, 167 op/s 2024-09-21T03:36:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:29 smithi102 ceph-mon[31392]: pgmap v411: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 301 KiB/s wr, 82 op/s 2024-09-21T03:36:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:29 smithi148 ceph-mon[34651]: pgmap v411: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 301 KiB/s wr, 82 op/s 2024-09-21T03:36:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:29 smithi121 ceph-mon[34316]: pgmap v411: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 301 KiB/s wr, 82 op/s 2024-09-21T03:36:30.606 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:36:30.866 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 -- 172.21.15.102:0/1456481973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 msgr2=0x7fd960104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 --2- 172.21.15.102:0/1456481973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd960104dc0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd950009900 tx=0x7fd95002a410 comp rx=0 tx=0).stop 2024-09-21T03:36:31.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 -- 172.21.15.102:0/1456481973 shutdown_connections 2024-09-21T03:36:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 --2- 172.21.15.102:0/1456481973 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 0x7fd960110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 --2- 172.21.15.102:0/1456481973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 0x7fd96010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 --2- 172.21.15.102:0/1456481973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd960104dc0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 -- 172.21.15.102:0/1456481973 >> 172.21.15.102:0/1456481973 conn(0x7fd960079730 msgr2=0x7fd960079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 -- 172.21.15.102:0/1456481973 shutdown_connections 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 -- 172.21.15.102:0/1456481973 wait complete. 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.363+0000 7fd9662be640 1 Processor -- start 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 -- start start 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 0x7fd960102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 0x7fd960103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd960113bb0 con 0x7fd9601049b0 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd960113a30 con 0x7fd960105300 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd9662be640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd960113d30 con 0x7fd96010de10 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39224/0 (socket says 172.21.15.102:39224) 2024-09-21T03:36:31.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 -- 172.21.15.102:0/4078570137 learned_addr learned my addr 172.21.15.102:0/4078570137 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 0x7fd960102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd96485b640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 0x7fd960103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 -- 172.21.15.102:0/4078570137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 msgr2=0x7fd960103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 0x7fd960103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 -- 172.21.15.102:0/4078570137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 msgr2=0x7fd960102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 0x7fd960102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.364+0000 7fd95ffff640 1 -- 172.21.15.102:0/4078570137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9601a8860 con 0x7fd9601049b0 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd95ffff640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd950005940 tx=0x7fd9500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd95d7fa640 1 -- 172.21.15.102:0/4078570137 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95003f030 con 0x7fd9601049b0 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd95d7fa640 1 -- 172.21.15.102:0/4078570137 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd950031910 con 0x7fd9601049b0 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9601a8af0 con 0x7fd9601049b0 2024-09-21T03:36:31.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd95d7fa640 1 -- 172.21.15.102:0/4078570137 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950035070 con 0x7fd9601049b0 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.365+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9601a8fd0 con 0x7fd9601049b0 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd95d7fa640 1 -- 172.21.15.102:0/4078570137 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fd950042030 con 0x7fd9601049b0 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 Processor -- start 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 -- start start 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4bf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4bf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55776e435e50 con 0x55776e0ef1b0 2024-09-21T03:36:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55776e425280 con 0x55776e118070 2024-09-21T03:36:31.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96c832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55776e429090 con 0x55776e0f7390 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4bf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd95ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4bf7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39236/0 (socket says 172.21.15.102:39236) 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd95ffff640 1 -- 172.21.15.102:0/1592276220 learned_addr learned my addr 172.21.15.102:0/1592276220 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd96485b640 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.368+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 -- 172.21.15.102:0/1592276220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 msgr2=0x55776e4bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 -- 172.21.15.102:0/1592276220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 msgr2=0x55776e4bf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4bf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 -- 172.21.15.102:0/1592276220 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776e183650 con 0x55776e118070 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd95d7fa640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 0x7fd9480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd95ffff640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 0x7fd9480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd96485b640 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4bf270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd958009eb0 tx=0x7fd958010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf7695c986f07bfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd95d7fa640 1 -- 172.21.15.102:0/4078570137 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fd950107bb0 con 0x7fd9601049b0 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd9467fc640 1 -- 172.21.15.102:0/1592276220 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958016070 con 0x55776e118070 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd9467fc640 1 -- 172.21.15.102:0/1592276220 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd958004d20 con 0x55776e118070 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.369+0000 7fd9467fc640 1 -- 172.21.15.102:0/1592276220 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9580127d0 con 0x55776e118070 2024-09-21T03:36:31.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 -- 172.21.15.102:0/1592276220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 msgr2=0x55776e4bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4bf270 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd958009eb0 tx=0x7fd958010740 comp rx=0 tx=0).stop 2024-09-21T03:36:31.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd95ffff640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 0x7fd9480b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9500cad10 tx=0x7fd95010b700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 -- 172.21.15.102:0/1592276220 shutdown_connections 2024-09-21T03:36:31.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4bf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 --2- 172.21.15.102:0/1592276220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4bf270 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 -- 172.21.15.102:0/1592276220 >> 172.21.15.102:0/1592276220 conn(0x55776e10c460 msgr2=0x55776e4bd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 -- 172.21.15.102:0/1592276220 shutdown_connections 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.370+0000 7fd96c832740 1 -- 172.21.15.102:0/1592276220 wait complete. 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 -- start start 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 Processor -- start 2024-09-21T03:36:31.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e0f7390 0x55776e4caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e118070 0x55776e4d6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55776e286700 con 0x55776e0ef1b0 2024-09-21T03:36:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55776e3c0110 con 0x55776e0f7390 2024-09-21T03:36:31.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55776e4cda50 con 0x55776e118070 2024-09-21T03:36:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96c832740 10 client.0 _ll_register_callbacks cb 0x55776e3d9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96485b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96485b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39250/0 (socket says 172.21.15.102:39250) 2024-09-21T03:36:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.371+0000 7fd96485b640 1 -- 172.21.15.102:0/3657073765 learned_addr learned my addr 172.21.15.102:0/3657073765 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:31.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e0f7390 0x55776e4caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 -- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e118070 msgr2=0x55776e4d6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e118070 0x55776e4d6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 -- 172.21.15.102:0/3657073765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e0f7390 msgr2=0x55776e4caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e0f7390 0x55776e4caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 -- 172.21.15.102:0/3657073765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55776e3edc40 con 0x55776e0ef1b0 2024-09-21T03:36:31.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96485b640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd958005a10 tx=0x7fd958004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a68526827830 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd93f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:31.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958016070 con 0x55776e0ef1b0 2024-09-21T03:36:31.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fd9580053e0 con 0x55776e0ef1b0 2024-09-21T03:36:31.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd958004d20 con 0x55776e0ef1b0 2024-09-21T03:36:31.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd9580055e0 con 0x55776e0ef1b0 2024-09-21T03:36:31.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96c832740 10 client.15870 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:31.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.372+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55776e4d9770 con 0x55776e0ef1b0 2024-09-21T03:36:31.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd958004d20 con 0x55776e0ef1b0 2024-09-21T03:36:31.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd95800f040 con 0x55776e0ef1b0 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 10 client.15870 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 20 client.15870 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0d69f0 0x55776e4dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 4 client.15870 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:31.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55776e437da0 con 0x55776e0d69f0 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.373+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0d69f0 0x55776e4dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.374+0000 7fd93f7fe640 10 client.15870 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.374+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0d69f0 0x55776e4dcb80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a80f230e538e85 server_cookie=9dea30997c930665 in_seq=0 out_seq=0 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.374+0000 7fd93f7fe640 1 -- 172.21.15.102:0/3657073765 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55776e437da0 con 0x55776e0d69f0 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.374+0000 7fd93f7fe640 10 client.15870 handle_command_reply: tid=0 2024-09-21T03:36:31.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.374+0000 7fd96c832740 1 client.15870 shutdown 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 msgr2=0x55776e4ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd958005a10 tx=0x7fd958004c70 comp rx=0 tx=0).stop 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 shutdown_connections 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e118070 0x55776e4d6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e0f7390 0x55776e4caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0d69f0 0x55776e4dcb80 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 --2- 172.21.15.102:0/3657073765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4ca970 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd93f7fe640 0 client.15870 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 >> 172.21.15.102:0/3657073765 conn(0x55776e10c460 msgr2=0x55776e4c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 shutdown_connections 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 1 -- 172.21.15.102:0/3657073765 wait complete. 2024-09-21T03:36:31.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.375+0000 7fd96c832740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T03:36:31.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 Processor -- start 2024-09-21T03:36:31.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 -- start start 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 0x55776e4cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601b44a0 con 0x55776e0f7390 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601b1cb0 con 0x55776e118070 2024-09-21T03:36:31.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.392+0000 7fd96c832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601afb00 con 0x55776e0ef1b0 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39262/0 (socket says 172.21.15.102:39262) 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 -- 172.21.15.102:0/2562525318 learned_addr learned my addr 172.21.15.102:0/2562525318 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd96485b640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd96485b640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 0x55776e4cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 -- 172.21.15.102:0/2562525318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 msgr2=0x55776e4cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 0x55776e4cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 -- 172.21.15.102:0/2562525318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 msgr2=0x55776e4c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 -- 172.21.15.102:0/2562525318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55776e4c98d0 con 0x55776e0f7390 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd96485b640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 0x55776e4cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:31.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd96006aaa0 tx=0x7fd95400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d2042906d7eff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd945ffb640 1 -- 172.21.15.102:0/2562525318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd954004220 con 0x55776e0f7390 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd945ffb640 1 -- 172.21.15.102:0/2562525318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd9540043c0 con 0x55776e0f7390 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.393+0000 7fd945ffb640 1 -- 172.21.15.102:0/2562525318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95401d9e0 con 0x55776e0f7390 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 -- 172.21.15.102:0/2562525318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 msgr2=0x55776e4c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd96006aaa0 tx=0x7fd95400b410 comp rx=0 tx=0).stop 2024-09-21T03:36:31.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 -- 172.21.15.102:0/2562525318 shutdown_connections 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0f7390 0x55776e4c2370 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 --2- 172.21.15.102:0/2562525318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0ef1b0 0x55776e4cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 -- 172.21.15.102:0/2562525318 >> 172.21.15.102:0/2562525318 conn(0x55776e10c460 msgr2=0x55776e4ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 -- 172.21.15.102:0/2562525318 shutdown_connections 2024-09-21T03:36:31.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.394+0000 7fd96c832740 1 -- 172.21.15.102:0/2562525318 wait complete. 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 -- start start 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 Processor -- start 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4de300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601b0170 con 0x55776e0ef1b0 2024-09-21T03:36:31.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601b15e0 con 0x55776e118070 2024-09-21T03:36:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd9601b0840 con 0x55776e0f7390 2024-09-21T03:36:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96c832740 10 client.0 _ll_register_callbacks cb 0x7fd95010b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96485b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96485b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39274/0 (socket says 172.21.15.102:39274) 2024-09-21T03:36:31.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.395+0000 7fd96485b640 1 -- 172.21.15.102:0/2806639233 learned_addr learned my addr 172.21.15.102:0/2806639233 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4de300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 -- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 msgr2=0x55776e4de300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4de300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 -- 172.21.15.102:0/2806639233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 msgr2=0x55776e4de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 -- 172.21.15.102:0/2806639233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55776e546530 con 0x55776e0ef1b0 2024-09-21T03:36:31.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96485b640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd958005ae0 tx=0x7fd958005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb6ffbd91c7aa39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd93f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd958016070 con 0x55776e0ef1b0 2024-09-21T03:36:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fd958004ce0 con 0x55776e0ef1b0 2024-09-21T03:36:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9540043c0 con 0x55776e0ef1b0 2024-09-21T03:36:31.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd958033040 con 0x55776e0ef1b0 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96c832740 10 client.15876 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.396+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55776e547730 con 0x55776e0ef1b0 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd9540043c0 con 0x55776e0ef1b0 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fd958012ae0 con 0x55776e0ef1b0 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 10 client.15876 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:31.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 20 client.15876 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0abda0 0x55776e549ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 4 client.15876 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55776e433850 con 0x55776e0abda0 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.397+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0abda0 0x55776e549ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd93f7fe640 10 client.15876 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd95f7fe640 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0abda0 0x55776e549ef0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58718d1cac0a02b4 server_cookie=bb9ef9b095be17c in_seq=0 out_seq=0 2024-09-21T03:36:31.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd93f7fe640 1 -- 172.21.15.102:0/2806639233 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55776e433850 con 0x55776e0abda0 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd93f7fe640 10 client.15876 handle_command_reply: tid=0 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 client.15876 shutdown 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 msgr2=0x55776e4dddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd958005ae0 tx=0x7fd958005fd0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 shutdown_connections 2024-09-21T03:36:31.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55776e118070 0x55776e4de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55776e0f7390 0x55776e4de300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55776e0abda0 0x55776e549ef0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 --2- 172.21.15.102:0/2806639233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55776e0ef1b0 0x55776e4dddc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 >> 172.21.15.102:0/2806639233 conn(0x55776e10c460 msgr2=0x55776e4c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd93f7fe640 0 client.15876 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:31.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.398+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 shutdown_connections 2024-09-21T03:36:31.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd96c832740 1 -- 172.21.15.102:0/2806639233 wait complete. 2024-09-21T03:36:31.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd96c832740 20 client.15876 trim_cache size 0 max 16384 2024-09-21T03:36:31.423 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:31.424 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:31.425 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:31.426 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:31.426 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:31.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:31.426 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:36:31.427 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:31.428 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:31.428 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:31.429 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:31.429 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:31.430 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:31.430 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:31.430 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:36:31.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 msgr2=0x7fd9480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 0x7fd9480b8b90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd9500cad10 tx=0x7fd95010b700 comp rx=0 tx=0).stop 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 msgr2=0x7fd9601026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd950005940 tx=0x7fd9500042f0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 shutdown_connections 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd9480b6680 0x7fd9480b8b90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd96010de10 0x7fd960103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd960105300 0x7fd960102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 --2- 172.21.15.102:0/4078570137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd9601049b0 0x7fd9601026f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:31.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 >> 172.21.15.102:0/4078570137 conn(0x7fd960079730 msgr2=0x7fd9600ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:31.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 shutdown_connections 2024-09-21T03:36:31.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:31.399+0000 7fd9662be640 1 -- 172.21.15.102:0/4078570137 wait complete. 2024-09-21T03:36:31.553 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:31 smithi102 ceph-mon[31392]: pgmap v412: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 85 KiB/s wr, 44 op/s 2024-09-21T03:36:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:31 smithi148 ceph-mon[34651]: pgmap v412: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 85 KiB/s wr, 44 op/s 2024-09-21T03:36:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:31 smithi121 ceph-mon[34316]: pgmap v412: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 85 KiB/s wr, 44 op/s 2024-09-21T03:36:32.152 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:36:32.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:36:32.412 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:32.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.925+0000 7f794a2cd640 1 -- 172.21.15.102:0/1463334738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944102a70 msgr2=0x7f7944102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:32.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.925+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1463334738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944102a70 0x7f7944102e80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7934009900 tx=0x7f793402a410 comp rx=0 tx=0).stop 2024-09-21T03:36:32.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.925+0000 7f794a2cd640 1 -- 172.21.15.102:0/1463334738 shutdown_connections 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.925+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1463334738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944108d00 0x7f794410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.925+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1463334738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 0x7f79441087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1463334738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944102a70 0x7f7944102e80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 -- 172.21.15.102:0/1463334738 >> 172.21.15.102:0/1463334738 conn(0x7f7944079710 msgr2=0x7f7944079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 -- 172.21.15.102:0/1463334738 shutdown_connections 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 -- 172.21.15.102:0/1463334738 wait complete. 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 Processor -- start 2024-09-21T03:36:32.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.926+0000 7f794a2cd640 1 -- start start 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944102a70 0x7f794419b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 0x7f794419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7944112b40 con 0x7f7944108d00 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f79441129c0 con 0x7f7944102a70 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794a2cd640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7944112cc0 con 0x7f79441083b0 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39294/0 (socket says 172.21.15.102:39294) 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 -- 172.21.15.102:0/1352101478 learned_addr learned my addr 172.21.15.102:0/1352101478 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f7943fff640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944102a70 0x7f794419b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f79437fe640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 0x7f794419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:32.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 -- 172.21.15.102:0/1352101478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 msgr2=0x7f794419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 0x7f794419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 -- 172.21.15.102:0/1352101478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944102a70 msgr2=0x7f794419b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944102a70 0x7f794419b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 -- 172.21.15.102:0/1352101478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79441a66a0 con 0x7f7944108d00 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.927+0000 7f794886a640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f793c00cad0 tx=0x7f793c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.928+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00ae20 con 0x7f7944108d00 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.928+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79441a6990 con 0x7f7944108d00 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.928+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f793c005020 con 0x7f7944108d00 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.928+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c00f6b0 con 0x7f7944108d00 2024-09-21T03:36:32.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.928+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79441a6f00 con 0x7f7944108d00 2024-09-21T03:36:32.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.929+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7944103cf0 con 0x7f7944108d00 2024-09-21T03:36:32.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.931+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f793c0051d0 con 0x7f7944108d00 2024-09-21T03:36:32.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.932+0000 7f79417fa640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 0x7f792c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:32.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.932+0000 7f7943fff640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 0x7f792c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:32.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.932+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f793c0e7c00 con 0x7f7944108d00 2024-09-21T03:36:32.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.932+0000 7f7943fff640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 0x7f792c0b8c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:32.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:32.935+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f793c014030 con 0x7f7944108d00 2024-09-21T03:36:33.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.149+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f794406bf90 con 0x7f7944108d00 2024-09-21T03:36:33.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.150+0000 7f79417fa640 1 -- 172.21.15.102:0/1352101478 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11942 (secure 0 0 0) 0x7f793c0ae0e0 con 0x7f7944108d00 2024-09-21T03:36:33.152 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:36:33.152 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":29,"btime":"2024-09-21T03:35:52:382620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:35:51.414877+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:36:33.152 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 29 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 msgr2=0x7f792c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 0x7f792c0b8c40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7934000c00 tx=0x7f7934005d50 comp rx=0 tx=0).stop 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 msgr2=0x7f794419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f793c00cad0 tx=0x7f793c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 shutdown_connections 2024-09-21T03:36:33.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f792c0b6730 0x7f792c0b8c40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7944108d00 0x7f794419be90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f79441083b0 0x7f794419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 --2- 172.21.15.102:0/1352101478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7944102a70 0x7f794419b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 >> 172.21.15.102:0/1352101478 conn(0x7f7944079710 msgr2=0x7f7944106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 shutdown_connections 2024-09-21T03:36:33.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:33.152+0000 7f794a2cd640 1 -- 172.21.15.102:0/1352101478 wait complete. 2024-09-21T03:36:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:33 smithi102 ceph-mon[31392]: pgmap v413: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-21T03:36:33.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:33 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1352101478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:33 smithi148 ceph-mon[34651]: pgmap v413: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-21T03:36:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:33 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1352101478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:33 smithi121 ceph-mon[34316]: pgmap v413: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 19 op/s 2024-09-21T03:36:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:33 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1352101478' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:33.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:36:34.159 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 -- 172.21.15.102:0/1609474137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a0105320 msgr2=0x7f49a010d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1609474137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a0105320 0x7f49a010d870 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4988009900 tx=0x7f498802a410 comp rx=0 tx=0).stop 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 -- 172.21.15.102:0/1609474137 shutdown_connections 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1609474137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a0105320 0x7f49a010d870 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1609474137 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a010de30 0x7f49a0110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1609474137 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 0x7f49a0104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 -- 172.21.15.102:0/1609474137 >> 172.21.15.102:0/1609474137 conn(0x7f49a0079740 msgr2=0x7f49a0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 -- 172.21.15.102:0/1609474137 shutdown_connections 2024-09-21T03:36:34.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 -- 172.21.15.102:0/1609474137 wait complete. 2024-09-21T03:36:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.636+0000 7f49a55bf640 1 Processor -- start 2024-09-21T03:36:34.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 -- start start 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 0x7f49a019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a0105320 0x7f49a019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0113bb0 con 0x7f49a010de30 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0113a30 con 0x7f49a01049d0 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f49a55bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0113d30 con 0x7f49a0105320 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f499f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f499f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47626/0 (socket says 172.21.15.102:47626) 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f499f7fe640 1 -- 172.21.15.102:0/1161358108 learned_addr learned my addr 172.21.15.102:0/1161358108 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f499e7fc640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a0105320 0x7f49a019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.637+0000 7f499effd640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 0x7f49a019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 -- 172.21.15.102:0/1161358108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a0105320 msgr2=0x7f49a019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a0105320 0x7f49a019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 -- 172.21.15.102:0/1161358108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 msgr2=0x7f49a019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 0x7f49a019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 -- 172.21.15.102:0/1161358108 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a01a0530 con 0x7f49a010de30 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f499f7fe640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f499800d750 tx=0x7f499800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f4997fff640 1 -- 172.21.15.102:0/1161358108 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998017070 con 0x7f49a010de30 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f4997fff640 1 -- 172.21.15.102:0/1161358108 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f49980054f0 con 0x7f49a010de30 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a01a0820 con 0x7f49a010de30 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f4997fff640 1 -- 172.21.15.102:0/1161358108 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4998004cd0 con 0x7f49a010de30 2024-09-21T03:36:34.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.638+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a01a6f80 con 0x7f49a010de30 2024-09-21T03:36:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.640+0000 7f49abb33740 1 Processor -- start 2024-09-21T03:36:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f4997fff640 1 -- 172.21.15.102:0/1161358108 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f4998009bd0 con 0x7f49a010de30 2024-09-21T03:36:34.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 -- start start 2024-09-21T03:36:34.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e47082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4340390 0x5652e4708d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5652e467eea0 con 0x5652e43381b0 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652e466e2d0 con 0x5652e4361070 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f49abb33740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5652e46720e0 con 0x5652e4340390 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47628/0 (socket says 172.21.15.102:47628) 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f499effd640 1 -- 172.21.15.102:0/2838284238 learned_addr learned my addr 172.21.15.102:0/2838284238 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.641+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4340390 0x5652e4708d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e47082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 -- 172.21.15.102:0/2838284238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4340390 msgr2=0x5652e4708d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4340390 0x5652e4708d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f4997fff640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 0x7f498c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 -- 172.21.15.102:0/2838284238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 msgr2=0x5652e47082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e47082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 -- 172.21.15.102:0/2838284238 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e43cc650 con 0x5652e43381b0 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e47082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499f7fe640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 0x7f498c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f499effd640 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4990010420 tx=0x7f49900108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cceabd20daa5f139 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f4997fff640 1 -- 172.21.15.102:0/1161358108 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f49980e7140 con 0x7f49a010de30 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f49957fa640 1 -- 172.21.15.102:0/2838284238 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990016070 con 0x5652e43381b0 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f49957fa640 1 -- 172.21.15.102:0/2838284238 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4990012be0 con 0x5652e43381b0 2024-09-21T03:36:34.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.642+0000 7f49957fa640 1 -- 172.21.15.102:0/2838284238 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f499001bd90 con 0x5652e43381b0 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 -- 172.21.15.102:0/2838284238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 msgr2=0x5652e4708800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f499f7fe640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 0x7f498c0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49980acfc0 tx=0x7f4998078040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4990010420 tx=0x7f49900108e0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 -- 172.21.15.102:0/2838284238 shutdown_connections 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e43381b0 0x5652e4708800 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4340390 0x5652e4708d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 --2- 172.21.15.102:0/2838284238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e47082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 -- 172.21.15.102:0/2838284238 >> 172.21.15.102:0/2838284238 conn(0x5652e4355460 msgr2=0x5652e47061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 -- 172.21.15.102:0/2838284238 shutdown_connections 2024-09-21T03:36:34.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.643+0000 7f49abb33740 1 -- 172.21.15.102:0/2838284238 wait complete. 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 -- start start 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 Processor -- start 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4713940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 0x5652e4713e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5652e44cf700 con 0x5652e4361070 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5652e4609160 con 0x5652e4340390 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5652e4716aa0 con 0x5652e43381b0 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f49abb33740 10 client.0 _ll_register_callbacks cb 0x5652e46229e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f499e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f499e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47630/0 (socket says 172.21.15.102:47630) 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f499e7fc640 1 -- 172.21.15.102:0/2030420053 learned_addr learned my addr 172.21.15.102:0/2030420053 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.644+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4713940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499effd640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 0x5652e4713e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 -- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 msgr2=0x5652e4713940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4713940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 -- 172.21.15.102:0/2030420053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 msgr2=0x5652e4713e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 0x5652e4713e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 -- 172.21.15.102:0/2030420053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652e4636c90 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499effd640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 0x5652e4713e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f499e7fc640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4988005f70 tx=0x7f4988009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a04e52546ae32bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49867fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988035040 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f4988004240 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4990012be0 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f498804f050 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49abb33740 10 client.15894 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5652e4722750 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.645+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f4990012be0 con 0x5652e4361070 2024-09-21T03:36:34.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f49880049f0 con 0x5652e4361070 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 10 client.15894 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 10 client.15894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 20 client.15894 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e431f9f0 0x5652e4725cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 4 client.15894 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652e4680df0 con 0x5652e431f9f0 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f499effd640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e431f9f0 0x5652e4725cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f499effd640 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e431f9f0 0x5652e4725cd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb0ff75d3e362d31 server_cookie=a55cf067dbe52b3a in_seq=0 out_seq=0 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.646+0000 7f49867fc640 10 client.15894 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49867fc640 1 -- 172.21.15.102:0/2030420053 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652e4680df0 con 0x5652e431f9f0 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49867fc640 10 client.15894 handle_command_reply: tid=0 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 client.15894 shutdown 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 msgr2=0x5652e47143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4988005f70 tx=0x7f4988009260 comp rx=0 tx=0).stop 2024-09-21T03:36:34.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 shutdown_connections 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e431f9f0 0x5652e4725cd0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4361070 0x5652e47143e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4340390 0x5652e4713e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49867fc640 0 client.15894 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.647+0000 7f49abb33740 1 --2- 172.21.15.102:0/2030420053 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4713940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.648+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 >> 172.21.15.102:0/2030420053 conn(0x5652e4355460 msgr2=0x5652e470b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.648+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 shutdown_connections 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.648+0000 7f49abb33740 1 -- 172.21.15.102:0/2030420053 wait complete. 2024-09-21T03:36:34.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.648+0000 7f49abb33740 20 client.15894 trim_cache size 0 max 16384 2024-09-21T03:36:34.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 Processor -- start 2024-09-21T03:36:34.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 -- start start 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4715570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e4711070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01b2320 con 0x5652e4340390 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01afb30 con 0x5652e4361070 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f49abb33740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01ad980 con 0x5652e43381b0 2024-09-21T03:36:34.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47632/0 (socket says 172.21.15.102:47632) 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 -- 172.21.15.102:0/3779242507 learned_addr learned my addr 172.21.15.102:0/3779242507 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4715570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e4711070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 -- 172.21.15.102:0/3779242507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 msgr2=0x5652e4715570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4715570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 -- 172.21.15.102:0/3779242507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 msgr2=0x5652e4711070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e4711070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499effd640 1 -- 172.21.15.102:0/3779242507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652e4700460 con 0x5652e4340390 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.661+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4715570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.662+0000 7f499effd640 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f499001b940 tx=0x7f4990010fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546e835275268a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.662+0000 7f4994ff9640 1 -- 172.21.15.102:0/3779242507 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990032070 con 0x5652e4340390 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.662+0000 7f4994ff9640 1 -- 172.21.15.102:0/3779242507 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f499001b560 con 0x5652e4340390 2024-09-21T03:36:34.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.662+0000 7f4994ff9640 1 -- 172.21.15.102:0/3779242507 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990016040 con 0x5652e4340390 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- 172.21.15.102:0/3779242507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 msgr2=0x5652e4710b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f499001b940 tx=0x7f4990010fb0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- 172.21.15.102:0/3779242507 shutdown_connections 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4710b30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e4361070 0x5652e4711070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 --2- 172.21.15.102:0/3779242507 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e43381b0 0x5652e4715570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- 172.21.15.102:0/3779242507 >> 172.21.15.102:0/3779242507 conn(0x5652e4355460 msgr2=0x5652e4714e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- 172.21.15.102:0/3779242507 shutdown_connections 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- 172.21.15.102:0/3779242507 wait complete. 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 -- start start 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.663+0000 7f49abb33740 1 Processor -- start 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 0x5652e4717de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4361070 0x5652e4718860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01adff0 con 0x5652e4340390 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01af460 con 0x5652e43381b0 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f49a01ae6c0 con 0x5652e4361070 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 10 client.0 _ll_register_callbacks cb 0x7f4988009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47638/0 (socket says 172.21.15.102:47638) 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 -- 172.21.15.102:0/3529796272 learned_addr learned my addr 172.21.15.102:0/3529796272 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4361070 0x5652e4718860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 0x5652e4717de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 -- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4361070 msgr2=0x5652e4718860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4361070 0x5652e4718860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 -- 172.21.15.102:0/3529796272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 msgr2=0x5652e4717de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 0x5652e4717de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 -- 172.21.15.102:0/3529796272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652e478f720 con 0x5652e4340390 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 0x5652e4717de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f499effd640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f499001b910 tx=0x7f499001b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a4413758dd0914 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49867fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4990032050 con 0x5652e4340390 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f4990004be0 con 0x5652e4340390 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.664+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f499001b560 con 0x5652e4340390 2024-09-21T03:36:34.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4990045050 con 0x5652e4340390 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 10 client.15900 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5652e47909a0 con 0x5652e4340390 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f499001b560 con 0x5652e4340390 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f499000f040 con 0x5652e4340390 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 10 client.15900 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 10 client.15900 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 20 client.15900 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e42f4da0 0x5652e4792f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 4 client.15900 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5652e467c8a0 con 0x5652e42f4da0 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.665+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e42f4da0 0x5652e4792f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49867fc640 10 client.15900 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f499e7fc640 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e42f4da0 0x5652e4792f30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc8765ea484d43dc server_cookie=71b839da24decf8 in_seq=0 out_seq=0 2024-09-21T03:36:34.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49867fc640 1 -- 172.21.15.102:0/3529796272 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5652e467c8a0 con 0x5652e42f4da0 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49867fc640 10 client.15900 handle_command_reply: tid=0 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 client.15900 shutdown 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 msgr2=0x5652e4718320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f499001b910 tx=0x7f499001b9e0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 shutdown_connections 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5652e42f4da0 0x5652e4792f30 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5652e4340390 0x5652e4718320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5652e4361070 0x5652e4718860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 --2- 172.21.15.102:0/3529796272 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5652e43381b0 0x5652e4717de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49867fc640 0 client.15900 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 >> 172.21.15.102:0/3529796272 conn(0x5652e4355460 msgr2=0x5652e4709c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.666+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 shutdown_connections 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49abb33740 1 -- 172.21.15.102:0/3529796272 wait complete. 2024-09-21T03:36:34.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49abb33740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T03:36:34.674 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 msgr2=0x7f498c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 0x7f498c0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f49980acfc0 tx=0x7f4998078040 comp rx=0 tx=0).stop 2024-09-21T03:36:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 msgr2=0x7f49a019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:34.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f499800d750 tx=0x7f499800dc10 comp rx=0 tx=0).stop 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 shutdown_connections 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f498c0b6680 0x7f498c0b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f49a010de30 0x7f49a019fe00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f49a0105320 0x7f49a019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 --2- 172.21.15.102:0/1161358108 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f49a01049d0 0x7f49a019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 >> 172.21.15.102:0/1161358108 conn(0x7f49a0079740 msgr2=0x7f49a00ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 shutdown_connections 2024-09-21T03:36:34.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:34.667+0000 7f49a55bf640 1 -- 172.21.15.102:0/1161358108 wait complete. 2024-09-21T03:36:35.498 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:36:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:35 smithi102 ceph-mon[31392]: pgmap v414: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-21T03:36:35.743 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:35 smithi148 ceph-mon[34651]: pgmap v414: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-21T03:36:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:35 smithi121 ceph-mon[34316]: pgmap v414: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.9 KiB/s wr, 11 op/s 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 -- 172.21.15.102:0/2013925653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804102100 msgr2=0x7fc804102510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 --2- 172.21.15.102:0/2013925653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804102100 0x7fc804102510 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009900 tx=0x7fc7f402a3f0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 -- 172.21.15.102:0/2013925653 shutdown_connections 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 --2- 172.21.15.102:0/2013925653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106ca0 0x7fc804110710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 --2- 172.21.15.102:0/2013925653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804106350 0x7fc804106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 --2- 172.21.15.102:0/2013925653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804102100 0x7fc804102510 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 -- 172.21.15.102:0/2013925653 >> 172.21.15.102:0/2013925653 conn(0x7fc804079ec0 msgr2=0x7fc80407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 -- 172.21.15.102:0/2013925653 shutdown_connections 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 -- 172.21.15.102:0/2013925653 wait complete. 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.223+0000 7fc808986640 1 Processor -- start 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 -- start start 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804102100 0x7fc80419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 0x7fc80419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113c90 con 0x7fc804106ca0 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113b10 con 0x7fc804102100 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc808986640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc804113e10 con 0x7fc804106350 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47654/0 (socket says 172.21.15.102:47654) 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 -- 172.21.15.102:0/812341001 learned_addr learned my addr 172.21.15.102:0/812341001 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:36.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc80259c640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804102100 0x7fc80419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 0x7fc80419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 -- 172.21.15.102:0/812341001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 msgr2=0x7fc80419abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 0x7fc80419abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 -- 172.21.15.102:0/812341001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804102100 msgr2=0x7fc80419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804102100 0x7fc80419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 -- 172.21.15.102:0/812341001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8041a04d0 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 0x7fc80419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.224+0000 7fc802d9d640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cce0 tx=0x7fc7fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.225+0000 7fc7fb7fe640 1 -- 172.21.15.102:0/812341001 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00f450 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.225+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8041a07c0 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.225+0000 7fc7fb7fe640 1 -- 172.21.15.102:0/812341001 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7fc00fac0 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.225+0000 7fc7fb7fe640 1 -- 172.21.15.102:0/812341001 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc018be0 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.225+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8041a0cb0 con 0x7fc804106ca0 2024-09-21T03:36:36.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.228+0000 7fc80eefa740 1 Processor -- start 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.228+0000 7fc7fb7fe640 1 -- 172.21.15.102:0/812341001 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc7fc00fc70 con 0x7fc804106ca0 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.228+0000 7fc80eefa740 1 -- start start 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018502be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01813a390 0x55a018503120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a018478ea0 con 0x55a01815b070 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a0184682d0 con 0x55a0181321b0 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80eefa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a01846c0e0 con 0x55a01813a390 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47666/0 (socket says 172.21.15.102:47666) 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 -- 172.21.15.102:0/3129172813 learned_addr learned my addr 172.21.15.102:0/3129172813 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80259c640 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018502be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fb7fe640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 0x7fc7f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 -- 172.21.15.102:0/3129172813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01813a390 msgr2=0x55a018503120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01813a390 0x55a018503120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 -- 172.21.15.102:0/3129172813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 msgr2=0x55a018502be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018502be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 -- 172.21.15.102:0/3129172813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0181c6650 con 0x55a01815b070 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc80259c640 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018502be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc802d9d640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 0x7fc7f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fb7fe640 1 -- 172.21.15.102:0/812341001 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc7fc0e7d20 con 0x7fc804106ca0 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.229+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00bd80 tx=0x7fc7ec011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ecc561a1755b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc7f8ff9640 1 -- 172.21.15.102:0/3129172813 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec016070 con 0x55a01815b070 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc7f8ff9640 1 -- 172.21.15.102:0/3129172813 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7ec005020 con 0x55a01815b070 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc7f8ff9640 1 -- 172.21.15.102:0/3129172813 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec004b00 con 0x55a01815b070 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc80eefa740 1 -- 172.21.15.102:0/3129172813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 msgr2=0x55a0185026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc802d9d640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 0x7fc7f00b8bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0e5510 tx=0x7fc7fc07ae40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.230+0000 7fc80eefa740 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec00bd80 tx=0x7fc7ec011750 comp rx=0 tx=0).stop 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 -- 172.21.15.102:0/3129172813 shutdown_connections 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01813a390 0x55a018503120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018502be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 --2- 172.21.15.102:0/3129172813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01815b070 0x55a0185026a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 -- 172.21.15.102:0/3129172813 >> 172.21.15.102:0/3129172813 conn(0x55a01814f460 msgr2=0x55a018500590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 -- 172.21.15.102:0/3129172813 shutdown_connections 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 -- 172.21.15.102:0/3129172813 wait complete. 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 -- start start 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.231+0000 7fc80eefa740 1 Processor -- start 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018512110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a018512650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a0182c9700 con 0x55a01813a390 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a018403160 con 0x55a0181321b0 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a0185151e0 con 0x55a01815b070 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80eefa740 10 client.0 _ll_register_callbacks cb 0x55a01841c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:60196/0 (socket says 172.21.15.102:60196) 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc7fbfff640 1 -- 172.21.15.102:0/4242929129 learned_addr learned my addr 172.21.15.102:0/4242929129 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018512110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a018512650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 -- 172.21.15.102:0/4242929129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 msgr2=0x55a018512bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 -- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 msgr2=0x55a018512110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018512110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc80259c640 1 -- 172.21.15.102:0/4242929129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a018430c90 con 0x55a01813a390 2024-09-21T03:36:36.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.232+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc80259c640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a018512650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006010 tx=0x7fc7f4031540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936088617fb3b366 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc7e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4035040 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7ec005020 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc7f4031930 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7f4004040 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc80eefa740 10 client.15912 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a018520f20 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.233+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7ec005020 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc7f40049d0 con 0x55a01813a390 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 10 client.15912 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 10 client.15912 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 20 client.15912 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:36.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0181199f0 0x55a018524440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 4 client.15912 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a01847adf0 con 0x55a0181199f0 2024-09-21T03:36:36.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0181199f0 0x55a018524440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc7e9ffb640 10 client.15912 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.234+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0181199f0 0x55a018524440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37fcf0921e38fcee server_cookie=f7dbfad536f8232 in_seq=0 out_seq=0 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/4242929129 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a01847adf0 con 0x55a0181199f0 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc7e9ffb640 10 client.15912 handle_command_reply: tid=0 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 client.15912 shutdown 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 msgr2=0x55a018512650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a018512650 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006010 tx=0x7fc7f4031540 comp rx=0 tx=0).stop 2024-09-21T03:36:36.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 shutdown_connections 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0181199f0 0x55a018524440 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a018512650 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a018512bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 --2- 172.21.15.102:0/4242929129 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018512110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc7e9ffb640 0 client.15912 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.235+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 >> 172.21.15.102:0/4242929129 conn(0x55a01814f460 msgr2=0x55a018504090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.236+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 shutdown_connections 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.236+0000 7fc80eefa740 1 -- 172.21.15.102:0/4242929129 wait complete. 2024-09-21T03:36:36.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.236+0000 7fc80eefa740 20 client.15912 trim_cache size 0 max 16384 2024-09-21T03:36:36.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 Processor -- start 2024-09-21T03:36:36.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 -- start start 2024-09-21T03:36:36.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018529bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a01851a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041b0010 con 0x55a01813a390 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041ad820 con 0x55a0181321b0 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80eefa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041ab670 con 0x55a01815b070 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47680/0 (socket says 172.21.15.102:47680) 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 -- 172.21.15.102:0/1173203412 learned_addr learned my addr 172.21.15.102:0/1173203412 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 -- 172.21.15.102:0/1173203412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 msgr2=0x55a01851a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a01851a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 -- 172.21.15.102:0/1173203412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 msgr2=0x55a018529bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018529bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 -- 172.21.15.102:0/1173203412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a018504df0 con 0x55a01813a390 2024-09-21T03:36:36.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.249+0000 7fc80259c640 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40314e0 tx=0x7fc7f4003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763393280f37c30d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc7ebfff640 1 -- 172.21.15.102:0/1173203412 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4035030 con 0x55a01813a390 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc7ebfff640 1 -- 172.21.15.102:0/1173203412 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7f40043e0 con 0x55a01813a390 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc7ebfff640 1 -- 172.21.15.102:0/1173203412 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4051070 con 0x55a01813a390 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 -- 172.21.15.102:0/1173203412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 msgr2=0x55a01852a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40314e0 tx=0x7fc7f4003780 comp rx=0 tx=0).stop 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 -- 172.21.15.102:0/1173203412 shutdown_connections 2024-09-21T03:36:36.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a01852a130 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a01815b070 0x55a01851a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 --2- 172.21.15.102:0/1173203412 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a0181321b0 0x55a018529bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.250+0000 7fc80eefa740 1 -- 172.21.15.102:0/1173203412 >> 172.21.15.102:0/1173203412 conn(0x55a01814f460 msgr2=0x55a018510990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- 172.21.15.102:0/1173203412 shutdown_connections 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- 172.21.15.102:0/1173203412 wait complete. 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- start start 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 Processor -- start 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0181321b0 0x55a018516d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 0x55a01858ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041abce0 con 0x55a01813a390 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041ad150 con 0x55a01815b070 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8041ac3b0 con 0x55a0181321b0 2024-09-21T03:36:36.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80eefa740 10 client.0 _ll_register_callbacks cb 0x7fc7f4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47686/0 (socket says 172.21.15.102:47686) 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.251+0000 7fc80259c640 1 -- 172.21.15.102:0/290918046 learned_addr learned my addr 172.21.15.102:0/290918046 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0181321b0 0x55a018516d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 0x55a01858ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 -- 172.21.15.102:0/290918046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0181321b0 msgr2=0x55a018516d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0181321b0 0x55a018516d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 -- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 msgr2=0x55a01858ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 0x55a01858ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 -- 172.21.15.102:0/290918046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0185034e0 con 0x55a01813a390 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 0x55a01858ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80259c640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006010 tx=0x7fc7f4004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767dc6d59d1c7c00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:36.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4062060 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc7f4004960 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7f40043e0 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc7f4035050 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80eefa740 10 client.15918 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a01858f4f0 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.252+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc7f40043e0 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc7f4005190 con 0x55a01813a390 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 10 client.15918 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 10 client.15918 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 20 client.15918 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0180eeda0 0x55a018591c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 4 client.15918 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0184768a0 con 0x55a0180eeda0 2024-09-21T03:36:36.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0180eeda0 0x55a018591c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc7fbfff640 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0180eeda0 0x55a018591c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ececfd5b422a9277 server_cookie=ef76ecec93a149a1 in_seq=0 out_seq=0 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.253+0000 7fc7e9ffb640 10 client.15918 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc7e9ffb640 1 -- 172.21.15.102:0/290918046 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0184768a0 con 0x55a0180eeda0 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc7e9ffb640 10 client.15918 handle_command_reply: tid=0 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 client.15918 shutdown 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 msgr2=0x55a0185172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4006010 tx=0x7fc7f4004590 comp rx=0 tx=0).stop 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 shutdown_connections 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55a0180eeda0 0x55a018591c20 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a01813a390 0x55a0185172c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc7e9ffb640 0 client.15918 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a01815b070 0x55a01858ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 --2- 172.21.15.102:0/290918046 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a0181321b0 0x55a018516d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 >> 172.21.15.102:0/290918046 conn(0x55a01814f460 msgr2=0x55a0185036d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 shutdown_connections 2024-09-21T03:36:36.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 1 -- 172.21.15.102:0/290918046 wait complete. 2024-09-21T03:36:36.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc80eefa740 20 client.15918 trim_cache size 0 max 16384 2024-09-21T03:36:36.261 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 msgr2=0x7fc7f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 0x7fc7f00b8bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc0e5510 tx=0x7fc7fc07ae40 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 msgr2=0x7fc80419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.254+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00cce0 tx=0x7fc7fc00a620 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 shutdown_connections 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc7f00b66b0 0x7fc7f00b8bc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc804106ca0 0x7fc80419fe60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc804106350 0x7fc80419abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 --2- 172.21.15.102:0/812341001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc804102100 0x7fc80419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 >> 172.21.15.102:0/812341001 conn(0x7fc804079ec0 msgr2=0x7fc804107520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 shutdown_connections 2024-09-21T03:36:36.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:36.255+0000 7fc808986640 1 -- 172.21.15.102:0/812341001 wait complete. 2024-09-21T03:36:36.925 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:36:37.173 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:37.625 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:37 smithi102 ceph-mon[31392]: pgmap v415: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-21T03:36:37.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 -- 172.21.15.102:0/2161988028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84108d00 msgr2=0x7fdd8410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2161988028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84108d00 0x7fdd8410f530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009ca0 tx=0x7fdd7c02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 -- 172.21.15.102:0/2161988028 shutdown_connections 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2161988028 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd84108d00 0x7fdd8410f530 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2161988028 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd841083b0 0x7fdd841087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2161988028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84102ac0 0x7fdd84102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 -- 172.21.15.102:0/2161988028 >> 172.21.15.102:0/2161988028 conn(0x7fdd84079790 msgr2=0x7fdd84079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 -- 172.21.15.102:0/2161988028 shutdown_connections 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.715+0000 7fdd8987e640 1 -- 172.21.15.102:0/2161988028 wait complete. 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 Processor -- start 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 -- start start 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd84102ac0 0x7fdd84199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84108d00 0x7fdd84199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd84112af0 con 0x7fdd841083b0 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd84112970 con 0x7fdd84108d00 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.716+0000 7fdd8987e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd84112c70 con 0x7fdd84102ac0 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47702/0 (socket says 172.21.15.102:47702) 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 -- 172.21.15.102:0/2554447398 learned_addr learned my addr 172.21.15.102:0/2554447398 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd84102ac0 0x7fdd84199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd837fe640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84108d00 0x7fdd84199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 -- 172.21.15.102:0/2554447398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd84102ac0 msgr2=0x7fdd84199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd84102ac0 0x7fdd84199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 -- 172.21.15.102:0/2554447398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84108d00 msgr2=0x7fdd84199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84108d00 0x7fdd84199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 -- 172.21.15.102:0/2554447398 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd841a87f0 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdd78006fd0 tx=0x7fdd7800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd8887c640 1 -- 172.21.15.102:0/2554447398 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011830 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd841a8a80 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd8887c640 1 -- 172.21.15.102:0/2554447398 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd78016070 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd8887c640 1 -- 172.21.15.102:0/2554447398 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800f2e0 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.717+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd841a9010 con 0x7fdd841083b0 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.720+0000 7fdd8fdf2740 1 Processor -- start 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.720+0000 7fdd8fdf2740 1 -- start start 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbdf070 0x55a1adf866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 0x55a1adf86be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a1adefcea0 con 0x55a1adbbe390 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a1adeec2d0 con 0x55a1adbb61b0 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a1adef00e0 con 0x55a1adbdf070 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd8887c640 1 -- 172.21.15.102:0/2554447398 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fdd780119d0 con 0x7fdd841083b0 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd82ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 0x55a1adf86be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47706/0 (socket says 172.21.15.102:47706) 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd82ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 0x55a1adf86be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39802/0 (socket says 172.21.15.102:39802) 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 -- 172.21.15.102:0/1250158808 learned_addr learned my addr 172.21.15.102:0/1250158808 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd837fe640 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbdf070 0x55a1adf866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 -- 172.21.15.102:0/1250158808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbdf070 msgr2=0x55a1adf866a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbdf070 0x55a1adf866a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 -- 172.21.15.102:0/1250158808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 msgr2=0x55a1adf86be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 0x55a1adf86be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.721+0000 7fdd827fc640 1 -- 172.21.15.102:0/1250158808 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1adc4a650 con 0x55a1adbbe390 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdd780e44a0 tx=0x7fdd780ef4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201607530c1e3b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd8887c640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 0x7fdd6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd69ffb640 1 -- 172.21.15.102:0/1250158808 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd780fa070 con 0x55a1adbbe390 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd837fe640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 0x7fdd6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd69ffb640 1 -- 172.21.15.102:0/1250158808 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd780ac740 con 0x55a1adbbe390 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd69ffb640 1 -- 172.21.15.102:0/1250158808 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78080800 con 0x55a1adbbe390 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.722+0000 7fdd8887c640 1 -- 172.21.15.102:0/2554447398 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdd780e6df0 con 0x7fdd841083b0 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1250158808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 msgr2=0x55a1adf87120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd837fe640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 0x7fdd6c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009a60 tx=0x7fdd7c009430 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fdd780e44a0 tx=0x7fdd780ef4b0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1250158808 shutdown_connections 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf87120 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbb61b0 0x55a1adf86be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1250158808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbdf070 0x55a1adf866a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1250158808 >> 172.21.15.102:0/1250158808 conn(0x55a1adbd3460 msgr2=0x55a1adf84590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1250158808 shutdown_connections 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1250158808 wait complete. 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.723+0000 7fdd8fdf2740 1 -- start start 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 Processor -- start 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adf91ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 0x55a1adf927a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a1add4d700 con 0x55a1adbbe390 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a1ade87160 con 0x55a1adbdf070 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a1adf94d00 con 0x55a1adbb61b0 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd8fdf2740 10 client.0 _ll_register_callbacks cb 0x55a1adea09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47708/0 (socket says 172.21.15.102:47708) 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 -- 172.21.15.102:0/3440569750 learned_addr learned my addr 172.21.15.102:0/3440569750 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd837fe640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 0x55a1adf927a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adf91ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 -- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 msgr2=0x55a1adf91ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adf91ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 -- 172.21.15.102:0/3440569750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 msgr2=0x55a1adf927a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 0x55a1adf927a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.724+0000 7fdd827fc640 1 -- 172.21.15.102:0/3440569750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1adeb4c90 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adf91ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd837fe640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 0x55a1adf927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd827fc640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800bde0 tx=0x7fdd78010730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7671cb16f7d33b63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7807fa00 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdd78011cc0 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd780ac740 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd7807fc50 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 10 client.15930 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1adfa09d0 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd780ac740 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdd780a8ea0 con 0x55a1adbbe390 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 10 client.15930 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:37.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 20 client.15930 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.725+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adb9d9f0 0x55a1adfa3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.726+0000 7fdd8fdf2740 4 client.15930 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.726+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1adefedf0 con 0x55a1adb9d9f0 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.726+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adb9d9f0 0x55a1adfa3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.726+0000 7fdd62ffd640 10 client.15930 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.726+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adb9d9f0 0x55a1adfa3d30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be9028c6daa590c server_cookie=fe9d5c269fa86f95 in_seq=0 out_seq=0 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd62ffd640 1 -- 172.21.15.102:0/3440569750 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1adefedf0 con 0x55a1adb9d9f0 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd62ffd640 10 client.15930 handle_command_reply: tid=0 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 client.15930 shutdown 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 msgr2=0x55a1adf92220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800bde0 tx=0x7fdd78010730 comp rx=0 tx=0).stop 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 shutdown_connections 2024-09-21T03:36:37.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adb9d9f0 0x55a1adfa3d30 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbbe390 0x55a1adf92220 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbdf070 0x55a1adf927a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd62ffd640 0 client.15930 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/3440569750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adf91ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 >> 172.21.15.102:0/3440569750 conn(0x55a1adbd3460 msgr2=0x55a1adf89830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 shutdown_connections 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.727+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/3440569750 wait complete. 2024-09-21T03:36:37.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.728+0000 7fdd8fdf2740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T03:36:37.746 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:37 smithi148 ceph-mon[34651]: pgmap v415: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 Processor -- start 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 -- start start 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adb9d9f0 0x55a1adf921a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbbe390 0x55a1adf84100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841b4500 con 0x55a1adbb61b0 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841b1d10 con 0x55a1adb9d9f0 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841afb60 con 0x55a1adbbe390 2024-09-21T03:36:37.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47712/0 (socket says 172.21.15.102:47712) 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd827fc640 1 -- 172.21.15.102:0/2087406251 learned_addr learned my addr 172.21.15.102:0/2087406251 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.741+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adb9d9f0 0x55a1adf921a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 -- 172.21.15.102:0/2087406251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbbe390 msgr2=0x55a1adf84100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbbe390 0x55a1adf84100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 -- 172.21.15.102:0/2087406251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adb9d9f0 msgr2=0x55a1adf921a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adb9d9f0 0x55a1adf921a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 -- 172.21.15.102:0/2087406251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1adf88990 con 0x55a1adbb61b0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd827fc640 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdd780805e0 tx=0x7fdd780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94434e124c6a6c79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd697fa640 1 -- 172.21.15.102:0/2087406251 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd7807fe50 con 0x55a1adbb61b0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd697fa640 1 -- 172.21.15.102:0/2087406251 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd780ea710 con 0x55a1adbb61b0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.742+0000 7fdd697fa640 1 -- 172.21.15.102:0/2087406251 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd78080040 con 0x55a1adbb61b0 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/2087406251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 msgr2=0x55a1adf83bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fdd780805e0 tx=0x7fdd780046c0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/2087406251 shutdown_connections 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adbb61b0 0x55a1adf83bc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbbe390 0x55a1adf84100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/2087406251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adb9d9f0 0x55a1adf921a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/2087406251 >> 172.21.15.102:0/2087406251 conn(0x55a1adbd3460 msgr2=0x55a1adf91a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/2087406251 shutdown_connections 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/2087406251 wait complete. 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.743+0000 7fdd8fdf2740 1 -- start start 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 Processor -- start 2024-09-21T03:36:37.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adfa5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbbe390 0x55a1adfa59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841b01d0 con 0x55a1adb9d9f0 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841b1640 con 0x55a1adbbe390 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdd841b08a0 con 0x55a1adbb61b0 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd8fdf2740 10 client.0 _ll_register_callbacks cb 0x7fdd780f8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47720/0 (socket says 172.21.15.102:47720) 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 -- 172.21.15.102:0/1807587425 learned_addr learned my addr 172.21.15.102:0/1807587425 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adfa5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 -- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 msgr2=0x55a1adfa5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adfa5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 -- 172.21.15.102:0/1807587425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbbe390 msgr2=0x55a1adfa59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbbe390 0x55a1adfa59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.744+0000 7fdd82ffd640 1 -- 172.21.15.102:0/1807587425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ae00d6b0 con 0x55a1adb9d9f0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd82ffd640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55a1adf85320 tx=0x7fdd7400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867e7e541b37d5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74023640 con 0x55a1adb9d9f0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdd74011440 con 0x55a1adb9d9f0 2024-09-21T03:36:37.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd780ea710 con 0x55a1adb9d9f0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdd740237e0 con 0x55a1adb9d9f0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 10 client.15936 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a1ae00e980 con 0x55a1adb9d9f0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdd780ea710 con 0x55a1adb9d9f0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdd74021070 con 0x55a1adb9d9f0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 10 client.15936 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 20 client.15936 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adbdf070 0x55a1ae011250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 4 client.15936 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.745+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1adefa8a0 con 0x55a1adbdf070 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adbdf070 0x55a1ae011250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd62ffd640 10 client.15936 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:37.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd827fc640 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adbdf070 0x55a1ae011250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674533a3c36f49ef server_cookie=6183e9a530b2a4f7 in_seq=0 out_seq=0 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd62ffd640 1 -- 172.21.15.102:0/1807587425 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1adefa8a0 con 0x55a1adbdf070 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd62ffd640 10 client.15936 handle_command_reply: tid=0 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 client.15936 shutdown 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 msgr2=0x55a1adfa4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x55a1adf85320 tx=0x7fdd7400cf40 comp rx=0 tx=0).stop 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 shutdown_connections 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a1adbbe390 0x55a1adfa59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a1adbb61b0 0x55a1adfa5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a1adbdf070 0x55a1ae011250 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.746+0000 7fdd8fdf2740 1 --2- 172.21.15.102:0/1807587425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a1adb9d9f0 0x55a1adfa4f20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 >> 172.21.15.102:0/1807587425 conn(0x55a1adbd3460 msgr2=0x55a1adf9cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd62ffd640 0 client.15936 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:37.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 shutdown_connections 2024-09-21T03:36:37.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8fdf2740 1 -- 172.21.15.102:0/1807587425 wait complete. 2024-09-21T03:36:37.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8fdf2740 20 client.15936 trim_cache size 0 max 16384 2024-09-21T03:36:37.758 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 msgr2=0x7fdd6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 0x7fdd6c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009a60 tx=0x7fdd7c009430 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 msgr2=0x7fdd841996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fdd78006fd0 tx=0x7fdd7800b8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 shutdown_connections 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdd6c0b6680 0x7fdd6c0b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdd841083b0 0x7fdd841996b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd84108d00 0x7fdd84199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 --2- 172.21.15.102:0/2554447398 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdd84102ac0 0x7fdd84199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.747+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 >> 172.21.15.102:0/2554447398 conn(0x7fdd84079790 msgr2=0x7fdd84104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.748+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 shutdown_connections 2024-09-21T03:36:37.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:37.748+0000 7fdd8987e640 1 -- 172.21.15.102:0/2554447398 wait complete. 2024-09-21T03:36:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:37 smithi121 ceph-mon[34316]: pgmap v415: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-21T03:36:39.538 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:36:39.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:36:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:39 smithi102 ceph-mon[31392]: pgmap v416: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:36:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:39 smithi148 ceph-mon[34651]: pgmap v416: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:36:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:39 smithi121 ceph-mon[34316]: pgmap v416: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T03:36:39.794 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- 172.21.15.102:0/1209788742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1031f0 msgr2=0x7fb2cc103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 --2- 172.21.15.102:0/1209788742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc103600 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009ca0 tx=0x7fb2c802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- 172.21.15.102:0/1209788742 shutdown_connections 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 --2- 172.21.15.102:0/1209788742 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 0x7fb2cc10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 --2- 172.21.15.102:0/1209788742 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 --2- 172.21.15.102:0/1209788742 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc103600 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- 172.21.15.102:0/1209788742 >> 172.21.15.102:0/1209788742 conn(0x7fb2cc079f90 msgr2=0x7fb2cc07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- 172.21.15.102:0/1209788742 shutdown_connections 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- 172.21.15.102:0/1209788742 wait complete. 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 Processor -- start 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.302+0000 7fb2d3937640 1 -- start start 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 0x7fb2cc19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc112b30 con 0x7fb2cc1051c0 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1129b0 con 0x7fb2cc1031f0 2024-09-21T03:36:40.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d3937640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc112cb0 con 0x7fb2cc105b10 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47736/0 (socket says 172.21.15.102:47736) 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 -- 172.21.15.102:0/2151154666 learned_addr learned my addr 172.21.15.102:0/2151154666 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 0x7fb2cc19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 -- 172.21.15.102:0/2151154666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 msgr2=0x7fb2cc19ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 0x7fb2cc19ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 -- 172.21.15.102:0/2151154666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1031f0 msgr2=0x7fb2cc1994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc1994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 -- 172.21.15.102:0/2151154666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc19f410 con 0x7fb2cc1051c0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e9f0 tx=0x7fb2bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.303+0000 7fb2c27fc640 1 -- 172.21.15.102:0/2151154666 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00ccc0 con 0x7fb2cc1051c0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.304+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc19f700 con 0x7fb2cc1051c0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.304+0000 7fb2c27fc640 1 -- 172.21.15.102:0/2151154666 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2bc010900 con 0x7fb2cc1051c0 2024-09-21T03:36:40.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.304+0000 7fb2c27fc640 1 -- 172.21.15.102:0/2151154666 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc018900 con 0x7fb2cc1051c0 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.304+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc1a5e60 con 0x7fb2cc1051c0 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.306+0000 7fb2d9eab740 1 Processor -- start 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.306+0000 7fb2d9eab740 1 -- start start 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2c27fc640 1 -- 172.21.15.102:0/2151154666 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fb2bc010ab0 con 0x7fb2cc1051c0 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbde0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edefb51e60 con 0x55edef834350 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edefb41290 con 0x55edef80b490 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edefb450a0 con 0x55edef813670 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47738/0 (socket says 172.21.15.102:47738) 2024-09-21T03:36:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/763374171 learned_addr learned my addr 172.21.15.102:0/763374171 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbde0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/763374171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 msgr2=0x55edefbde0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbde0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/763374171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 msgr2=0x55edefbddb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbddb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/763374171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edef89f930 con 0x55edef834350 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.307+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b700 tx=0x7fb2c400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a30978dcf9b90b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2c27fc640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 0x7fb2b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2b77fe640 1 -- 172.21.15.102:0/763374171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4003dd0 con 0x55edef834350 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 0x7fb2b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2b77fe640 1 -- 172.21.15.102:0/763374171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c4015070 con 0x55edef834350 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2b77fe640 1 -- 172.21.15.102:0/763374171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40106a0 con 0x55edef834350 2024-09-21T03:36:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.308+0000 7fb2c27fc640 1 -- 172.21.15.102:0/2151154666 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb2bc0e7ae0 con 0x7fb2cc1051c0 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- 172.21.15.102:0/763374171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 msgr2=0x55edefbdd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 0x7fb2b80b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55edefbdc2c0 tx=0x7fb2c80094a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b700 tx=0x7fb2c400bbc0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- 172.21.15.102:0/763374171 shutdown_connections 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbde0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbddb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/763374171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbdd640 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- 172.21.15.102:0/763374171 >> 172.21.15.102:0/763374171 conn(0x55edef828740 msgr2=0x55edefbdb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- 172.21.15.102:0/763374171 shutdown_connections 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- 172.21.15.102:0/763374171 wait complete. 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 -- start start 2024-09-21T03:36:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.309+0000 7fb2d9eab740 1 Processor -- start 2024-09-21T03:36:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef80b490 0x55edefbe9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 0x55edefbe9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edef9a2890 con 0x55edef834350 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55edefadbd40 con 0x55edef813670 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55edefbebe20 con 0x55edef80b490 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d9eab740 10 client.0 _ll_register_callbacks cb 0x55edefb3fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47740/0 (socket says 172.21.15.102:47740) 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/3884061922 learned_addr learned my addr 172.21.15.102:0/3884061922 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 0x55edefbe9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef80b490 0x55edefbe9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef80b490 msgr2=0x55edefbe9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef80b490 0x55edefbe9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/3884061922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 msgr2=0x55edefbe9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 0x55edefbe9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/3884061922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edefbf5750 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.310+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 0x55edefbe9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4011e00 tx=0x7fb2c4003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0f666529dd5c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4005440 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb2c40055e0 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c4015070 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb2c40046c0 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 10 client.15948 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55edefbf8080 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c4015070 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb2c401a470 con 0x55edef834350 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 10 client.15948 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 20 client.15948 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef7f2cd0 0x55edefbfb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 4 client.15948 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.311+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edefb53db0 con 0x55edef7f2cd0 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.312+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef7f2cd0 0x55edefbfb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.312+0000 7fb2b4ff9640 10 client.15948 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.312+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef7f2cd0 0x55edefbfb4f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22ea83b61930dbb9 server_cookie=2a38f67eda9aec52 in_seq=0 out_seq=0 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/3884061922 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edefb53db0 con 0x55edef7f2cd0 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2b4ff9640 10 client.15948 handle_command_reply: tid=0 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 client.15948 shutdown 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 msgr2=0x55edefbf5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4011e00 tx=0x7fb2c4003e00 comp rx=0 tx=0).stop 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 shutdown_connections 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef7f2cd0 0x55edefbfb4f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef834350 0x55edefbf5140 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef813670 0x55edefbe9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3884061922 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef80b490 0x55edefbe9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2b4ff9640 0 client.15948 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 >> 172.21.15.102:0/3884061922 conn(0x55edef828740 msgr2=0x55edefbe0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 shutdown_connections 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3884061922 wait complete. 2024-09-21T03:36:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.313+0000 7fb2d9eab740 20 client.15948 trim_cache size 0 max 16384 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 Processor -- start 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 -- start start 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbe7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbe7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1b0140 con 0x55edef828740 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ad950 con 0x55edef80b490 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ab7a0 con 0x55edef813670 2024-09-21T03:36:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d16d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d16d3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47742/0 (socket says 172.21.15.102:47742) 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d16d3640 1 -- 172.21.15.102:0/3670119915 learned_addr learned my addr 172.21.15.102:0/3670119915 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbe7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.331+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbe7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 -- 172.21.15.102:0/3670119915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 msgr2=0x55edefbe7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbe7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 -- 172.21.15.102:0/3670119915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 msgr2=0x55edefbe7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbe7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 -- 172.21.15.102:0/3670119915 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edefbf5580 con 0x55edef828740 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802ade0 tx=0x7fb2c8044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4fe8735d0cab9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2b6ffd640 1 -- 172.21.15.102:0/3670119915 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8031450 con 0x55edef828740 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2b6ffd640 1 -- 172.21.15.102:0/3670119915 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c8036040 con 0x55edef828740 2024-09-21T03:36:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.332+0000 7fb2b6ffd640 1 -- 172.21.15.102:0/3670119915 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8030820 con 0x55edef828740 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3670119915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 msgr2=0x55edefbf5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb2c802ade0 tx=0x7fb2c8044000 comp rx=0 tx=0).stop 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3670119915 shutdown_connections 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbe7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbe7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/3670119915 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbf5040 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3670119915 >> 172.21.15.102:0/3670119915 conn(0x55edefbdb570 msgr2=0x55edefbe41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3670119915 shutdown_connections 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- 172.21.15.102:0/3670119915 wait complete. 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 -- start start 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.333+0000 7fb2d9eab740 1 Processor -- start 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbed6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1abe10 con 0x55edef828740 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ad280 con 0x55edef80b490 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc1ac4e0 con 0x55edef813670 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d9eab740 10 client.0 _ll_register_callbacks cb 0x7fb2bc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47752/0 (socket says 172.21.15.102:47752) 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/484248352 learned_addr learned my addr 172.21.15.102:0/484248352 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbed6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 msgr2=0x55edefbed6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbed6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/484248352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 msgr2=0x55edefbed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d1ed4640 1 -- 172.21.15.102:0/484248352 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edefc64d90 con 0x55edef828740 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.334+0000 7fb2d0ed2640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d1ed4640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b620 tx=0x7fb2c400b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9943e15e89f4e992 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c401acb0 con 0x55edef828740 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb2c4005240 con 0x55edef828740 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2c8036040 con 0x55edef828740 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb2c4042050 con 0x55edef828740 2024-09-21T03:36:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 10 client.15954 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55edefc66050 con 0x55edef828740 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb2c8036040 con 0x55edef828740 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fb2c4005440 con 0x55edef828740 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 10 client.15954 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 10 client.15954 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 20 client.15954 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef834350 0x55edefc68830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 4 client.15954 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.335+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55edefb4f860 con 0x55edef834350 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.336+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef834350 0x55edefc68830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.336+0000 7fb2d16d3640 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef834350 0x55edefc68830 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b836f4d35f53ff7 server_cookie=4b477ce35793d814 in_seq=0 out_seq=0 2024-09-21T03:36:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.336+0000 7fb2b4ff9640 10 client.15954 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:40.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2b4ff9640 1 -- 172.21.15.102:0/484248352 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55edefb4f860 con 0x55edef834350 2024-09-21T03:36:40.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2b4ff9640 10 client.15954 handle_command_reply: tid=0 2024-09-21T03:36:40.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 client.15954 shutdown 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 msgr2=0x55edefbedbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400b620 tx=0x7fb2c400b2e0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 shutdown_connections 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55edef834350 0x55edefc68830 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2b4ff9640 0 client.15954 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edef828740 0x55edefbedbf0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55edef813670 0x55edefbed6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 --2- 172.21.15.102:0/484248352 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55edef80b490 0x55edefbed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 >> 172.21.15.102:0/484248352 conn(0x55edefbdb570 msgr2=0x55edefbe41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 shutdown_connections 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 1 -- 172.21.15.102:0/484248352 wait complete. 2024-09-21T03:36:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.338+0000 7fb2d9eab740 20 client.15954 trim_cache size 0 max 16384 2024-09-21T03:36:40.344 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:36:40.344 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:36:40.344 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "d4537e22-001f-4900-84d6-1280c566048f", 2024-09-21T03:36:40.344 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:36:40.344 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 msgr2=0x7fb2b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 0x7fb2b80b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55edefbdc2c0 tx=0x7fb2c80094a0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 msgr2=0x7fb2cc199a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc00e9f0 tx=0x7fb2bc00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 shutdown_connections 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb2b80b6680 0x7fb2b80b8b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb2cc1051c0 0x7fb2cc199a40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb2cc105b10 0x7fb2cc19ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 --2- 172.21.15.102:0/2151154666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb2cc1031f0 0x7fb2cc1994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 >> 172.21.15.102:0/2151154666 conn(0x7fb2cc079f90 msgr2=0x7fb2cc107320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 shutdown_connections 2024-09-21T03:36:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:40.339+0000 7fb2d3937640 1 -- 172.21.15.102:0/2151154666 wait complete. 2024-09-21T03:36:41.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:36:41.385 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:41.645 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:41 smithi102 ceph-mon[31392]: pgmap v417: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:36:41.645 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:41 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:36:41.645 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:41 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.645 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:41 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:36:41.645 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:41 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:41 smithi148 ceph-mon[34651]: pgmap v417: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:36:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:41 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:36:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:41 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:41 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:36:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:41 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:41 smithi121 ceph-mon[34316]: pgmap v417: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T03:36:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:41 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:36:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:41 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:41 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:36:41.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:41 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:41.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 -- 172.21.15.102:0/2142860213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b3010de10 msgr2=0x7f8b301102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2142860213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b3010de10 0x7f8b301102f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009900 tx=0x7f8b2802a410 comp rx=0 tx=0).stop 2024-09-21T03:36:41.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 -- 172.21.15.102:0/2142860213 shutdown_connections 2024-09-21T03:36:41.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2142860213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b3010de10 0x7f8b301102f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2142860213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2142860213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b30104860 0x7f8b30104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 -- 172.21.15.102:0/2142860213 >> 172.21.15.102:0/2142860213 conn(0x7f8b30079730 msgr2=0x7f8b30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 -- 172.21.15.102:0/2142860213 shutdown_connections 2024-09-21T03:36:41.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.860+0000 7f8b381a2640 1 -- 172.21.15.102:0/2142860213 wait complete. 2024-09-21T03:36:41.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 Processor -- start 2024-09-21T03:36:41.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 -- start start 2024-09-21T03:36:41.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 0x7f8b3019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30113ba0 con 0x7f8b30104860 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30113a20 con 0x7f8b3010de10 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b381a2640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30113d20 con 0x7f8b30105290 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b35f3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b35f3e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47772/0 (socket says 172.21.15.102:47772) 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.861+0000 7f8b35f3e640 1 -- 172.21.15.102:0/2901516665 learned_addr learned my addr 172.21.15.102:0/2901516665 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 0x7f8b3019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 -- 172.21.15.102:0/2901516665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 msgr2=0x7f8b3019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 -- 172.21.15.102:0/2901516665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 msgr2=0x7f8b3019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 0x7f8b3019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 -- 172.21.15.102:0/2901516665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b301a0480 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 0x7f8b3019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000db80 tx=0x7f8b2000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b2effd640 1 -- 172.21.15.102:0/2901516665 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20017070 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b301a0770 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b2effd640 1 -- 172.21.15.102:0/2901516665 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b20003b70 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b2effd640 1 -- 172.21.15.102:0/2901516665 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b200106c0 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.862+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b301a6ed0 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.865+0000 7f8b3e716740 1 Processor -- start 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 -- start start 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b2effd640 1 -- 172.21.15.102:0/2901516665 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f8b20004020 con 0x7f8b30104860 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cf39724e50 con 0x55cf39407070 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf39714280 con 0x55cf393de1b0 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3e716740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf39718090 con 0x55cf393e6390 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47774/0 (socket says 172.21.15.102:47774) 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3673f640 1 -- 172.21.15.102:0/2482907803 learned_addr learned my addr 172.21.15.102:0/2482907803 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.866+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 -- 172.21.15.102:0/2482907803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 msgr2=0x55cf397af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 -- 172.21.15.102:0/2482907803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 msgr2=0x55cf397aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 -- 172.21.15.102:0/2482907803 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf39472650 con 0x55cf39407070 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b28006010 tx=0x7f8b28032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efc84ef2d055d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b17fff640 1 -- 172.21.15.102:0/2482907803 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2803f070 con 0x55cf39407070 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b2effd640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 0x7f8b180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b17fff640 1 -- 172.21.15.102:0/2482907803 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b28031710 con 0x55cf39407070 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b17fff640 1 -- 172.21.15.102:0/2482907803 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28035070 con 0x55cf39407070 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 0x7f8b180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.867+0000 7f8b2effd640 1 -- 172.21.15.102:0/2901516665 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8b200e75f0 con 0x7f8b30104860 2024-09-21T03:36:41.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 -- 172.21.15.102:0/2482907803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 msgr2=0x55cf397ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b35f3e640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 0x7f8b180b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b200e4de0 tx=0x7f8b2000bf20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8b28006010 tx=0x7f8b28032c80 comp rx=0 tx=0).stop 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 -- 172.21.15.102:0/2482907803 shutdown_connections 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2482907803 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ae650 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 -- 172.21.15.102:0/2482907803 >> 172.21.15.102:0/2482907803 conn(0x55cf393fb460 msgr2=0x55cf397ac540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 -- 172.21.15.102:0/2482907803 shutdown_connections 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.868+0000 7f8b3e716740 1 -- 172.21.15.102:0/2482907803 wait complete. 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 -- start start 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 Processor -- start 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397ba270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cf39575700 con 0x55cf39407070 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf396af110 con 0x55cf393de1b0 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf397c11e0 con 0x55cf393e6390 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3e716740 10 client.0 _ll_register_callbacks cb 0x55cf396c8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47788/0 (socket says 172.21.15.102:47788) 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3673f640 1 -- 172.21.15.102:0/2479739192 learned_addr learned my addr 172.21.15.102:0/2479739192 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.869+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397ba270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 -- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 msgr2=0x55cf397ba270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397ba270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 -- 172.21.15.102:0/2479739192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 msgr2=0x55cf397b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397b9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 -- 172.21.15.102:0/2479739192 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf396dcc40 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8b280053c0 tx=0x7f8b280052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5f91b5a533100d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28035070 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8b280046c0 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b28031710 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b28058050 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3e716740 10 client.15966 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf397ccee0 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.870+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b28031710 con 0x55cf39407070 2024-09-21T03:36:41.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8b2803b9d0 con 0x55cf39407070 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 10 client.15966 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 10 client.15966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 20 client.15966 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf393c59f0 0x55cf397d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 4 client.15966 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf39726da0 con 0x55cf393c59f0 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.871+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf393c59f0 0x55cf397d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b157fa640 10 client.15966 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf393c59f0 0x55cf397d0240 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f3fa4d8f9c2099d server_cookie=a873340d24f26cbc in_seq=0 out_seq=0 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b157fa640 1 -- 172.21.15.102:0/2479739192 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf39726da0 con 0x55cf393c59f0 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b157fa640 10 client.15966 handle_command_reply: tid=0 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b3e716740 1 client.15966 shutdown 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 msgr2=0x55cf397ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.872+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f8b280053c0 tx=0x7f8b280052c0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 shutdown_connections 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf393c59f0 0x55cf397d0240 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397ca500 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397ba270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2479739192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b157fa640 0 client.15966 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 >> 172.21.15.102:0/2479739192 conn(0x55cf393fb460 msgr2=0x55cf397b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 shutdown_connections 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 1 -- 172.21.15.102:0/2479739192 wait complete. 2024-09-21T03:36:41.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.873+0000 7f8b3e716740 20 client.15966 trim_cache size 0 max 16384 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 Processor -- start 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 -- start start 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393de1b0 0x55cf397ba1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf39407070 0x55cf397b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301aff50 con 0x55cf393e6390 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ad760 con 0x55cf39407070 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3e716740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ab5b0 con 0x55cf393de1b0 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47794/0 (socket says 172.21.15.102:47794) 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 -- 172.21.15.102:0/1855415991 learned_addr learned my addr 172.21.15.102:0/1855415991 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 -- 172.21.15.102:0/1855415991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393de1b0 msgr2=0x55cf397ba1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3673f640 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393de1b0 0x55cf397ba1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393de1b0 0x55cf397ba1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 -- 172.21.15.102:0/1855415991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf39407070 msgr2=0x55cf397b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf39407070 0x55cf397b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.890+0000 7f8b3573d640 1 -- 172.21.15.102:0/1855415991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf397b8c90 con 0x55cf393e6390 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.891+0000 7f8b3573d640 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8b3006aaa0 tx=0x7f8b240094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be97739217ee308a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.891+0000 7f8b177fe640 1 -- 172.21.15.102:0/1855415991 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24023600 con 0x55cf393e6390 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.891+0000 7f8b177fe640 1 -- 172.21.15.102:0/1855415991 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b24023c70 con 0x55cf393e6390 2024-09-21T03:36:41.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.891+0000 7f8b177fe640 1 -- 172.21.15.102:0/1855415991 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011cc0 con 0x55cf393e6390 2024-09-21T03:36:41.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- 172.21.15.102:0/1855415991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 msgr2=0x55cf397b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8b3006aaa0 tx=0x7f8b240094b0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- 172.21.15.102:0/1855415991 shutdown_connections 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf393e6390 0x55cf397b1750 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf39407070 0x55cf397b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 --2- 172.21.15.102:0/1855415991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393de1b0 0x55cf397ba1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- 172.21.15.102:0/1855415991 >> 172.21.15.102:0/1855415991 conn(0x55cf393fb460 msgr2=0x55cf397b9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- 172.21.15.102:0/1855415991 shutdown_connections 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- 172.21.15.102:0/1855415991 wait complete. 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 -- start start 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.892+0000 7f8b3e716740 1 Processor -- start 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301abc20 con 0x55cf39407070 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ad090 con 0x55cf393de1b0 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8b301ac2f0 con 0x55cf393e6390 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3e716740 10 client.0 _ll_register_callbacks cb 0x7f8b28032b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47808/0 (socket says 172.21.15.102:47808) 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 -- 172.21.15.102:0/2425193340 learned_addr learned my addr 172.21.15.102:0/2425193340 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 -- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 msgr2=0x55cf397d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 -- 172.21.15.102:0/2425193340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 msgr2=0x55cf397d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 -- 172.21.15.102:0/2425193340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf398399c0 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b3673f640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001eb0 tx=0x7f8b2803bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6b915c4c9230f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.893+0000 7f8b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28035050 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8b2804d040 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b24023c70 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8b2803f040 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 10 client.15972 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cf3983ab90 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8b24023c70 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f8b28004750 con 0x55cf39407070 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 10 client.15972 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 10 client.15972 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 20 client.15972 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:41.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf3939ada0 0x55cf3983d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:41.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 4 client.15972 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:36:41.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.894+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cf39722850 con 0x55cf3939ada0 2024-09-21T03:36:41.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.895+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf3939ada0 0x55cf3983d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.895+0000 7f8b3573d640 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf3939ada0 0x55cf3983d210 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3402ccb8f7929120 server_cookie=8811ad9ee0f6e414 in_seq=0 out_seq=0 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.895+0000 7f8b157fa640 10 client.15972 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b157fa640 1 -- 172.21.15.102:0/2425193340 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55cf39722850 con 0x55cf3939ada0 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b157fa640 10 client.15972 handle_command_reply: tid=0 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 client.15972 shutdown 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 msgr2=0x55cf397d1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001eb0 tx=0x7f8b2803bf90 comp rx=0 tx=0).stop 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 shutdown_connections 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf3939ada0 0x55cf3983d210 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf39407070 0x55cf397d1c80 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf393e6390 0x55cf397d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b157fa640 0 client.15972 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 --2- 172.21.15.102:0/2425193340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf393de1b0 0x55cf397d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 >> 172.21.15.102:0/2425193340 conn(0x55cf393fb460 msgr2=0x55cf397b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 shutdown_connections 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 1 -- 172.21.15.102:0/2425193340 wait complete. 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.896+0000 7f8b3e716740 20 client.15972 trim_cache size 0 max 16384 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:36:41.902 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:41.903 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:36:41.904 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:41.905 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:41.906 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:41.906 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:36:41.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 msgr2=0x7f8b180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 0x7f8b180b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8b200e4de0 tx=0x7f8b2000bf20 comp rx=0 tx=0).stop 2024-09-21T03:36:41.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 msgr2=0x7f8b3019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000db80 tx=0x7f8b2000b630 comp rx=0 tx=0).stop 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 shutdown_connections 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8b180b6680 0x7f8b180b8b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8b3010de10 0x7f8b3019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8b30105290 0x7f8b3019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 --2- 172.21.15.102:0/2901516665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8b30104860 0x7f8b3019a510 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 >> 172.21.15.102:0/2901516665 conn(0x7f8b30079730 msgr2=0x7f8b30107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 shutdown_connections 2024-09-21T03:36:41.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:41.897+0000 7f8b381a2640 1 -- 172.21.15.102:0/2901516665 wait complete. 2024-09-21T03:36:42.623 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:42 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:36:42.739 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:36:42.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:36:42.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:42 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:36:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:42 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:36:42.984 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:43.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- 172.21.15.102:0/2424059010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0102ae0 msgr2=0x7feef0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:43.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 --2- 172.21.15.102:0/2424059010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0102ae0 0x7feef0102ef0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7feee0009900 tx=0x7feee002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- 172.21.15.102:0/2424059010 shutdown_connections 2024-09-21T03:36:43.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 --2- 172.21.15.102:0/2424059010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108d70 0x7feef010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 --2- 172.21.15.102:0/2424059010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0108420 0x7feef0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 --2- 172.21.15.102:0/2424059010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0102ae0 0x7feef0102ef0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- 172.21.15.102:0/2424059010 >> 172.21.15.102:0/2424059010 conn(0x7feef0079770 msgr2=0x7feef0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- 172.21.15.102:0/2424059010 shutdown_connections 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- 172.21.15.102:0/2424059010 wait complete. 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 Processor -- start 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.511+0000 7feef5610640 1 -- start start 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0102ae0 0x7feef0110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108420 0x7feef01105c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113cd0 con 0x7feef0108d70 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113b50 con 0x7feef0102ae0 2024-09-21T03:36:43.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feef5610640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feef0113e50 con 0x7feef0108420 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:47830/0 (socket says 172.21.15.102:47830) 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 -- 172.21.15.102:0/2156089279 learned_addr learned my addr 172.21.15.102:0/2156089279 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeeeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0102ae0 0x7feef0110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feee7fff640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108420 0x7feef01105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 -- 172.21.15.102:0/2156089279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108420 msgr2=0x7feef01105c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108420 0x7feef01105c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 -- 172.21.15.102:0/2156089279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0102ae0 msgr2=0x7feef0110080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0102ae0 0x7feef0110080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 -- 172.21.15.102:0/2156089279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef01a89a0 con 0x7feef0108d70 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.512+0000 7feeef7fe640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feee800b970 tx=0x7feee800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.513+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8019070 con 0x7feef0108d70 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.513+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feee800cb40 con 0x7feef0108d70 2024-09-21T03:36:43.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.513+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee8007650 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.513+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef01a8c90 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.513+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feef01a9180 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.514+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feef0103d60 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.515+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7feee801c070 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.516+0000 7feeecff9640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 0x7feedc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.516+0000 7feeeeffd640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 0x7feedc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.516+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7feee80e7070 con 0x7feef0108d70 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.516+0000 7feeeeffd640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 0x7feedc0b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feef0111ad0 tx=0x7feee00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:43.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.519+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feee80b1990 con 0x7feef0108d70 2024-09-21T03:36:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:43 smithi102 ceph-mon[31392]: pgmap v418: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T03:36:43.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.735+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feef0111380 con 0x7feef0108d70 2024-09-21T03:36:43.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.735+0000 7feeecff9640 1 -- 172.21.15.102:0/2156089279 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11942 (secure 0 0 0) 0x7feef0111380 con 0x7feef0108d70 2024-09-21T03:36:43.739 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:36:43.739 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":29,"btime":"2024-09-21T03:35:52:382620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:35:51.414877+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:36:43.739 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 29 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 msgr2=0x7feedc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 0x7feedc0b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feef0111ad0 tx=0x7feee00058d0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 msgr2=0x7feef0110b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feee800b970 tx=0x7feee800be30 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 shutdown_connections 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feedc0b6680 0x7feedc0b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feef0108d70 0x7feef0110b00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feef0108420 0x7feef01105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 --2- 172.21.15.102:0/2156089279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feef0102ae0 0x7feef0110080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:43.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 >> 172.21.15.102:0/2156089279 conn(0x7feef0079770 msgr2=0x7feef01064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:43.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 shutdown_connections 2024-09-21T03:36:43.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:43.738+0000 7feef5610640 1 -- 172.21.15.102:0/2156089279 wait complete. 2024-09-21T03:36:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:43 smithi148 ceph-mon[34651]: pgmap v418: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T03:36:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:43 smithi121 ceph-mon[34316]: pgmap v418: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T03:36:44.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:36:44.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2156089279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2156089279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:44.768 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2156089279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 -- 172.21.15.102:0/870175440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c810c040 msgr2=0x7fe9c8112870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 --2- 172.21.15.102:0/870175440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c810c040 0x7fe9c8112870 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009ca0 tx=0x7fe9c002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 -- 172.21.15.102:0/870175440 shutdown_connections 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 --2- 172.21.15.102:0/870175440 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c810c040 0x7fe9c8112870 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 --2- 172.21.15.102:0/870175440 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810b6f0 0x7fe9c810bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 --2- 172.21.15.102:0/870175440 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c8105db0 0x7fe9c81061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 -- 172.21.15.102:0/870175440 >> 172.21.15.102:0/870175440 conn(0x7fe9c8101800 msgr2=0x7fe9c8103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 -- 172.21.15.102:0/870175440 shutdown_connections 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.259+0000 7fe9cf868640 1 -- 172.21.15.102:0/870175440 wait complete. 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 Processor -- start 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 -- start start 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c810b6f0 0x7fe9c819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 0x7fe9c81a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8115e40 con 0x7fe9c8105db0 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8115cc0 con 0x7fe9c810b6f0 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cf868640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c8115fc0 con 0x7fe9c810c040 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51482/0 (socket says 172.21.15.102:51482) 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 -- 172.21.15.102:0/2424359358 learned_addr learned my addr 172.21.15.102:0/2424359358 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cce03640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c810b6f0 0x7fe9c819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 0x7fe9c81a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 -- 172.21.15.102:0/2424359358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 msgr2=0x7fe9c81a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 0x7fe9c81a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 -- 172.21.15.102:0/2424359358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c810b6f0 msgr2=0x7fe9c819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c810b6f0 0x7fe9c819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.260+0000 7fe9cd604640 1 -- 172.21.15.102:0/2424359358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c81a2680 con 0x7fe9c8105db0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 0x7fe9c81a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9cd604640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d950 tx=0x7fe9c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9be7fc640 1 -- 172.21.15.102:0/2424359358 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4017070 con 0x7fe9c8105db0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9be7fc640 1 -- 172.21.15.102:0/2424359358 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9c4009c30 con 0x7fe9c8105db0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c81a2970 con 0x7fe9c8105db0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9be7fc640 1 -- 172.21.15.102:0/2424359358 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400f6b0 con 0x7fe9c8105db0 2024-09-21T03:36:45.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.261+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c81a90d0 con 0x7fe9c8105db0 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 Processor -- start 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9be7fc640 1 -- 172.21.15.102:0/2424359358 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe9c40109c0 con 0x7fe9c8105db0 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 -- start start 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd371b0 0x557440107be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 0x557440108120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55744007dea0 con 0x55743fd60070 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55744006d2d0 con 0x55743fd371b0 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5574400710e0 con 0x55743fd3f390 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9cde05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.264+0000 7fe9cde05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51494/0 (socket says 172.21.15.102:51494) 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 -- 172.21.15.102:0/3574350789 learned_addr learned my addr 172.21.15.102:0/3574350789 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cd604640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd371b0 0x557440107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cce03640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 0x557440108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 -- 172.21.15.102:0/3574350789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 msgr2=0x557440108120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 0x557440108120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 -- 172.21.15.102:0/3574350789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd371b0 msgr2=0x557440107be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd371b0 0x557440107be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 -- 172.21.15.102:0/3574350789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743fdcb650 con 0x55743fd60070 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cce03640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 0x557440108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9be7fc640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 0x7fe9b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009830 tx=0x7fe9c0009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f3848b693b106a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9cd604640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 0x7fe9b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9be7fc640 1 -- 172.21.15.102:0/2424359358 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe9c40e7390 con 0x7fe9c8105db0 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9b37fe640 1 -- 172.21.15.102:0/3574350789 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0003970 con 0x55743fd60070 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9b37fe640 1 -- 172.21.15.102:0/3574350789 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9c0036040 con 0x55743fd60070 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.265+0000 7fe9b37fe640 1 -- 172.21.15.102:0/3574350789 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0004400 con 0x55743fd60070 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3574350789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 msgr2=0x5574401076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009830 tx=0x7fe9c0009860 comp rx=0 tx=0).stop 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9cd604640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 0x7fe9b40b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40e4b80 tx=0x7fe9c40e98a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3574350789 shutdown_connections 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd3f390 0x557440108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd371b0 0x557440107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3574350789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd60070 0x5574401076a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.266+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3574350789 >> 172.21.15.102:0/3574350789 conn(0x55743fd54460 msgr2=0x557440105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.267+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3574350789 shutdown_connections 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.267+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3574350789 wait complete. 2024-09-21T03:36:45.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.267+0000 7fe9d5ddc740 1 -- start start 2024-09-21T03:36:45.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.267+0000 7fe9d5ddc740 1 Processor -- start 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440112d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55743fece700 con 0x55743fd3f390 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557440008160 con 0x55743fd60070 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557440115e20 con 0x55743fd371b0 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 10 client.0 _ll_register_callbacks cb 0x5574400219e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51510/0 (socket says 172.21.15.102:51510) 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 -- 172.21.15.102:0/3158370943 learned_addr learned my addr 172.21.15.102:0/3158370943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:45.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440112d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 -- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 msgr2=0x557440112d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440112d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 -- 172.21.15.102:0/3158370943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 msgr2=0x55744011f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 -- 172.21.15.102:0/3158370943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557440035c90 con 0x55743fd3f390 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9cce03640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b920 tx=0x7fe9b8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c5e1f20dd48b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b801b470 con 0x55743fd3f390 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe9b801b610 con 0x55743fd3f390 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.268+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9c0036040 con 0x55743fd3f390 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9b801b810 con 0x55743fd3f390 2024-09-21T03:36:45.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 10 client.15990 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557440121ad0 con 0x55743fd3f390 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9c0036040 con 0x55743fd3f390 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe9b8012c90 con 0x55743fd3f390 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 10 client.15990 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 10 client.15990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 20 client.15990 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fd1e9f0 0x557440124fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 4 client.15990 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55744007fdf0 con 0x55743fd1e9f0 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.269+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fd1e9f0 0x557440124fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.270+0000 7fe9cde05640 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fd1e9f0 0x557440124fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4dd840e829e4dfe server_cookie=5e118e90ad08d001 in_seq=0 out_seq=0 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.270+0000 7fe9b0ff9640 10 client.15990 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/3158370943 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55744007fdf0 con 0x55743fd1e9f0 2024-09-21T03:36:45.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9b0ff9640 10 client.15990 handle_command_reply: tid=0 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 client.15990 shutdown 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 msgr2=0x5574401132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800b920 tx=0x7fe9b8004610 comp rx=0 tx=0).stop 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 shutdown_connections 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fd1e9f0 0x557440124fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x5574401132a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/3158370943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440112d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 >> 172.21.15.102:0/3158370943 conn(0x55743fd54460 msgr2=0x55744010a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9b0ff9640 0 client.15990 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 shutdown_connections 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/3158370943 wait complete. 2024-09-21T03:36:45.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.271+0000 7fe9d5ddc740 20 client.15990 trim_cache size 0 max 16384 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 Processor -- start 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 -- start start 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440109090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81b4490 con 0x55743fd3f390 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81b1ca0 con 0x55743fd60070 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.284+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81afaf0 con 0x55743fd371b0 2024-09-21T03:36:45.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51520/0 (socket says 172.21.15.102:51520) 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 -- 172.21.15.102:0/4095811318 learned_addr learned my addr 172.21.15.102:0/4095811318 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cde05640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cde05640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 -- 172.21.15.102:0/4095811318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 msgr2=0x557440109090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440109090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 -- 172.21.15.102:0/4095811318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 msgr2=0x55744011f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 -- 172.21.15.102:0/4095811318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557440109990 con 0x55743fd3f390 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cde05640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9cce03640 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8005c20 tx=0x7fe9b8005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fe57efa08a139 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.285+0000 7fe9b2ffd640 1 -- 172.21.15.102:0/4095811318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b8031070 con 0x55743fd3f390 2024-09-21T03:36:45.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9b2ffd640 1 -- 172.21.15.102:0/4095811318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9b8016070 con 0x55743fd3f390 2024-09-21T03:36:45.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9b2ffd640 1 -- 172.21.15.102:0/4095811318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b801bc10 con 0x55743fd3f390 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/4095811318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 msgr2=0x557440114990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8005c20 tx=0x7fe9b8005690 comp rx=0 tx=0).stop 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/4095811318 shutdown_connections 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd3f390 0x557440114990 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd60070 0x55744011f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/4095811318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd371b0 0x557440109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.286+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/4095811318 >> 172.21.15.102:0/4095811318 conn(0x55743fd54460 msgr2=0x557440114280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.287+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/4095811318 shutdown_connections 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.287+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/4095811318 wait complete. 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.287+0000 7fe9d5ddc740 1 -- start start 2024-09-21T03:36:45.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.287+0000 7fe9d5ddc740 1 Processor -- start 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd3f390 0x5574401175a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd60070 0x557440117ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81b0160 con 0x55743fd371b0 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81b15d0 con 0x55743fd3f390 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c81b0830 con 0x55743fd60070 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9d5ddc740 10 client.0 _ll_register_callbacks cb 0x7fe9b8004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51530/0 (socket says 172.21.15.102:51530) 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 -- 172.21.15.102:0/2787898591 learned_addr learned my addr 172.21.15.102:0/2787898591 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cce03640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd3f390 0x5574401175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd60070 0x557440117ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 -- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd60070 msgr2=0x557440117ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd60070 0x557440117ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 -- 172.21.15.102:0/2787898591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd3f390 msgr2=0x5574401175a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd3f390 0x5574401175a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 -- 172.21.15.102:0/2787898591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55744018e9a0 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9cde05640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009800 tx=0x7fe9b8004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20f387fc25298d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.288+0000 7fe9b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0031720 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9b8016070 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe9c00318c0 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fe9c0003970 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 10 client.15996 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55744018fc00 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe9b8016070 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fe9c0050070 con 0x55743fd371b0 2024-09-21T03:36:45.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 10 client.15996 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 10 client.15996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 20 client.15996 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fcf3da0 0x557440191f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 4 client.15996 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.289+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55744007b8a0 con 0x55743fcf3da0 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9cce03640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fcf3da0 0x557440191f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9b0ff9640 10 client.15996 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9cce03640 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fcf3da0 0x557440191f80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=675ef74e7a025a78 server_cookie=1a1658f8f9fd7f63 in_seq=0 out_seq=0 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9b0ff9640 1 -- 172.21.15.102:0/2787898591 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55744007b8a0 con 0x55743fcf3da0 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9b0ff9640 10 client.15996 handle_command_reply: tid=0 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.290+0000 7fe9d5ddc740 1 client.15996 shutdown 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 msgr2=0x557440117060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0009800 tx=0x7fe9b8004440 comp rx=0 tx=0).stop 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 shutdown_connections 2024-09-21T03:36:45.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55743fcf3da0 0x557440191f80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55743fd60070 0x557440117ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9b0ff9640 0 client.15996 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55743fd3f390 0x5574401175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 --2- 172.21.15.102:0/2787898591 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55743fd371b0 0x557440117060 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 >> 172.21.15.102:0/2787898591 conn(0x55743fd54460 msgr2=0x557440108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 shutdown_connections 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 1 -- 172.21.15.102:0/2787898591 wait complete. 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.291+0000 7fe9d5ddc740 20 client.15996 trim_cache size 0 max 16384 2024-09-21T03:36:45.298 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 msgr2=0x7fe9b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 0x7fe9b40b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe9c40e4b80 tx=0x7fe9c40e98a0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 msgr2=0x7fe9c819c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d950 tx=0x7fe9c400de10 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 shutdown_connections 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe9b40b6680 0x7fe9b40b8b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe9c810c040 0x7fe9c81a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe9c810b6f0 0x7fe9c819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 --2- 172.21.15.102:0/2424359358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe9c8105db0 0x7fe9c819c710 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 >> 172.21.15.102:0/2424359358 conn(0x7fe9c8101800 msgr2=0x7fe9c8108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:45.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 shutdown_connections 2024-09-21T03:36:45.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:45.292+0000 7fe9cf868640 1 -- 172.21.15.102:0/2424359358 wait complete. 2024-09-21T03:36:45.449 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:45 smithi102 ceph-mon[31392]: pgmap v419: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:36:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:45 smithi148 ceph-mon[34651]: pgmap v419: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:36:45.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:45 smithi121 ceph-mon[34316]: pgmap v419: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T03:36:46.018 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:36:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:46.669 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:46 smithi102 ceph-mon[31392]: pgmap v420: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T03:36:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:46 smithi148 ceph-mon[34651]: pgmap v420: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T03:36:46.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 -- 172.21.15.102:0/3086687044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770105ac0 msgr2=0x7f777010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 --2- 172.21.15.102:0/3086687044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770105ac0 0x7f777010f530 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7768009ca0 tx=0x7f776802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 -- 172.21.15.102:0/3086687044 shutdown_connections 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 --2- 172.21.15.102:0/3086687044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770105ac0 0x7f777010f530 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 --2- 172.21.15.102:0/3086687044 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105170 0x7f7770105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 --2- 172.21.15.102:0/3086687044 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770103160 0x7f7770103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 -- 172.21.15.102:0/3086687044 >> 172.21.15.102:0/3086687044 conn(0x7f7770077c60 msgr2=0x7f77700780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 -- 172.21.15.102:0/3086687044 shutdown_connections 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.758+0000 7f77773d6640 1 -- 172.21.15.102:0/3086687044 wait complete. 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 Processor -- start 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 -- start start 2024-09-21T03:36:46.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770105170 0x7f77701999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105ac0 0x7f777019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7770112b00 con 0x7f7770103160 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7770112980 con 0x7f7770105170 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f77773d6640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7770112c80 con 0x7f7770105ac0 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f7775172640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f7775172640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51554/0 (socket says 172.21.15.102:51554) 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.759+0000 7f7775172640 1 -- 172.21.15.102:0/3131984993 learned_addr learned my addr 172.21.15.102:0/3131984993 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775973640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105ac0 0x7f777019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7774971640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770105170 0x7f77701999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 -- 172.21.15.102:0/3131984993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105ac0 msgr2=0x7f777019ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105ac0 0x7f777019ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 -- 172.21.15.102:0/3131984993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770105170 msgr2=0x7f77701999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770105170 0x7f77701999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 -- 172.21.15.102:0/3131984993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777019f380 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f7775172640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f776400c890 tx=0x7f776400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f77627fc640 1 -- 172.21.15.102:0/3131984993 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764004220 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777019f670 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f77627fc640 1 -- 172.21.15.102:0/3131984993 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f77640043c0 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f77627fc640 1 -- 172.21.15.102:0/3131984993 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77640049e0 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.760+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77701a5dd0 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 Processor -- start 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 -- start start 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f77627fc640 1 -- 172.21.15.102:0/3131984993 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7764005140 con 0x7f7770103160 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd302e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd302ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2fa4ea0 con 0x55cfd2c87070 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2f942d0 con 0x55cfd2c66390 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f777d94a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2f980e0 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51564/0 (socket says 172.21.15.102:51564) 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.763+0000 7f7775973640 1 -- 172.21.15.102:0/444504247 learned_addr learned my addr 172.21.15.102:0/444504247 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775172640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd302e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7774971640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd302ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 -- 172.21.15.102:0/444504247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 msgr2=0x55cfd302e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd302e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 -- 172.21.15.102:0/444504247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 msgr2=0x55cfd302ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd302ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 -- 172.21.15.102:0/444504247 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd2cf2650 con 0x55cfd2c87070 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7774971640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd302ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:46.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775973640 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7768009930 tx=0x7f7768009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d16e40e1f7ed95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f77627fc640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 0x7f775c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f775b7fe640 1 -- 172.21.15.102:0/444504247 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7768031e40 con 0x55cfd2c87070 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f775b7fe640 1 -- 172.21.15.102:0/444504247 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7768036040 con 0x55cfd2c87070 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f775b7fe640 1 -- 172.21.15.102:0/444504247 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7768004330 con 0x55cfd2c87070 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f7775172640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 0x7f775c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.764+0000 7f77627fc640 1 -- 172.21.15.102:0/3131984993 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f77640e74e0 con 0x7f7770103160 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 -- 172.21.15.102:0/444504247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 msgr2=0x55cfd302e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f7775172640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 0x7f775c0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77640e4cd0 tx=0x7f77640e9040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7768009930 tx=0x7f7768009960 comp rx=0 tx=0).stop 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 -- 172.21.15.102:0/444504247 shutdown_connections 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd302ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd302e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 --2- 172.21.15.102:0/444504247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd302e2c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 -- 172.21.15.102:0/444504247 >> 172.21.15.102:0/444504247 conn(0x55cfd2c7b460 msgr2=0x55cfd302c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 -- 172.21.15.102:0/444504247 shutdown_connections 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.765+0000 7f777d94a740 1 -- 172.21.15.102:0/444504247 wait complete. 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 -- start start 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 Processor -- start 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd3039e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2df5700 con 0x55cfd2c87070 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2f2f160 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cfd303ec50 con 0x55cfd2c66390 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f777d94a740 10 client.0 _ll_register_callbacks cb 0x55cfd2f489e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51566/0 (socket says 172.21.15.102:51566) 2024-09-21T03:36:46.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.766+0000 7f7775973640 1 -- 172.21.15.102:0/558957760 learned_addr learned my addr 172.21.15.102:0/558957760 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7774971640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd3039e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 -- 172.21.15.102:0/558957760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 msgr2=0x55cfd3039e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd3039e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 -- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c5e1b0 msgr2=0x55cfd3039950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 -- 172.21.15.102:0/558957760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd2f5cc90 con 0x55cfd2c87070 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7774971640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd3039e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7775973640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f776802f470 tx=0x7f77680319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c2b42058771601 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7758ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7768004380 con 0x55cfd2c87070 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7768004520 con 0x55cfd2c87070 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7768036040 con 0x55cfd2c87070 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7768004720 con 0x55cfd2c87070 2024-09-21T03:36:46.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f777d94a740 10 client.16008 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.767+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cfd304a8a0 con 0x55cfd2c87070 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7768036040 con 0x55cfd2c87070 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7768050070 con 0x55cfd2c87070 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 10 client.16008 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 10 client.16008 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 20 client.16008 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c459f0 0x55cfd304dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 4 client.16008 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfd2fa6df0 con 0x55cfd2c459f0 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.768+0000 7f7774971640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c459f0 0x55cfd304dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.769+0000 7f7758ff9640 10 client.16008 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.769+0000 7f7774971640 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c459f0 0x55cfd304dc00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=940057ed751a5682 server_cookie=f8f04235e7589718 in_seq=0 out_seq=0 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.769+0000 7f7758ff9640 1 -- 172.21.15.102:0/558957760 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfd2fa6df0 con 0x55cfd2c459f0 2024-09-21T03:36:46.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.769+0000 7f7758ff9640 10 client.16008 handle_command_reply: tid=0 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.769+0000 7f777d94a740 1 client.16008 shutdown 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 msgr2=0x55cfd3047f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f776802f470 tx=0x7f77680319f0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 shutdown_connections 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c459f0 0x55cfd304dc00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3047f40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f7758ff9640 0 client.16008 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd3039e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 --2- 172.21.15.102:0/558957760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 >> 172.21.15.102:0/558957760 conn(0x55cfd2c7b460 msgr2=0x55cfd30314a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 shutdown_connections 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 1 -- 172.21.15.102:0/558957760 wait complete. 2024-09-21T03:36:46.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.770+0000 7f777d94a740 20 client.16008 trim_cache size 0 max 16384 2024-09-21T03:36:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 Processor -- start 2024-09-21T03:36:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 -- start start 2024-09-21T03:36:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd3047eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77701b00a0 con 0x55cfd2c87070 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77701ad8b0 con 0x55cfd2c66390 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f777d94a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77701ab700 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51576/0 (socket says 172.21.15.102:51576) 2024-09-21T03:36:46.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.783+0000 7f7775973640 1 -- 172.21.15.102:0/1727826962 learned_addr learned my addr 172.21.15.102:0/1727826962 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:46.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:46 smithi121 ceph-mon[34316]: pgmap v420: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-21T03:36:46.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7774971640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd3047eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 -- 172.21.15.102:0/1727826962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 msgr2=0x55cfd3039e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 -- 172.21.15.102:0/1727826962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 msgr2=0x55cfd3047eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd3047eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 -- 172.21.15.102:0/1727826962 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd3037e50 con 0x55cfd2c87070 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7774971640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd3047eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f7775973640 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f776802fa90 tx=0x7f7768004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b5e53484df6dce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f775affd640 1 -- 172.21.15.102:0/1727826962 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77680098b0 con 0x55cfd2c87070 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f775affd640 1 -- 172.21.15.102:0/1727826962 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7768036070 con 0x55cfd2c87070 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.784+0000 7f775affd640 1 -- 172.21.15.102:0/1727826962 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776802fe90 con 0x55cfd2c87070 2024-09-21T03:36:46.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- 172.21.15.102:0/1727826962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 msgr2=0x55cfd3036b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f776802fa90 tx=0x7f7768004040 comp rx=0 tx=0).stop 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- 172.21.15.102:0/1727826962 shutdown_connections 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c87070 0x55cfd3036b40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c66390 0x55cfd3047eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 --2- 172.21.15.102:0/1727826962 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c5e1b0 0x55cfd3039e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- 172.21.15.102:0/1727826962 >> 172.21.15.102:0/1727826962 conn(0x55cfd2c7b460 msgr2=0x55cfd3039700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- 172.21.15.102:0/1727826962 shutdown_connections 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- 172.21.15.102:0/1727826962 wait complete. 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 -- start start 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.785+0000 7f777d94a740 1 Processor -- start 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd304f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c87070 0x55cfd304f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77701abd70 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77701ad1e0 con 0x55cfd2c87070 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77701ac440 con 0x55cfd2c66390 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f777d94a740 10 client.0 _ll_register_callbacks cb 0x7f7768009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51580/0 (socket says 172.21.15.102:51580) 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 -- 172.21.15.102:0/881674067 learned_addr learned my addr 172.21.15.102:0/881674067 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7774971640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd304f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c87070 0x55cfd304f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 -- 172.21.15.102:0/881674067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 msgr2=0x55cfd304f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd304f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 -- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c87070 msgr2=0x55cfd304f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c87070 0x55cfd304f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 -- 172.21.15.102:0/881674067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd30b7380 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7775973640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f776802ade0 tx=0x7f7768000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80e0f1485cb371f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.786+0000 7f7758ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776806e060 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7768004380 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7768036070 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7768004580 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 10 client.16014 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55cfd30b84d0 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7768036070 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7768050040 con 0x55cfd2c5e1b0 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 10 client.16014 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 10 client.16014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 20 client.16014 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:46.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c1ada0 0x55cfd30bab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 4 client.16014 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfd2fa28a0 con 0x55cfd2c1ada0 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.787+0000 7f7774971640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c1ada0 0x55cfd30bab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f7758ff9640 10 client.16014 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f7774971640 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c1ada0 0x55cfd30bab80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7735ee7d8ea2eb4d server_cookie=a95dfec00e8a9e6b in_seq=0 out_seq=0 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f7758ff9640 1 -- 172.21.15.102:0/881674067 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfd2fa28a0 con 0x55cfd2c1ada0 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f7758ff9640 10 client.16014 handle_command_reply: tid=0 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 client.16014 shutdown 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 msgr2=0x55cfd304eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f776802ade0 tx=0x7f7768000f40 comp rx=0 tx=0).stop 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 shutdown_connections 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55cfd2c1ada0 0x55cfd30bab80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cfd2c87070 0x55cfd304f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cfd2c66390 0x55cfd304f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f7758ff9640 0 client.16014 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 --2- 172.21.15.102:0/881674067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cfd2c5e1b0 0x55cfd304eb90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 >> 172.21.15.102:0/881674067 conn(0x55cfd2c7b460 msgr2=0x55cfd302f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 shutdown_connections 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 1 -- 172.21.15.102:0/881674067 wait complete. 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.788+0000 7f777d94a740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T03:36:46.796 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 msgr2=0x7f775c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 0x7f775c0b8b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f77640e4cd0 tx=0x7f77640e9040 comp rx=0 tx=0).stop 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 msgr2=0x7f7770199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f776400c890 tx=0x7f776400cd50 comp rx=0 tx=0).stop 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 shutdown_connections 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f775c0b6680 0x7f775c0b8b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7770105ac0 0x7f777019ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7770105170 0x7f77701999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 --2- 172.21.15.102:0/3131984993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7770103160 0x7f7770199410 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 >> 172.21.15.102:0/3131984993 conn(0x7f7770077c60 msgr2=0x7f7770106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 shutdown_connections 2024-09-21T03:36:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:46.789+0000 7f77773d6640 1 -- 172.21.15.102:0/3131984993 wait complete. 2024-09-21T03:36:47.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:36:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 -- 172.21.15.102:0/86034619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80109e40 msgr2=0x7f7d80110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 --2- 172.21.15.102:0/86034619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80109e40 0x7f7d80110670 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7d78009ca0 tx=0x7f7d7802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 -- 172.21.15.102:0/86034619 shutdown_connections 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 --2- 172.21.15.102:0/86034619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80109e40 0x7f7d80110670 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 --2- 172.21.15.102:0/86034619 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d801094f0 0x7f7d80109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 --2- 172.21.15.102:0/86034619 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d80103bb0 0x7f7d80103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 -- 172.21.15.102:0/86034619 >> 172.21.15.102:0/86034619 conn(0x7f7d800ff600 msgr2=0x7f7d80101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 -- 172.21.15.102:0/86034619 shutdown_connections 2024-09-21T03:36:48.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.310+0000 7f7d87202640 1 -- 172.21.15.102:0/86034619 wait complete. 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.311+0000 7f7d87202640 1 Processor -- start 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 -- start start 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d801094f0 0x7f7d8019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d80109e40 0x7f7d8019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d80113c30 con 0x7f7d80103bb0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d80113ab0 con 0x7f7d801094f0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d87202640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d80113db0 con 0x7f7d80109e40 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51600/0 (socket says 172.21.15.102:51600) 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 -- 172.21.15.102:0/3765980419 learned_addr learned my addr 172.21.15.102:0/3765980419 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d80109e40 0x7f7d8019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d801094f0 0x7f7d8019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 -- 172.21.15.102:0/3765980419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d80109e40 msgr2=0x7f7d8019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d80109e40 0x7f7d8019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 -- 172.21.15.102:0/3765980419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d801094f0 msgr2=0x7f7d8019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d801094f0 0x7f7d8019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.312+0000 7f7d84f9e640 1 -- 172.21.15.102:0/3765980419 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d801a0510 con 0x7f7d80103bb0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d950 tx=0x7f7d7400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d7dffb640 1 -- 172.21.15.102:0/3765980419 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74017070 con 0x7f7d80103bb0 2024-09-21T03:36:48.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d801a0800 con 0x7f7d80103bb0 2024-09-21T03:36:48.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d7dffb640 1 -- 172.21.15.102:0/3765980419 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d7400de80 con 0x7f7d80103bb0 2024-09-21T03:36:48.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d7dffb640 1 -- 172.21.15.102:0/3765980419 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7400f620 con 0x7f7d80103bb0 2024-09-21T03:36:48.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.313+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d801a6f60 con 0x7f7d80103bb0 2024-09-21T03:36:48.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.315+0000 7f7d7dffb640 1 -- 172.21.15.102:0/3765980419 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7d74009c30 con 0x7f7d80103bb0 2024-09-21T03:36:48.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 Processor -- start 2024-09-21T03:36:48.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 -- start start 2024-09-21T03:36:48.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 0x55a4f56d32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a4f5649ea0 con 0x55a4f53031b0 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a4f56392d0 con 0x55a4f530b390 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8d776740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a4f563d0e0 con 0x55a4f532c070 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d84f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d84f9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51610/0 (socket says 172.21.15.102:51610) 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d84f9e640 1 -- 172.21.15.102:0/2288114072 learned_addr learned my addr 172.21.15.102:0/2288114072 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d8579f640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 0x55a4f56d32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.316+0000 7f7d7dffb640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 0x7f7d700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 0x7f7d700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d7dffb640 1 -- 172.21.15.102:0/3765980419 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7d740e7390 con 0x7f7d80103bb0 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 -- 172.21.15.102:0/2288114072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 msgr2=0x55a4f56d32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 0x55a4f56d32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 -- 172.21.15.102:0/2288114072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 msgr2=0x55a4f56d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 -- 172.21.15.102:0/2288114072 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f5397650 con 0x55a4f53031b0 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d8579f640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 0x55a4f56d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:48.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d740e49e0 tx=0x7f7d74010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4664cfbbf36a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d6affd640 1 -- 172.21.15.102:0/2288114072 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74020030 con 0x55a4f53031b0 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 0x7f7d700b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005e30 tx=0x7f7d7802a8e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d6affd640 1 -- 172.21.15.102:0/2288114072 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d740d0030 con 0x55a4f53031b0 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.317+0000 7f7d6affd640 1 -- 172.21.15.102:0/2288114072 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d740e4cf0 con 0x55a4f53031b0 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 -- 172.21.15.102:0/2288114072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 msgr2=0x55a4f56d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f7d740e49e0 tx=0x7f7d74010cd0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 -- 172.21.15.102:0/2288114072 shutdown_connections 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f53031b0 0x55a4f56d3800 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 --2- 172.21.15.102:0/2288114072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f532c070 0x55a4f56d32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 -- 172.21.15.102:0/2288114072 >> 172.21.15.102:0/2288114072 conn(0x55a4f5320460 msgr2=0x55a4f56d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 -- 172.21.15.102:0/2288114072 shutdown_connections 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.318+0000 7f7d8d776740 1 -- 172.21.15.102:0/2288114072 wait complete. 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 -- start start 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 Processor -- start 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56de900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a4f549a700 con 0x55a4f532c070 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a4f55d4160 con 0x55a4f530b390 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a4f56e19e0 con 0x55a4f53031b0 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8d776740 10 client.0 _ll_register_callbacks cb 0x55a4f55ed9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d84f9e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51624/0 (socket says 172.21.15.102:51624) 2024-09-21T03:36:48.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d8579f640 1 -- 172.21.15.102:0/651357996 learned_addr learned my addr 172.21.15.102:0/651357996 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.319+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 -- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 msgr2=0x55a4f56de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56de900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 -- 172.21.15.102:0/651357996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 msgr2=0x55a4f56dee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 -- 172.21.15.102:0/651357996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f5601c90 con 0x55a4f532c070 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8579f640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d78035000 tx=0x7f7d780095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a2da1b42b1a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780305e0 con 0x55a4f532c070 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7d78030780 con 0x55a4f532c070 2024-09-21T03:36:48.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d740d0030 con 0x55a4f532c070 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d78030980 con 0x55a4f532c070 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8d776740 10 client.16026 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.320+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f56ed680 con 0x55a4f532c070 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d740d0030 con 0x55a4f532c070 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d78048ca0 con 0x55a4f532c070 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 10 client.16026 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 20 client.16026 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52ea9f0 0x55a4f56f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 4 client.16026 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4f564bdf0 con 0x55a4f52ea9f0 2024-09-21T03:36:48.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.321+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52ea9f0 0x55a4f56f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d5ffff640 10 client.16026 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52ea9f0 0x55a4f56f0b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d4f8ccaae0af366 server_cookie=56cde0c6f18a2e29 in_seq=0 out_seq=0 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d5ffff640 1 -- 172.21.15.102:0/651357996 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4f564bdf0 con 0x55a4f52ea9f0 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d5ffff640 10 client.16026 handle_command_reply: tid=0 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d8d776740 1 client.16026 shutdown 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.322+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 msgr2=0x55a4f56df3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7d78035000 tx=0x7f7d780095c0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 shutdown_connections 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52ea9f0 0x55a4f56f0b70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56df3c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d5ffff640 0 client.16026 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 --2- 172.21.15.102:0/651357996 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 >> 172.21.15.102:0/651357996 conn(0x55a4f5320460 msgr2=0x55a4f56d6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 shutdown_connections 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 1 -- 172.21.15.102:0/651357996 wait complete. 2024-09-21T03:36:48.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.323+0000 7f7d8d776740 20 client.16026 trim_cache size 0 max 16384 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 Processor -- start 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 -- start start 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801b2400 con 0x55a4f532c070 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801afc10 con 0x55a4f530b390 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8d776740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801ada60 con 0x55a4f53031b0 2024-09-21T03:36:48.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51630/0 (socket says 172.21.15.102:51630) 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d8579f640 1 -- 172.21.15.102:0/1928997016 learned_addr learned my addr 172.21.15.102:0/1928997016 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.336+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 -- 172.21.15.102:0/1928997016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 msgr2=0x55a4f56e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 -- 172.21.15.102:0/1928997016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 msgr2=0x55a4f56dbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 -- 172.21.15.102:0/1928997016 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4f56d1f40 con 0x55a4f532c070 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d8579f640 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d78031040 tx=0x7f7d78009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e027acb918e53d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d6a7fc640 1 -- 172.21.15.102:0/1928997016 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d780307e0 con 0x55a4f532c070 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d6a7fc640 1 -- 172.21.15.102:0/1928997016 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d78036040 con 0x55a4f532c070 2024-09-21T03:36:48.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.337+0000 7f7d6a7fc640 1 -- 172.21.15.102:0/1928997016 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7803ad40 con 0x55a4f532c070 2024-09-21T03:36:48.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- 172.21.15.102:0/1928997016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 msgr2=0x55a4f56dc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7d78031040 tx=0x7f7d78009630 comp rx=0 tx=0).stop 2024-09-21T03:36:48.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- 172.21.15.102:0/1928997016 shutdown_connections 2024-09-21T03:36:48.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56dc030 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56dbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 --2- 172.21.15.102:0/1928997016 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- 172.21.15.102:0/1928997016 >> 172.21.15.102:0/1928997016 conn(0x55a4f5320460 msgr2=0x55a4f56dfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- 172.21.15.102:0/1928997016 shutdown_connections 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- 172.21.15.102:0/1928997016 wait complete. 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 -- start start 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.338+0000 7f7d8d776740 1 Processor -- start 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801ae0d0 con 0x55a4f532c070 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801af540 con 0x55a4f530b390 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7d801ae7a0 con 0x55a4f53031b0 2024-09-21T03:36:48.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8d776740 10 client.0 _ll_register_callbacks cb 0x7f7d78031840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51636/0 (socket says 172.21.15.102:51636) 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 -- 172.21.15.102:0/3218434629 learned_addr learned my addr 172.21.15.102:0/3218434629 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 -- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 msgr2=0x55a4f56e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 -- 172.21.15.102:0/3218434629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 msgr2=0x55a4f56e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 -- 172.21.15.102:0/3218434629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4f575a530 con 0x55a4f532c070 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d7ffff640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:48.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d8579f640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005d70 tx=0x7f7d78005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5760165fed3af7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.339+0000 7f7d5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d7803a790 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7d7803a930 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d78036040 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d7806a050 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 10 client.16032 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a4f575b660 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7d78036040 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7d78052bc0 con 0x55a4f532c070 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 10 client.16032 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 20 client.16032 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:48.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52bfda0 0x55a4f575dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 4 client.16032 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4f56478a0 con 0x55a4f52bfda0 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.340+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52bfda0 0x55a4f575dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d5ffff640 10 client.16032 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d84f9e640 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52bfda0 0x55a4f575dd70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=793b4298de374fd3 server_cookie=b8d08e81a5388258 in_seq=0 out_seq=0 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d5ffff640 1 -- 172.21.15.102:0/3218434629 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4f56478a0 con 0x55a4f52bfda0 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d5ffff640 10 client.16032 handle_command_reply: tid=0 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 client.16032 shutdown 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 msgr2=0x55a4f56e31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005d70 tx=0x7f7d78005da0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 shutdown_connections 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a4f52bfda0 0x55a4f575dd70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a4f532c070 0x55a4f56e31e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a4f530b390 0x55a4f56e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d5ffff640 0 client.16032 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 --2- 172.21.15.102:0/3218434629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a4f53031b0 0x55a4f56e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 >> 172.21.15.102:0/3218434629 conn(0x55a4f5320460 msgr2=0x55a4f56e9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 shutdown_connections 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.341+0000 7f7d8d776740 1 -- 172.21.15.102:0/3218434629 wait complete. 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d8d776740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T03:36:48.349 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 msgr2=0x7f7d700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 0x7f7d700b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d78005e30 tx=0x7f7d7802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 msgr2=0x7f7d8019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d950 tx=0x7f7d7400dd50 comp rx=0 tx=0).stop 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 shutdown_connections 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7d700b6680 0x7f7d700b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7d80109e40 0x7f7d8019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7d801094f0 0x7f7d8019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 --2- 172.21.15.102:0/3765980419 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7d80103bb0 0x7f7d8019a5a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 >> 172.21.15.102:0/3765980419 conn(0x7f7d800ff600 msgr2=0x7f7d80101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 shutdown_connections 2024-09-21T03:36:48.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:48.342+0000 7f7d87202640 1 -- 172.21.15.102:0/3765980419 wait complete. 2024-09-21T03:36:49.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:49 smithi102 ceph-mon[31392]: pgmap v421: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:49 smithi148 ceph-mon[34651]: pgmap v421: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:49 smithi121 ceph-mon[34316]: pgmap v421: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:50.089 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:36:50.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:36:50.357 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 -- 172.21.15.102:0/1625897750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4109df0 msgr2=0x7fdef4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/1625897750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4109df0 0x7fdef4110620 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdeec009ca0 tx=0x7fdeec02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 -- 172.21.15.102:0/1625897750 shutdown_connections 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/1625897750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4109df0 0x7fdef4110620 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/1625897750 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 0x7fdef41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/1625897750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4103b60 0x7fdef4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 -- 172.21.15.102:0/1625897750 >> 172.21.15.102:0/1625897750 conn(0x7fdef407b850 msgr2=0x7fdef407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 -- 172.21.15.102:0/1625897750 shutdown_connections 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.919+0000 7fdefa1a5640 1 -- 172.21.15.102:0/1625897750 wait complete. 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 Processor -- start 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 -- start start 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 0x7fdef419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4109df0 0x7fdef419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4113be0 con 0x7fdef4103b60 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4113a60 con 0x7fdef4109df0 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdefa1a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdef4113d60 con 0x7fdef41094a0 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.920+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51652/0 (socket says 172.21.15.102:51652) 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 -- 172.21.15.102:0/2975463871 learned_addr learned my addr 172.21.15.102:0/2975463871 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 0x7fdef419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef3fff640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4109df0 0x7fdef419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 -- 172.21.15.102:0/2975463871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 msgr2=0x7fdef419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 0x7fdef419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 -- 172.21.15.102:0/2975463871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4109df0 msgr2=0x7fdef419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4109df0 0x7fdef419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 -- 172.21.15.102:0/2975463871 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef41a04e0 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c890 tx=0x7fdee400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef0ff9640 1 -- 172.21.15.102:0/2975463871 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4004220 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef0ff9640 1 -- 172.21.15.102:0/2975463871 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdee40043c0 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef41a07d0 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdef0ff9640 1 -- 172.21.15.102:0/2975463871 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40049c0 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.921+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef41a6f30 con 0x7fdef4103b60 2024-09-21T03:36:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdef0ff9640 1 -- 172.21.15.102:0/2975463871 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fdee4005140 con 0x7fdef4103b60 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 Processor -- start 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 -- start start 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7bf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56182c735e60 con 0x56182c3ef490 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56182c725290 con 0x56182c3f7670 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdf00719740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56182c7290a0 con 0x56182c418350 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.924+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51662/0 (socket says 172.21.15.102:51662) 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 -- 172.21.15.102:0/2172872667 learned_addr learned my addr 172.21.15.102:0/2172872667 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef0ff9640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 0x7fdedc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef3fff640 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef3fff640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 0x7fdedc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 -- 172.21.15.102:0/2172872667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 msgr2=0x56182c7bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 -- 172.21.15.102:0/2172872667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 msgr2=0x56182c7bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef0ff9640 1 -- 172.21.15.102:0/2975463871 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdee40e7500 con 0x7fdef4103b60 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 -- 172.21.15.102:0/2172872667 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182c483930 con 0x56182c3ef490 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdee40e4be0 tx=0x7fdee4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea4602a98bc4c1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fded9ffb640 1 -- 172.21.15.102:0/2172872667 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee401d030 con 0x56182c3ef490 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fdef3fff640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 0x7fdedc0b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdeec031040 tx=0x7fdeec02a8e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fded9ffb640 1 -- 172.21.15.102:0/2172872667 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdee4009290 con 0x56182c3ef490 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.925+0000 7fded9ffb640 1 -- 172.21.15.102:0/2172872667 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40ace50 con 0x56182c3ef490 2024-09-21T03:36:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 -- 172.21.15.102:0/2172872667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 msgr2=0x56182c7bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fdee40e4be0 tx=0x7fdee4004570 comp rx=0 tx=0).stop 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 -- 172.21.15.102:0/2172872667 shutdown_connections 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7bf970 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 --2- 172.21.15.102:0/2172872667 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 -- 172.21.15.102:0/2172872667 >> 172.21.15.102:0/2172872667 conn(0x56182c40c740 msgr2=0x56182c7bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 -- 172.21.15.102:0/2172872667 shutdown_connections 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.926+0000 7fdf00719740 1 -- 172.21.15.102:0/2172872667 wait complete. 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 -- start start 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 Processor -- start 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7d6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56182c586890 con 0x56182c3ef490 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56182c6bfd40 con 0x56182c3f7670 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56182c7cdc10 con 0x56182c418350 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdf00719740 10 client.0 _ll_register_callbacks cb 0x56182c723c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51674/0 (socket says 172.21.15.102:51674) 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.927+0000 7fdef37fe640 1 -- 172.21.15.102:0/2273845092 learned_addr learned my addr 172.21.15.102:0/2273845092 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef3fff640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 -- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 msgr2=0x56182c7d6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7d6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 -- 172.21.15.102:0/2273845092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 msgr2=0x56182c7cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 -- 172.21.15.102:0/2273845092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182c7d74c0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdef37fe640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdee4005520 tx=0x7fdee40b6b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a70c9071b945d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fded2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee401d070 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdee40ac5a0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56182c737db0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdee40ad110 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdf00719740 10 client.16044 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56182c7d9df0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.928+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x56182c737db0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdee4058ad0 con 0x56182c3ef490 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 10 client.16044 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 20 client.16044 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3d6cd0 0x56182c7dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 4 client.16044 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56182c733860 con 0x56182c3d6cd0 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.929+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3d6cd0 0x56182c7dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.930+0000 7fded2ffd640 10 client.16044 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.930+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3d6cd0 0x56182c7dcf80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4afd3fe9c4ea4983 server_cookie=75fa763544e54d3a in_seq=0 out_seq=0 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.930+0000 7fded2ffd640 1 -- 172.21.15.102:0/2273845092 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56182c733860 con 0x56182c3d6cd0 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.930+0000 7fded2ffd640 10 client.16044 handle_command_reply: tid=0 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.930+0000 7fdf00719740 1 client.16044 shutdown 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 msgr2=0x56182c7cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fdee4005520 tx=0x7fdee40b6b00 comp rx=0 tx=0).stop 2024-09-21T03:36:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 shutdown_connections 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7d6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3d6cd0 0x56182c7dcf80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 --2- 172.21.15.102:0/2273845092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7cafe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fded2ffd640 0 client.16044 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 >> 172.21.15.102:0/2273845092 conn(0x56182c40c740 msgr2=0x56182c7c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 shutdown_connections 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 1 -- 172.21.15.102:0/2273845092 wait complete. 2024-09-21T03:36:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.931+0000 7fdf00719740 20 client.16044 trim_cache size 0 max 16384 2024-09-21T03:36:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 Processor -- start 2024-09-21T03:36:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 -- start start 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c3ef490 0x56182c7ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 0x56182c7bd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41b2360 con 0x56182c3f7670 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41afb70 con 0x56182c418350 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdf00719740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41ad9c0 con 0x56182c3ef490 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51678/0 (socket says 172.21.15.102:51678) 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 -- 172.21.15.102:0/204953705 learned_addr learned my addr 172.21.15.102:0/204953705 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef37fe640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c3ef490 0x56182c7ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef3fff640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 0x56182c7bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 -- 172.21.15.102:0/204953705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c3ef490 msgr2=0x56182c7ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c3ef490 0x56182c7ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 -- 172.21.15.102:0/204953705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 msgr2=0x56182c7bd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 0x56182c7bd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef2ffd640 1 -- 172.21.15.102:0/204953705 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56182c7d72b0 con 0x56182c3f7670 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.949+0000 7fdef3fff640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 0x56182c7bd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.950+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x56182c6bfda0 tx=0x7fdee8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5038e5004da2cc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.950+0000 7fded97fa640 1 -- 172.21.15.102:0/204953705 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8016ac0 con 0x56182c3f7670 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.950+0000 7fded97fa640 1 -- 172.21.15.102:0/204953705 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdee8016c60 con 0x56182c3f7670 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.950+0000 7fded97fa640 1 -- 172.21.15.102:0/204953705 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee8014610 con 0x56182c3f7670 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- 172.21.15.102:0/204953705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 msgr2=0x56182c7bcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x56182c6bfda0 tx=0x7fdee8008040 comp rx=0 tx=0).stop 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- 172.21.15.102:0/204953705 shutdown_connections 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3f7670 0x56182c7bcd10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c418350 0x56182c7bd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 --2- 172.21.15.102:0/204953705 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c3ef490 0x56182c7ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- 172.21.15.102:0/204953705 >> 172.21.15.102:0/204953705 conn(0x56182c40c740 msgr2=0x56182c7c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- 172.21.15.102:0/204953705 shutdown_connections 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- 172.21.15.102:0/204953705 wait complete. 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.951+0000 7fdf00719740 1 -- start start 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 Processor -- start 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7debd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7df110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41ae030 con 0x56182c3ef490 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41af4a0 con 0x56182c3f7670 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fdef41ae700 con 0x56182c418350 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdf00719740 10 client.0 _ll_register_callbacks cb 0x7fdee800b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51682/0 (socket says 172.21.15.102:51682) 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 -- 172.21.15.102:0/1124345533 learned_addr learned my addr 172.21.15.102:0/1124345533 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef3fff640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7df110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 -- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 msgr2=0x56182c7df110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7df110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 -- 172.21.15.102:0/1124345533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 msgr2=0x56182c7debd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7debd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 -- 172.21.15.102:0/1124345533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56182c7df750 con 0x56182c3ef490 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fdef37fe640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdee4058f50 tx=0x7fdee40ac7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0c5a3e4bc179a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.952+0000 7fded2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee401d040 con 0x56182c3ef490 2024-09-21T03:36:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fdee40a8c90 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdee8016c60 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fdee40acc90 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 10 client.16050 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56182c7df750 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fdee8016c60 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fdee40ac010 con 0x56182c3ef490 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 10 client.16050 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 20 client.16050 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3ac080 0x56182c84a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 4 client.16050 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.953+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56182c730c90 con 0x56182c3ac080 2024-09-21T03:36:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.954+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3ac080 0x56182c84a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:50.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.954+0000 7fdef2ffd640 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3ac080 0x56182c84a7f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5516c8d2c15b63df server_cookie=e3e8f9811908de34 in_seq=0 out_seq=0 2024-09-21T03:36:50.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.954+0000 7fded2ffd640 10 client.16050 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fded2ffd640 1 -- 172.21.15.102:0/1124345533 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56182c730c90 con 0x56182c3ac080 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fded2ffd640 10 client.16050 handle_command_reply: tid=0 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 client.16050 shutdown 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 msgr2=0x56182c7e0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdee4058f50 tx=0x7fdee40ac7d0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 shutdown_connections 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56182c418350 0x56182c7df110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56182c3f7670 0x56182c7debd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56182c3ac080 0x56182c84a7f0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 --2- 172.21.15.102:0/1124345533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56182c3ef490 0x56182c7e0650 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 >> 172.21.15.102:0/1124345533 conn(0x56182c40c740 msgr2=0x56182c7bcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fded2ffd640 0 client.16050 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 shutdown_connections 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 1 -- 172.21.15.102:0/1124345533 wait complete. 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.956+0000 7fdf00719740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "aca3977a-a9cc-416a-9ba5-cf480c41b244", 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:36:50.962 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:36:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 msgr2=0x7fdedc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 0x7fdedc0b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdeec031040 tx=0x7fdeec02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 msgr2=0x7fdef419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdee400c890 tx=0x7fdee400cd50 comp rx=0 tx=0).stop 2024-09-21T03:36:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 shutdown_connections 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fdedc0b6680 0x7fdedc0b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdef4109df0 0x7fdef419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fdef41094a0 0x7fdef419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 --2- 172.21.15.102:0/2975463871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef4103b60 0x7fdef419a570 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 >> 172.21.15.102:0/2975463871 conn(0x7fdef407b850 msgr2=0x7fdef4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 shutdown_connections 2024-09-21T03:36:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:50.957+0000 7fdefa1a5640 1 -- 172.21.15.102:0/2975463871 wait complete. 2024-09-21T03:36:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:51 smithi102 ceph-mon[31392]: pgmap v422: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:36:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:51 smithi148 ceph-mon[34651]: pgmap v422: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:36:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:51 smithi121 ceph-mon[34316]: pgmap v422: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T03:36:51.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:36:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:52.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:52 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:36:52.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:52 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:52 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:36:52.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:52 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:52 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:36:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 -- 172.21.15.102:0/3129704568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0658108cf0 msgr2=0x7f065810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 --2- 172.21.15.102:0/3129704568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0658108cf0 0x7f065810f520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0650009ca0 tx=0x7f065002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 -- 172.21.15.102:0/3129704568 shutdown_connections 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 --2- 172.21.15.102:0/3129704568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0658108cf0 0x7f065810f520 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 --2- 172.21.15.102:0/3129704568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06581083a0 0x7f06581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 --2- 172.21.15.102:0/3129704568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 0x7f0658102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 -- 172.21.15.102:0/3129704568 >> 172.21.15.102:0/3129704568 conn(0x7f0658079730 msgr2=0x7f0658079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 -- 172.21.15.102:0/3129704568 shutdown_connections 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.659+0000 7f065f069640 1 -- 172.21.15.102:0/3129704568 wait complete. 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 Processor -- start 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 -- start start 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 0x7f065819b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 0x7f065819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0658112aa0 con 0x7f06581083a0 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0658112920 con 0x7f0658108cf0 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065f069640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f0658112c20 con 0x7f0658102a60 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51694/0 (socket says 172.21.15.102:51694) 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f064ffff640 1 -- 172.21.15.102:0/3031481153 learned_addr learned my addr 172.21.15.102:0/3031481153 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.660+0000 7f065ce05640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 0x7f065819b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f065d606640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 0x7f065819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 -- 172.21.15.102:0/3031481153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 msgr2=0x7f065819b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 0x7f065819b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 -- 172.21.15.102:0/3031481153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 msgr2=0x7f065819be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 0x7f065819be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 -- 172.21.15.102:0/3031481153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06581a6620 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f065d606640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 0x7f065819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064ffff640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f064800c970 tx=0x7f064800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064dffb640 1 -- 172.21.15.102:0/3031481153 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648007bb0 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064dffb640 1 -- 172.21.15.102:0/3031481153 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0648007d50 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06581a6910 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f064dffb640 1 -- 172.21.15.102:0/3031481153 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064800f450 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.661+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a6e50 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f064dffb640 1 -- 172.21.15.102:0/3031481153 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f06480046c0 con 0x7f06581083a0 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 Processor -- start 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 -- start start 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758a8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 0x5577758a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55777581ee50 con 0x557775501070 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55777580e280 con 0x5577754e0390 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f06655dd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557775812090 con 0x5577754d81b0 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f065d606640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f065d606640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51696/0 (socket says 172.21.15.102:51696) 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f065d606640 1 -- 172.21.15.102:0/2222269769 learned_addr learned my addr 172.21.15.102:0/2222269769 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f064ffff640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 0x5577758a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f064dffb640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 0x7f06400b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.664+0000 7f065ce05640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758a8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 -- 172.21.15.102:0/2222269769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 msgr2=0x5577758a8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758a8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 -- 172.21.15.102:0/2222269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 msgr2=0x5577758a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 0x5577758a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 -- 172.21.15.102:0/2222269769 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55777556c650 con 0x557775501070 2024-09-21T03:36:52.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f064ffff640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 0x5577758a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 0x7f06400b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f064dffb640 1 -- 172.21.15.102:0/3031481153 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f06480e73b0 con 0x7f06581083a0 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f065d606640 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0650006010 tx=0x7f0650009a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6f540dc431d6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f063effd640 1 -- 172.21.15.102:0/2222269769 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650031920 con 0x557775501070 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f063effd640 1 -- 172.21.15.102:0/2222269769 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0650036070 con 0x557775501070 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.665+0000 7f063effd640 1 -- 172.21.15.102:0/2222269769 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065002fb60 con 0x557775501070 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- 172.21.15.102:0/2222269769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 msgr2=0x5577758a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f065d606640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 0x7f06400b8bc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f065004b000 tx=0x7f0650048000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0650006010 tx=0x7f0650009a00 comp rx=0 tx=0).stop 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- 172.21.15.102:0/2222269769 shutdown_connections 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754e0390 0x5577758a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758a8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 --2- 172.21.15.102:0/2222269769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557775501070 0x5577758a8650 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- 172.21.15.102:0/2222269769 >> 172.21.15.102:0/2222269769 conn(0x5577754f5460 msgr2=0x5577758a6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- 172.21.15.102:0/2222269769 shutdown_connections 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- 172.21.15.102:0/2222269769 wait complete. 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.666+0000 7f06655dd740 1 -- start start 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 Processor -- start 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557775501070 0x5577758bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55777566f700 con 0x5577754e0390 2024-09-21T03:36:52.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5577757a9110 con 0x557775501070 2024-09-21T03:36:52.732 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:36:52.732 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:36:52.732 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:36:52.732 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:36:52.734 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:36:52.736 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5577758b6cb0 con 0x5577754d81b0 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f06655dd740 10 client.0 _ll_register_callbacks cb 0x5577757c2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51700/0 (socket says 172.21.15.102:51700) 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 -- 172.21.15.102:0/2643665227 learned_addr learned my addr 172.21.15.102:0/2643665227 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f065ce05640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f065d606640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557775501070 0x5577758bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 -- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 msgr2=0x5577758b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 -- 172.21.15.102:0/2643665227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557775501070 msgr2=0x5577758bffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.667+0000 7f064ffff640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557775501070 0x5577758bffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f064ffff640 1 -- 172.21.15.102:0/2643665227 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577757d6c40 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f064ffff640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f06480aa400 tx=0x7f06480eaf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5940b663ea0b470e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064801d040 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f06480a8ce0 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0650036070 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f06480acf60 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 10 client.16062 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5577758c2a50 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0650036070 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f06480abe60 con 0x5577754e0390 2024-09-21T03:36:52.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 10 client.16062 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.668+0000 7f06655dd740 20 client.16062 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5577754bf9f0 0x5577758c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f06655dd740 4 client.16062 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557775820da0 con 0x5577754bf9f0 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f065ce05640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5577754bf9f0 0x5577758c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f0637fff640 10 client.16062 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.669+0000 7f065ce05640 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5577754bf9f0 0x5577758c5ec0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0f9b2764e85be4 server_cookie=bcd8a645f3b8b122 in_seq=0 out_seq=0 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f0637fff640 1 -- 172.21.15.102:0/2643665227 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557775820da0 con 0x5577754bf9f0 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f0637fff640 10 client.16062 handle_command_reply: tid=0 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 client.16062 shutdown 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 msgr2=0x5577758b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f06480aa400 tx=0x7f06480eaf40 comp rx=0 tx=0).stop 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 shutdown_connections 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5577754bf9f0 0x5577758c5ec0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x5577758b42c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557775501070 0x5577758bffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f0637fff640 0 client.16062 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 --2- 172.21.15.102:0/2643665227 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754d81b0 0x5577758b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 >> 172.21.15.102:0/2643665227 conn(0x5577754f5460 msgr2=0x5577758ab830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 shutdown_connections 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.670+0000 7f06655dd740 1 -- 172.21.15.102:0/2643665227 wait complete. 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.671+0000 7f06655dd740 20 client.16062 trim_cache size 0 max 16384 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.687+0000 7f06655dd740 1 Processor -- start 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.687+0000 7f06655dd740 1 -- start start 2024-09-21T03:36:52.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754bf9f0 0x5577758a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 0x5577758ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06581b22f0 con 0x5577754d81b0 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06581afb00 con 0x5577754bf9f0 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f06655dd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f06581ad950 con 0x5577754e0390 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51706/0 (socket says 172.21.15.102:51706) 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 -- 172.21.15.102:0/2912685090 learned_addr learned my addr 172.21.15.102:0/2912685090 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f065ce05640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754bf9f0 0x5577758a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f065d606640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 0x5577758ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 -- 172.21.15.102:0/2912685090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 msgr2=0x5577758ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 0x5577758ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 -- 172.21.15.102:0/2912685090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754bf9f0 msgr2=0x5577758a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754bf9f0 0x5577758a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 -- 172.21.15.102:0/2912685090 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577758b5040 con 0x5577754d81b0 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f065d606640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 0x5577758ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.688+0000 7f064ffff640 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f06480a9760 tx=0x7f06480a9900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d04b2bf8ad98cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f063e7fc640 1 -- 172.21.15.102:0/2912685090 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064801d070 con 0x5577754d81b0 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f063e7fc640 1 -- 172.21.15.102:0/2912685090 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06480ac060 con 0x5577754d81b0 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f063e7fc640 1 -- 172.21.15.102:0/2912685090 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06480ac900 con 0x5577754d81b0 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 -- 172.21.15.102:0/2912685090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 msgr2=0x5577758bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f06480a9760 tx=0x7f06480a9900 comp rx=0 tx=0).stop 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 -- 172.21.15.102:0/2912685090 shutdown_connections 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754d81b0 0x5577758bfed0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754e0390 0x5577758ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 --2- 172.21.15.102:0/2912685090 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754bf9f0 0x5577758a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 -- 172.21.15.102:0/2912685090 >> 172.21.15.102:0/2912685090 conn(0x5577754f5460 msgr2=0x5577758a5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 -- 172.21.15.102:0/2912685090 shutdown_connections 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.689+0000 7f06655dd740 1 -- 172.21.15.102:0/2912685090 wait complete. 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 -- start start 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 Processor -- start 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754bf9f0 0x5577758b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754d81b0 0x5577758b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f06581adfc0 con 0x5577754e0390 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06581af430 con 0x5577754d81b0 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f06581ae690 con 0x5577754bf9f0 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f06655dd740 10 client.0 _ll_register_callbacks cb 0x7f064800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f065d606640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.690+0000 7f065d606640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51712/0 (socket says 172.21.15.102:51712) 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 -- 172.21.15.102:0/2944004045 learned_addr learned my addr 172.21.15.102:0/2944004045 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065ce05640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754bf9f0 0x5577758b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f064ffff640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754d81b0 0x5577758b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 -- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754bf9f0 msgr2=0x5577758b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754bf9f0 0x5577758b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 -- 172.21.15.102:0/2944004045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754d81b0 msgr2=0x5577758b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754d81b0 0x5577758b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 -- 172.21.15.102:0/2944004045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55777592fe30 con 0x5577754e0390 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f065d606640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f065002fcf0 tx=0x7f06500095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298efff33050032b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f0637fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650060060 con 0x5577754e0390 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f065002fe40 con 0x5577754e0390 2024-09-21T03:36:52.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06480ac060 con 0x5577754e0390 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f065002f310 con 0x5577754e0390 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f06655dd740 10 client.16068 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.691+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557775931030 con 0x5577754e0390 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f06480ac060 con 0x5577754e0390 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f065005a030 con 0x5577754e0390 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 10 client.16068 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 20 client.16068 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557775501070 0x557775933510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:52.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 4 client.16068 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55777581c850 con 0x557775501070 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.692+0000 7f065ce05640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557775501070 0x557775933510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f0637fff640 10 client.16068 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f065ce05640 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557775501070 0x557775933510 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=898cd69f548bbf98 server_cookie=50f62630dcb376cf in_seq=0 out_seq=0 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f0637fff640 1 -- 172.21.15.102:0/2944004045 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x55777581c850 con 0x557775501070 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f0637fff640 10 client.16068 handle_command_reply: tid=0 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 client.16068 shutdown 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 msgr2=0x55777592f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f065002fcf0 tx=0x7f06500095c0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 shutdown_connections 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557775501070 0x557775933510 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5577754e0390 0x55777592f870 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5577754d81b0 0x5577758b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 --2- 172.21.15.102:0/2944004045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5577754bf9f0 0x5577758b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f0637fff640 0 client.16068 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 >> 172.21.15.102:0/2944004045 conn(0x5577754f5460 msgr2=0x5577758ab750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 shutdown_connections 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 1 -- 172.21.15.102:0/2944004045 wait complete. 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.693+0000 7f06655dd740 20 client.16068 trim_cache size 0 max 16384 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 msgr2=0x7f06400b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 0x7f06400b8bc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f065004b000 tx=0x7f0650048000 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 msgr2=0x7f065819b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f064800c970 tx=0x7f064800ce30 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 shutdown_connections 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f06400b66b0 0x7f06400b8bc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f06581083a0 0x7f065819b8d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0658108cf0 0x7f065819be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 --2- 172.21.15.102:0/3031481153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f0658102a60 0x7f065819b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 >> 172.21.15.102:0/3031481153 conn(0x7f0658079730 msgr2=0x7f0658104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 shutdown_connections 2024-09-21T03:36:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:52.694+0000 7f065f069640 1 -- 172.21.15.102:0/3031481153 wait complete. 2024-09-21T03:36:52.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:52 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:36:52.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:52 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:52 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:36:52.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:52 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.748 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:52 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:36:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:52 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:36:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:52 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:52 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:36:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:52 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:36:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:52 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:36:53.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:53 smithi102 ceph-mon[31392]: pgmap v423: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:53.578 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:36:53.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:36:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:53 smithi148 ceph-mon[34651]: pgmap v423: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:53 smithi121 ceph-mon[34316]: pgmap v423: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:53.826 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 -- 172.21.15.102:0/57718079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d01094a0 msgr2=0x7f23d01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 --2- 172.21.15.102:0/57718079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d01094a0 0x7f23d01098b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f23c4009900 tx=0x7f23c402a410 comp rx=0 tx=0).stop 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 -- 172.21.15.102:0/57718079 shutdown_connections 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 --2- 172.21.15.102:0/57718079 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d01094a0 0x7f23d01098b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 --2- 172.21.15.102:0/57718079 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d0109df0 0x7f23d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 --2- 172.21.15.102:0/57718079 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.323+0000 7f23d48fe640 1 -- 172.21.15.102:0/57718079 >> 172.21.15.102:0/57718079 conn(0x7f23d007b850 msgr2=0x7f23d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.324+0000 7f23d48fe640 1 -- 172.21.15.102:0/57718079 shutdown_connections 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.324+0000 7f23d48fe640 1 -- 172.21.15.102:0/57718079 wait complete. 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.324+0000 7f23d48fe640 1 Processor -- start 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.324+0000 7f23d48fe640 1 -- start start 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d01094a0 0x7f23d019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f23d0113bd0 con 0x7f23d0109df0 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f23d0113a50 con 0x7f23d0103b60 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f23d0113d50 con 0x7f23d01094a0 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43244/0 (socket says 172.21.15.102:43244) 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 -- 172.21.15.102:0/2230861881 learned_addr learned my addr 172.21.15.102:0/2230861881 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ce59c640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23cdd9b640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d01094a0 0x7f23d019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 -- 172.21.15.102:0/2230861881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d01094a0 msgr2=0x7f23d019aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d01094a0 0x7f23d019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 -- 172.21.15.102:0/2230861881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 msgr2=0x7f23d019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 -- 172.21.15.102:0/2230861881 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d01a04b0 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ce59c640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23ced9d640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f23c800cce0 tx=0x7f23c800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c800f450 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.325+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d01a07a0 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.326+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f23c800fac0 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.326+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8018be0 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.326+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d01a6fc0 con 0x7f23d0109df0 2024-09-21T03:36:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.326+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d0104de0 con 0x7f23d0109df0 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.329+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f23c800fc70 con 0x7f23d0109df0 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.330+0000 7f23bf7fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 0x7f23b80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.330+0000 7f23ce59c640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 0x7f23b80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.330+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f23c80e7f10 con 0x7f23d0109df0 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.330+0000 7f23ce59c640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 0x7f23b80b8bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23c00058c0 tx=0x7f23c0005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.333+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23c8014030 con 0x7f23d0109df0 2024-09-21T03:36:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.546+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23d0103f70 con 0x7f23d0109df0 2024-09-21T03:36:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.547+0000 7f23bf7fe640 1 -- 172.21.15.102:0/2230861881 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11942 (secure 0 0 0) 0x7f23d0103f70 con 0x7f23d0109df0 2024-09-21T03:36:54.549 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:36:54.549 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":29,"btime":"2024-09-21T03:35:52:382620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:35:51.414877+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:36:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 29 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 msgr2=0x7f23b80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 0x7f23b80b8bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f23c00058c0 tx=0x7f23c0005d30 comp rx=0 tx=0).stop 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 msgr2=0x7f23d019fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f23c800cce0 tx=0x7f23c800a620 comp rx=0 tx=0).stop 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 shutdown_connections 2024-09-21T03:36:54.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f23b80b66b0 0x7f23b80b8bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23d0109df0 0x7f23d019fe40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f23d01094a0 0x7f23d019aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 --2- 172.21.15.102:0/2230861881 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f23d0103b60 0x7f23d019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 >> 172.21.15.102:0/2230861881 conn(0x7f23d007b850 msgr2=0x7f23d01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 shutdown_connections 2024-09-21T03:36:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:54.549+0000 7f23d48fe640 1 -- 172.21.15.102:0/2230861881 wait complete. 2024-09-21T03:36:55.492 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:36:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:55 smithi102 ceph-mon[31392]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:55 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2230861881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:55.741 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:55 smithi148 ceph-mon[34651]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:55.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:55 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2230861881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:55 smithi121 ceph-mon[34316]: pgmap v424: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:36:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:55 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2230861881' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:36:56.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 -- 172.21.15.102:0/1519456043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 msgr2=0x7fa254102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 --2- 172.21.15.102:0/1519456043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa254102e70 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fa244009900 tx=0x7fa24402a410 comp rx=0 tx=0).stop 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 -- 172.21.15.102:0/1519456043 shutdown_connections 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 --2- 172.21.15.102:0/1519456043 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 0x7fa25410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 --2- 172.21.15.102:0/1519456043 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 0x7fa2541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 --2- 172.21.15.102:0/1519456043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa254102e70 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 -- 172.21.15.102:0/1519456043 >> 172.21.15.102:0/1519456043 conn(0x7fa254079730 msgr2=0x7fa254079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 -- 172.21.15.102:0/1519456043 shutdown_connections 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.254+0000 7fa25a889640 1 -- 172.21.15.102:0/1519456043 wait complete. 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.255+0000 7fa25a889640 1 Processor -- start 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.255+0000 7fa25a889640 1 -- start start 2024-09-21T03:36:56.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 0x7fa2541104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 0x7fa254110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113ba0 con 0x7fa254102a60 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113a20 con 0x7fa2541083a0 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa25a889640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa254113d20 con 0x7fa254108cf0 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43262/0 (socket says 172.21.15.102:43262) 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 -- 172.21.15.102:0/3003413358 learned_addr learned my addr 172.21.15.102:0/3003413358 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa2537fe640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 0x7fa2541104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa258e26640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 0x7fa254110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 -- 172.21.15.102:0/3003413358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 msgr2=0x7fa254110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 0x7fa254110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 -- 172.21.15.102:0/3003413358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 msgr2=0x7fa2541104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 0x7fa2541104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 -- 172.21.15.102:0/3003413358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2541a87d0 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa253fff640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa244005ab0 tx=0x7fa2440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.256+0000 7fa2517fa640 1 -- 172.21.15.102:0/3003413358 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24403f030 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.257+0000 7fa2517fa640 1 -- 172.21.15.102:0/3003413358 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa244003cd0 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.257+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2541a8a60 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.257+0000 7fa2517fa640 1 -- 172.21.15.102:0/3003413358 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244035070 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.257+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2541a8f40 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.259+0000 7fa2517fa640 1 -- 172.21.15.102:0/3003413358 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa244042030 con 0x7fa254102a60 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.259+0000 7fa260dfd740 1 Processor -- start 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.259+0000 7fa260dfd740 1 -- start start 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878bdfbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878bdfc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55878bd71ea0 con 0x55878ba54070 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55878bd612d0 con 0x55878ba2b1b0 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa260dfd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55878bd650e0 con 0x55878ba33390 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43268/0 (socket says 172.21.15.102:43268) 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 -- 172.21.15.102:0/2160646409 learned_addr learned my addr 172.21.15.102:0/2160646409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa2517fa640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa2537fe640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878bdfc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa253fff640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878bdfbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 -- 172.21.15.102:0/2160646409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 msgr2=0x55878bdfc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878bdfc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 -- 172.21.15.102:0/2160646409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 msgr2=0x55878bdfbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878bdfbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 -- 172.21.15.102:0/2160646409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878babf650 con 0x55878ba54070 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa253fff640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878bdfbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa2517fa640 1 -- 172.21.15.102:0/3003413358 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa244107c60 con 0x7fa254102a60 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.260+0000 7fa258e26640 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0103f0 tx=0x7fa24c0108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262e10fb9c0245a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa23a7fc640 1 -- 172.21.15.102:0/2160646409 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01c900 con 0x55878ba54070 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa23a7fc640 1 -- 172.21.15.102:0/2160646409 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa24c0113e0 con 0x55878ba54070 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa23a7fc640 1 -- 172.21.15.102:0/2160646409 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24c01b610 con 0x55878ba54070 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa258e26640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 0x7fa23c0b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa24c020000 tx=0x7fa24c01d000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa260dfd740 1 -- 172.21.15.102:0/2160646409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 msgr2=0x55878bdfb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.261+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0103f0 tx=0x7fa24c0108b0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 -- 172.21.15.102:0/2160646409 shutdown_connections 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878bdfc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878bdfbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2160646409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878bdfb6a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 -- 172.21.15.102:0/2160646409 >> 172.21.15.102:0/2160646409 conn(0x55878ba48460 msgr2=0x55878bdf9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 -- 172.21.15.102:0/2160646409 shutdown_connections 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 -- 172.21.15.102:0/2160646409 wait complete. 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 -- start start 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.262+0000 7fa260dfd740 1 Processor -- start 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba2b1b0 0x55878be06db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba54070 0x55878be131a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55878bbc2700 con 0x55878ba33390 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55878bcfc160 con 0x55878ba54070 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55878be09e80 con 0x55878ba2b1b0 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa260dfd740 10 client.0 _ll_register_callbacks cb 0x55878bd159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43274/0 (socket says 172.21.15.102:43274) 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 -- 172.21.15.102:0/1573567120 learned_addr learned my addr 172.21.15.102:0/1573567120 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa258e26640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba54070 0x55878be131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa253fff640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba2b1b0 0x55878be06db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 -- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba2b1b0 msgr2=0x55878be06db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba2b1b0 0x55878be06db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 -- 172.21.15.102:0/1573567120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba54070 msgr2=0x55878be131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba54070 0x55878be131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 -- 172.21.15.102:0/1573567120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878bd29c90 con 0x55878ba33390 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2537fe640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b9f0 tx=0x7fa24800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c62dab54a7f7e54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2337fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.263+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24801b640 con 0x55878ba33390 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa24801b7e0 con 0x55878ba33390 2024-09-21T03:36:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa24c0113e0 con 0x55878ba33390 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa24801b9e0 con 0x55878ba33390 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 10 client.16086 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55878be15b90 con 0x55878ba33390 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa24c0113e0 con 0x55878ba33390 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa248019020 con 0x55878ba33390 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 10 client.16086 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 10 client.16086 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 20 client.16086 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878ba129f0 0x55878be190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 4 client.16086 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55878bd73df0 con 0x55878ba129f0 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.264+0000 7fa253fff640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878ba129f0 0x55878be190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.265+0000 7fa253fff640 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878ba129f0 0x55878be190f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41828fc0bf512b2 server_cookie=9ec9bf612342a51b in_seq=0 out_seq=0 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.265+0000 7fa2337fe640 10 client.16086 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa2337fe640 1 -- 172.21.15.102:0/1573567120 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55878bd73df0 con 0x55878ba129f0 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa2337fe640 10 client.16086 handle_command_reply: tid=0 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 client.16086 shutdown 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 msgr2=0x55878be072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fa24800b9f0 tx=0x7fa24800beb0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 shutdown_connections 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878ba129f0 0x55878be190f0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba33390 0x55878be072f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba54070 0x55878be131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa2337fe640 0 client.16086 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 --2- 172.21.15.102:0/1573567120 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba2b1b0 0x55878be06db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 >> 172.21.15.102:0/1573567120 conn(0x55878ba48460 msgr2=0x55878bdfe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 shutdown_connections 2024-09-21T03:36:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 1 -- 172.21.15.102:0/1573567120 wait complete. 2024-09-21T03:36:56.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.266+0000 7fa260dfd740 20 client.16086 trim_cache size 0 max 16384 2024-09-21T03:36:56.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 Processor -- start 2024-09-21T03:36:56.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 -- start start 2024-09-21T03:36:56.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba33390 0x55878be03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba54070 0x55878be044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b4470 con 0x55878ba2b1b0 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b1c80 con 0x55878ba33390 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa260dfd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541afad0 con 0x55878ba54070 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.279+0000 7fa253fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43276/0 (socket says 172.21.15.102:43276) 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 -- 172.21.15.102:0/2415137436 learned_addr learned my addr 172.21.15.102:0/2415137436 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa2537fe640 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba33390 0x55878be03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 -- 172.21.15.102:0/2415137436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba54070 msgr2=0x55878be044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba54070 0x55878be044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 -- 172.21.15.102:0/2415137436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba33390 msgr2=0x55878be03fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba33390 0x55878be03fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 -- 172.21.15.102:0/2415137436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55878bdfe500 con 0x55878ba2b1b0 2024-09-21T03:36:56.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa253fff640 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa2440cda30 tx=0x7fa2440cdc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a978b5bbc1eb986 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa239ffb640 1 -- 172.21.15.102:0/2415137436 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244049040 con 0x55878ba2b1b0 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa239ffb640 1 -- 172.21.15.102:0/2415137436 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2440cd5b0 con 0x55878ba2b1b0 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.280+0000 7fa239ffb640 1 -- 172.21.15.102:0/2415137436 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2440d74c0 con 0x55878ba2b1b0 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- 172.21.15.102:0/2415137436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 msgr2=0x55878bdfeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa2440cda30 tx=0x7fa2440cdc90 comp rx=0 tx=0).stop 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- 172.21.15.102:0/2415137436 shutdown_connections 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba54070 0x55878be044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba33390 0x55878be03fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 --2- 172.21.15.102:0/2415137436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba2b1b0 0x55878bdfeeb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- 172.21.15.102:0/2415137436 >> 172.21.15.102:0/2415137436 conn(0x55878ba48460 msgr2=0x55878bdfe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- 172.21.15.102:0/2415137436 shutdown_connections 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- 172.21.15.102:0/2415137436 wait complete. 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.281+0000 7fa260dfd740 1 -- start start 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 Processor -- start 2024-09-21T03:36:56.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878be0b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878be0bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b0140 con 0x55878ba54070 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b15b0 con 0x55878ba2b1b0 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2541b0810 con 0x55878ba33390 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa260dfd740 10 client.0 _ll_register_callbacks cb 0x7fa248004140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa258e26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa258e26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43280/0 (socket says 172.21.15.102:43280) 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa258e26640 1 -- 172.21.15.102:0/348768311 learned_addr learned my addr 172.21.15.102:0/348768311 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa253fff640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878be0b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.282+0000 7fa2537fe640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878be0bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 -- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 msgr2=0x55878be0bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878be0bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 -- 172.21.15.102:0/348768311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 msgr2=0x55878be82af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 -- 172.21.15.102:0/348768311 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55878be83080 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa258e26640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa253fff640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878be0b850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa244006010 tx=0x7fa2440d26e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0f3848dc366d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa2337fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244049070 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa24403bc30 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2440cd5b0 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2440c9210 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa260dfd740 10 client.25520 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55878be842e0 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.283+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2440cd5b0 con 0x55878ba2b1b0 2024-09-21T03:36:56.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa2440cdd00 con 0x55878ba2b1b0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 10 client.25520 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 10 client.25520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 20 client.25520 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878b9e7da0 0x55878be86830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 4 client.25520 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55878bd6f8a0 con 0x55878b9e7da0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa2537fe640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878b9e7da0 0x55878be86830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa2337fe640 10 client.25520 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.284+0000 7fa2537fe640 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878b9e7da0 0x55878be86830 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ada2b090f163fc36 server_cookie=4ec9430343793f47 in_seq=0 out_seq=0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa2337fe640 1 -- 172.21.15.102:0/348768311 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55878bd6f8a0 con 0x55878b9e7da0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa2337fe640 10 client.25520 handle_command_reply: tid=0 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 client.25520 shutdown 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 msgr2=0x55878be0b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878be0b850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa244006010 tx=0x7fa2440d26e0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 shutdown_connections 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55878b9e7da0 0x55878be86830 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878ba54070 0x55878be82af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878ba33390 0x55878be0bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa2337fe640 0 client.25520 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 --2- 172.21.15.102:0/348768311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878ba2b1b0 0x55878be0b850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 >> 172.21.15.102:0/348768311 conn(0x55878ba48460 msgr2=0x55878bdfc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 shutdown_connections 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 1 -- 172.21.15.102:0/348768311 wait complete. 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa260dfd740 20 client.25520 trim_cache size 0 max 16384 2024-09-21T03:36:56.293 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:56.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 msgr2=0x7fa23c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 0x7fa23c0b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa24c020000 tx=0x7fa24c01d000 comp rx=0 tx=0).stop 2024-09-21T03:36:56.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 msgr2=0x7fa25410ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.285+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa244005ab0 tx=0x7fa2440042f0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 shutdown_connections 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa254108cf0 0x7fa254110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2541083a0 0x7fa2541104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 --2- 172.21.15.102:0/3003413358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa254102a60 0x7fa25410ffb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 >> 172.21.15.102:0/3003413358 conn(0x7fa254079730 msgr2=0x7fa2541013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 shutdown_connections 2024-09-21T03:36:56.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:56.286+0000 7fa25a889640 1 -- 172.21.15.102:0/3003413358 wait complete. 2024-09-21T03:36:57.100 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:36:57.343 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:57.641 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:57 smithi102 ceph-mon[31392]: pgmap v425: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T03:36:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:57 smithi148 ceph-mon[34651]: pgmap v425: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T03:36:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:57 smithi121 ceph-mon[34316]: pgmap v425: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-21T03:36:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 -- 172.21.15.102:0/4226211277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1190103b60 msgr2=0x7f1190103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 --2- 172.21.15.102:0/4226211277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1190103b60 0x7f1190103f70 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f118c009900 tx=0x7f118c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 -- 172.21.15.102:0/4226211277 shutdown_connections 2024-09-21T03:36:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 --2- 172.21.15.102:0/4226211277 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190109df0 0x7f1190110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 --2- 172.21.15.102:0/4226211277 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f11901094a0 0x7f11901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 --2- 172.21.15.102:0/4226211277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1190103b60 0x7f1190103f70 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.837+0000 7f119803c640 1 -- 172.21.15.102:0/4226211277 >> 172.21.15.102:0/4226211277 conn(0x7f119007b850 msgr2=0x7f119007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.838+0000 7f119803c640 1 -- 172.21.15.102:0/4226211277 shutdown_connections 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.838+0000 7f119803c640 1 -- 172.21.15.102:0/4226211277 wait complete. 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.838+0000 7f119803c640 1 Processor -- start 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 -- start start 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190103b60 0x7f119019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1190109df0 0x7f119019ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1190113c50 con 0x7f11901094a0 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1190113ad0 con 0x7f1190109df0 2024-09-21T03:36:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f119803c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1190113dd0 con 0x7f1190103b60 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43296/0 (socket says 172.21.15.102:43296) 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 -- 172.21.15.102:0/2765503645 learned_addr learned my addr 172.21.15.102:0/2765503645 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11965d9640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1190109df0 0x7f119019ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f1195dd8640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190103b60 0x7f119019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 -- 172.21.15.102:0/2765503645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190103b60 msgr2=0x7f119019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190103b60 0x7f119019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 -- 172.21.15.102:0/2765503645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1190109df0 msgr2=0x7f119019ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1190109df0 0x7f119019ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.839+0000 7f11955d7640 1 -- 172.21.15.102:0/2765503645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11901a0570 con 0x7f11901094a0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f11955d7640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f118000c8c0 tx=0x7f118000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f1186ffd640 1 -- 172.21.15.102:0/2765503645 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180007bb0 con 0x7f11901094a0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11901a0860 con 0x7f11901094a0 2024-09-21T03:36:57.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f1186ffd640 1 -- 172.21.15.102:0/2765503645 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1180007d50 con 0x7f11901094a0 2024-09-21T03:36:57.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f1186ffd640 1 -- 172.21.15.102:0/2765503645 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800188c0 con 0x7f11901094a0 2024-09-21T03:36:57.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.840+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11901a7080 con 0x7f11901094a0 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.842+0000 7f119e5b0740 1 Processor -- start 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.842+0000 7f119e5b0740 1 -- start start 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364afd070 0x558364ea46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364ea5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558364e1aea0 con 0x558364ad41b0 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558364e0a2d0 con 0x558364adc390 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f119e5b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558364e0e0e0 con 0x558364afd070 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43310/0 (socket says 172.21.15.102:43310) 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 -- 172.21.15.102:0/2031908027 learned_addr learned my addr 172.21.15.102:0/2031908027 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f11965d9640 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364afd070 0x558364ea46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1186ffd640 1 -- 172.21.15.102:0/2765503645 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f118000f450 con 0x7f11901094a0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 -- 172.21.15.102:0/2031908027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364afd070 msgr2=0x558364ea46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364afd070 0x558364ea46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 -- 172.21.15.102:0/2031908027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 msgr2=0x558364ea5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364ea5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 -- 172.21.15.102:0/2031908027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558364b68650 con 0x558364ad41b0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.843+0000 7f1195dd8640 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f118c009900 tx=0x7f118c031c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaa8d0fad7ec86b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f117bfff640 1 -- 172.21.15.102:0/2031908027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c03f070 con 0x558364ad41b0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f117bfff640 1 -- 172.21.15.102:0/2031908027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f118c031710 con 0x558364ad41b0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f117bfff640 1 -- 172.21.15.102:0/2031908027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118c035070 con 0x558364ad41b0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f1186ffd640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 0x7f117c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f11965d9640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 0x7f117c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.844+0000 7f1186ffd640 1 -- 172.21.15.102:0/2765503645 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f11800e7810 con 0x7f11901094a0 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- 172.21.15.102:0/2031908027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 msgr2=0x558364ea4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f11965d9640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 0x7f117c0b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f118800a400 tx=0x7f118800d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f118c009900 tx=0x7f118c031c70 comp rx=0 tx=0).stop 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- 172.21.15.102:0/2031908027 shutdown_connections 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ea4be0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364ea5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 --2- 172.21.15.102:0/2031908027 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364afd070 0x558364ea46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- 172.21.15.102:0/2031908027 >> 172.21.15.102:0/2031908027 conn(0x558364af1460 msgr2=0x558364ea2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- 172.21.15.102:0/2031908027 shutdown_connections 2024-09-21T03:36:57.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- 172.21.15.102:0/2031908027 wait complete. 2024-09-21T03:36:57.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 -- start start 2024-09-21T03:36:57.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.845+0000 7f119e5b0740 1 Processor -- start 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558364c6b700 con 0x558364afd070 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558364da5160 con 0x558364adc390 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558364eb7180 con 0x558364ad41b0 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f119e5b0740 10 client.0 _ll_register_callbacks cb 0x558364dbe9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43314/0 (socket says 172.21.15.102:43314) 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 -- 172.21.15.102:0/491543527 learned_addr learned my addr 172.21.15.102:0/491543527 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f1195dd8640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11955d7640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 -- 172.21.15.102:0/491543527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 msgr2=0x558364eb4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 -- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 msgr2=0x558364eb46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11965d9640 1 -- 172.21.15.102:0/491543527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558364dd2c90 con 0x558364afd070 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.846+0000 7f11955d7640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11965d9640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1188018ed0 tx=0x7f1188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10869e892a0a4134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11797fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188028060 con 0x558364afd070 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f11880177d0 con 0x558364afd070 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f118c031710 con 0x558364afd070 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1188016e40 con 0x558364afd070 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f119e5b0740 10 client.16104 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:57.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558364ec2f80 con 0x558364afd070 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.847+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f118c031710 con 0x558364afd070 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f1188023c30 con 0x558364afd070 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 10 client.16104 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 10 client.16104 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 20 client.16104 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364abb9f0 0x558364ec64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 4 client.16104 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558364e1cdf0 con 0x558364abb9f0 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f1195dd8640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364abb9f0 0x558364ec64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f11797fa640 10 client.16104 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.848+0000 7f1195dd8640 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364abb9f0 0x558364ec64d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=572f3ab65eb3bc48 server_cookie=15ee2c4eb78593fc in_seq=0 out_seq=0 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f11797fa640 1 -- 172.21.15.102:0/491543527 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558364e1cdf0 con 0x558364abb9f0 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f11797fa640 10 client.16104 handle_command_reply: tid=0 2024-09-21T03:36:57.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 client.16104 shutdown 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 msgr2=0x558364ec04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1188018ed0 tx=0x7f1188004a40 comp rx=0 tx=0).stop 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 shutdown_connections 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364abb9f0 0x558364ec64d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364afd070 0x558364ec04e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f11797fa640 0 client.16104 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 --2- 172.21.15.102:0/491543527 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.849+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 >> 172.21.15.102:0/491543527 conn(0x558364af1460 msgr2=0x558364ea0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.850+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 shutdown_connections 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.850+0000 7f119e5b0740 1 -- 172.21.15.102:0/491543527 wait complete. 2024-09-21T03:36:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.850+0000 7f119e5b0740 20 client.16104 trim_cache size 0 max 16384 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 Processor -- start 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 -- start start 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 0x558364eb3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11901b0040 con 0x558364adc390 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11901ad850 con 0x558364abb9f0 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f119e5b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f11901ab6a0 con 0x558364ad41b0 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43320/0 (socket says 172.21.15.102:43320) 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 -- 172.21.15.102:0/577348462 learned_addr learned my addr 172.21.15.102:0/577348462 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11955d7640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f1195dd8640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 0x558364eb3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 -- 172.21.15.102:0/577348462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 msgr2=0x558364eb4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 -- 172.21.15.102:0/577348462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 msgr2=0x558364eb3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 0x558364eb3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f11965d9640 1 -- 172.21.15.102:0/577348462 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558364eaede0 con 0x558364adc390 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.863+0000 7f1195dd8640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 0x558364eb3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f11965d9640 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f118802b410 tx=0x7f1188018b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110447a81be801ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f117b7fe640 1 -- 172.21.15.102:0/577348462 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1188007000 con 0x558364adc390 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f117b7fe640 1 -- 172.21.15.102:0/577348462 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f118801f040 con 0x558364adc390 2024-09-21T03:36:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f117b7fe640 1 -- 172.21.15.102:0/577348462 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f118802bc50 con 0x558364adc390 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f119e5b0740 1 -- 172.21.15.102:0/577348462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 msgr2=0x558364ea1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.864+0000 7f119e5b0740 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f118802b410 tx=0x7f1188018b60 comp rx=0 tx=0).stop 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 -- 172.21.15.102:0/577348462 shutdown_connections 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364adc390 0x558364ea1eb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364ad41b0 0x558364eb4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 --2- 172.21.15.102:0/577348462 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364abb9f0 0x558364eb3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 -- 172.21.15.102:0/577348462 >> 172.21.15.102:0/577348462 conn(0x558364af1460 msgr2=0x558364eb29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 -- 172.21.15.102:0/577348462 shutdown_connections 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 -- 172.21.15.102:0/577348462 wait complete. 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 -- start start 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.865+0000 7f119e5b0740 1 Processor -- start 2024-09-21T03:36:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 0x558364ebc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f11901abd10 con 0x558364ad41b0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f11901ad180 con 0x558364adc390 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f11901ac3e0 con 0x558364abb9f0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f119e5b0740 10 client.0 _ll_register_callbacks cb 0x7f1188009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43330/0 (socket says 172.21.15.102:43330) 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 -- 172.21.15.102:0/4016417821 learned_addr learned my addr 172.21.15.102:0/4016417821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f1195dd8640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 0x558364ebc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11965d9640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 -- 172.21.15.102:0/4016417821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 msgr2=0x558364ebc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 0x558364ebc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 -- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 msgr2=0x558364eb74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 -- 172.21.15.102:0/4016417821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558364eb7c50 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f1195dd8640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 0x558364ebc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11955d7640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f11800e5000 tx=0x7f11800ace80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99829a53b4bc014a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11797fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11800b2130 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.866+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f11800ac8b0 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f118801f040 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f11800b7070 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 10 client.16110 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558364f318a0 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f118801f040 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f11800ac320 con 0x558364ad41b0 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 10 client.16110 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 10 client.16110 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 20 client.16110 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364afd070 0x558364f34070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 4 client.16110 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558364e188a0 con 0x558364afd070 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.867+0000 7f1195dd8640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364afd070 0x558364f34070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f1195dd8640 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364afd070 0x558364f34070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e94f2b8074291619 server_cookie=aa0f92baa098950a in_seq=0 out_seq=0 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f11797fa640 10 client.16110 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f11797fa640 1 -- 172.21.15.102:0/4016417821 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558364e188a0 con 0x558364afd070 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f11797fa640 10 client.16110 handle_command_reply: tid=0 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 client.16110 shutdown 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 msgr2=0x558364ebcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f11800e5000 tx=0x7f11800ace80 comp rx=0 tx=0).stop 2024-09-21T03:36:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 shutdown_connections 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558364afd070 0x558364f34070 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558364ad41b0 0x558364ebcd70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558364adc390 0x558364eb74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f11797fa640 0 client.16110 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 --2- 172.21.15.102:0/4016417821 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558364abb9f0 0x558364ebc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 >> 172.21.15.102:0/4016417821 conn(0x558364af1460 msgr2=0x558364eb3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 shutdown_connections 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 1 -- 172.21.15.102:0/4016417821 wait complete. 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.868+0000 7f119e5b0740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T03:36:57.875 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 msgr2=0x7f117c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 0x7f117c0b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f118800a400 tx=0x7f118800d040 comp rx=0 tx=0).stop 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 msgr2=0x7f119019ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f118000c8c0 tx=0x7f118000cd80 comp rx=0 tx=0).stop 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 shutdown_connections 2024-09-21T03:36:57.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f117c0b66b0 0x7f117c0b8bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f11901094a0 0x7f119019ac60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1190109df0 0x7f119019ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 --2- 172.21.15.102:0/2765503645 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1190103b60 0x7f119019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 >> 172.21.15.102:0/2765503645 conn(0x7f119007b850 msgr2=0x7f11901075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 shutdown_connections 2024-09-21T03:36:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:57.869+0000 7f119803c640 1 -- 172.21.15.102:0/2765503645 wait complete. 2024-09-21T03:36:58.684 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:36:58.927 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:36:59.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2365899388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 msgr2=0x7fc8d01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2365899388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d01087b0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009900 tx=0x7fc8c402a410 comp rx=0 tx=0).stop 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2365899388 shutdown_connections 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2365899388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d01087b0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2365899388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8d0108cf0 0x7fc8d010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2365899388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 0x7fc8d0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2365899388 >> 172.21.15.102:0/2365899388 conn(0x7fc8d0079730 msgr2=0x7fc8d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2365899388 shutdown_connections 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2365899388 wait complete. 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.416+0000 7fc8d5b96640 1 Processor -- start 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 -- start start 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 0x7fc8d019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8d0108cf0 0x7fc8d019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112a80 con 0x7fc8d01083a0 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112900 con 0x7fc8d0108cf0 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8d5b96640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d0112c00 con 0x7fc8d0102a60 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43346/0 (socket says 172.21.15.102:43346) 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.417+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2279628366 learned_addr learned my addr 172.21.15.102:0/2279628366 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 0x7fc8d019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2279628366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 msgr2=0x7fc8d019a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 0x7fc8d019a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2279628366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8d0108cf0 msgr2=0x7fc8d019fde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8d0108cf0 0x7fc8d019fde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2279628366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d01a0510 con 0x7fc8d01083a0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005940 tx=0x7fc8c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ccff9640 1 -- 172.21.15.102:0/2279628366 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c403f030 con 0x7fc8d01083a0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d01a07a0 con 0x7fc8d01083a0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ccff9640 1 -- 172.21.15.102:0/2279628366 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8c4031910 con 0x7fc8d01083a0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8ccff9640 1 -- 172.21.15.102:0/2279628366 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4035070 con 0x7fc8d01083a0 2024-09-21T03:36:59.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.418+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d01a6f60 con 0x7fc8d01083a0 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.421+0000 7fc8dc10a740 1 Processor -- start 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.421+0000 7fc8dc10a740 1 -- start start 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb91820be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb91821120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fb91796ea0 con 0x55fb91479070 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb917862d0 con 0x55fb91458390 2024-09-21T03:36:59.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb9178a0e0 con 0x55fb914501b0 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8ccff9640 1 -- 172.21.15.102:0/2279628366 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc8c4042030 con 0x7fc8d01083a0 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43352/0 (socket says 172.21.15.102:43352) 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 -- 172.21.15.102:0/3126933898 learned_addr learned my addr 172.21.15.102:0/3126933898 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb91820be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb91821120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 -- 172.21.15.102:0/3126933898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 msgr2=0x55fb91820be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb91820be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 -- 172.21.15.102:0/3126933898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 msgr2=0x55fb91821120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb91821120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8cffff640 1 -- 172.21.15.102:0/3126933898 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb914e4650 con 0x55fb91479070 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.422+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb91821120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:36:59.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8cffff640 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009c80 tx=0x7fc8c800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e409e4c0faee9ed6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8b5ffb640 1 -- 172.21.15.102:0/3126933898 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8016070 con 0x55fb91479070 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8b5ffb640 1 -- 172.21.15.102:0/3126933898 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8c8005020 con 0x55fb91479070 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8b5ffb640 1 -- 172.21.15.102:0/3126933898 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80116d0 con 0x55fb91479070 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8ccff9640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 0x7fc8b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 0x7fc8b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.423+0000 7fc8ccff9640 1 -- 172.21.15.102:0/2279628366 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc8c4107c60 con 0x7fc8d01083a0 2024-09-21T03:36:59.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- 172.21.15.102:0/3126933898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 msgr2=0x55fb918206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 0x7fc8b80b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55fb9181f320 tx=0x7fc8c000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8009c80 tx=0x7fc8c800e6c0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- 172.21.15.102:0/3126933898 shutdown_connections 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb91821120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb91820be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/3126933898 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91479070 0x55fb918206a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- 172.21.15.102:0/3126933898 >> 172.21.15.102:0/3126933898 conn(0x55fb9146d460 msgr2=0x55fb9181e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- 172.21.15.102:0/3126933898 shutdown_connections 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- 172.21.15.102:0/3126933898 wait complete. 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.424+0000 7fc8dc10a740 1 -- start start 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 Processor -- start 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9182bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fb915e7700 con 0x55fb91458390 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb91721160 con 0x55fb91479070 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fb9182ee80 con 0x55fb914501b0 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8dc10a740 10 client.0 _ll_register_callbacks cb 0x55fb9173a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43362/0 (socket says 172.21.15.102:43362) 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2607142221 learned_addr learned my addr 172.21.15.102:0/2607142221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9182bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8cffff640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 msgr2=0x55fb9182bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9182bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2607142221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 msgr2=0x55fb918381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.425+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2607142221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb9174ec90 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40314b0 tx=0x7fc8c4105850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b1bd53c5431c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4049070 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc8c4003800 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c8005020 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8c40cd3f0 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 10 client.16122 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb9183aaf0 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8c8005020 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc8c40d7030 con 0x55fb91458390 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 10 client.16122 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:59.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 20 client.16122 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb914379f0 0x55fb9183dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 4 client.16122 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.426+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb91798df0 con 0x55fb914379f0 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.427+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb914379f0 0x55fb9183dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.427+0000 7fc8aeffd640 10 client.16122 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.427+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb914379f0 0x55fb9183dfe0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa761c62d6cf421 server_cookie=adf26f1ad6f1ae6c in_seq=0 out_seq=0 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2607142221 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb91798df0 con 0x55fb914379f0 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8aeffd640 10 client.16122 handle_command_reply: tid=0 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 client.16122 shutdown 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 msgr2=0x55fb9182c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40314b0 tx=0x7fc8c4105850 comp rx=0 tx=0).stop 2024-09-21T03:36:59.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 shutdown_connections 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb914379f0 0x55fb9183dfe0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb9182c2c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8aeffd640 0 client.16122 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2607142221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9182bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 >> 172.21.15.102:0/2607142221 conn(0x55fb9146d460 msgr2=0x55fb91823880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 shutdown_connections 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2607142221 wait complete. 2024-09-21T03:36:59.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.428+0000 7fc8dc10a740 20 client.16122 trim_cache size 0 max 16384 2024-09-21T03:36:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 Processor -- start 2024-09-21T03:36:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 -- start start 2024-09-21T03:36:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9181e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01b22b0 con 0x55fb91458390 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01afac0 con 0x55fb91479070 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.441+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01ad910 con 0x55fb914501b0 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43368/0 (socket says 172.21.15.102:43368) 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2901092151 learned_addr learned my addr 172.21.15.102:0/2901092151 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9181e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8cffff640 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2901092151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 msgr2=0x55fb9181e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9181e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2901092151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 msgr2=0x55fb918344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 -- 172.21.15.102:0/2901092151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb9182ed60 con 0x55fb91458390 2024-09-21T03:36:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40cda30 tx=0x7fc8c40f51a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e1a9be791b58dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8b57fa640 1 -- 172.21.15.102:0/2901092151 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c410a030 con 0x55fb91458390 2024-09-21T03:36:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8b57fa640 1 -- 172.21.15.102:0/2901092151 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8c40cd5b0 con 0x55fb91458390 2024-09-21T03:36:59.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.442+0000 7fc8b57fa640 1 -- 172.21.15.102:0/2901092151 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4049070 con 0x55fb91458390 2024-09-21T03:36:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2901092151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 msgr2=0x55fb918380a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc8c40cda30 tx=0x7fc8c40f51a0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2901092151 shutdown_connections 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb91458390 0x55fb918380a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91479070 0x55fb918344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2901092151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb914501b0 0x55fb9181e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2901092151 >> 172.21.15.102:0/2901092151 conn(0x55fb9146d460 msgr2=0x55fb9181deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2901092151 shutdown_connections 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2901092151 wait complete. 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.443+0000 7fc8dc10a740 1 -- start start 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 Processor -- start 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb918a6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb91479070 0x55fb918a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01adf80 con 0x55fb914501b0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01af3f0 con 0x55fb91458390 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d01ae650 con 0x55fb91479070 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8dc10a740 10 client.0 _ll_register_callbacks cb 0x7fc8c4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43374/0 (socket says 172.21.15.102:43374) 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 -- 172.21.15.102:0/2854354213 learned_addr learned my addr 172.21.15.102:0/2854354213 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb918a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cffff640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb91479070 0x55fb918a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 -- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb91479070 msgr2=0x55fb918a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb91479070 0x55fb918a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.444+0000 7fc8cf7fe640 1 -- 172.21.15.102:0/2854354213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 msgr2=0x55fb918a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb918a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8cf7fe640 1 -- 172.21.15.102:0/2854354213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb918a5080 con 0x55fb914501b0 2024-09-21T03:36:59.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8cf7fe640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0004650 tx=0x7fc8c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8374b2d0b768c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0035060 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fc8c001ea70 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc8c40cd5b0 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc8c001ec70 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8dc10a740 10 client.16128 fetch_fsmap learned FSMap version 29 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb918ad5e0 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.445+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc8c40cd5b0 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fc8c001d450 con 0x55fb914501b0 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 10 client.16128 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 20 client.16128 populate_metadata read hostname 'smithi102' 2024-09-21T03:36:59.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb9140cda0 0x55fb918afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 4 client.16128 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb917948a0 con 0x55fb9140cda0 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb9140cda0 0x55fb918afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8aeffd640 10 client.16128 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8ceffd640 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb9140cda0 0x55fb918afde0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c257463ed9647f server_cookie=67c1741b7c57551f in_seq=0 out_seq=0 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8aeffd640 1 -- 172.21.15.102:0/2854354213 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb917948a0 con 0x55fb9140cda0 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.446+0000 7fc8aeffd640 10 client.16128 handle_command_reply: tid=0 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 client.16128 shutdown 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 msgr2=0x55fb918a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0004650 tx=0x7fc8c00046c0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 shutdown_connections 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fb91479070 0x55fb918a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb91458390 0x55fb918a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fb9140cda0 0x55fb918afde0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 --2- 172.21.15.102:0/2854354213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fb914501b0 0x55fb918a5cd0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 >> 172.21.15.102:0/2854354213 conn(0x55fb9146d460 msgr2=0x55fb918216d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8aeffd640 0 client.16128 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 shutdown_connections 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 1 -- 172.21.15.102:0/2854354213 wait complete. 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.447+0000 7fc8dc10a740 20 client.16128 trim_cache size 0 max 16384 2024-09-21T03:36:59.454 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 msgr2=0x7fc8b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 0x7fc8b80b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55fb9181f320 tx=0x7fc8c000b390 comp rx=0 tx=0).stop 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 msgr2=0x7fc8d019ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4005940 tx=0x7fc8c40042f0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 shutdown_connections 2024-09-21T03:36:59.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc8b80b6680 0x7fc8b80b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc8d01083a0 0x7fc8d019ab40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc8d0108cf0 0x7fc8d019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 --2- 172.21.15.102:0/2279628366 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc8d0102a60 0x7fc8d019a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 >> 172.21.15.102:0/2279628366 conn(0x7fc8d0079730 msgr2=0x7fc8d0101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 shutdown_connections 2024-09-21T03:36:59.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:36:59.448+0000 7fc8d5b96640 1 -- 172.21.15.102:0/2279628366 wait complete. 2024-09-21T03:36:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:36:59 smithi102 ceph-mon[31392]: pgmap v426: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:36:59.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:36:59 smithi148 ceph-mon[34651]: pgmap v426: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:36:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:36:59 smithi121 ceph-mon[34316]: pgmap v426: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:00 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:37:00.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:00 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:37:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:37:00.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:37:00.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:37:00.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:00 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:37:01.161 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:37:01.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:37:01.411 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:01.452 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:01 smithi102 ceph-mon[31392]: pgmap v427: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:01 smithi148 ceph-mon[34651]: pgmap v427: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:01 smithi121 ceph-mon[34316]: pgmap v427: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:01.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.899+0000 7f00d6f77640 1 -- 172.21.15.102:0/809364532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d0105300 msgr2=0x7f00d010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.899+0000 7f00d6f77640 1 --2- 172.21.15.102:0/809364532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d0105300 0x7f00d010d850 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009900 tx=0x7f00bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 -- 172.21.15.102:0/809364532 shutdown_connections 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 --2- 172.21.15.102:0/809364532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d0105300 0x7f00d010d850 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 --2- 172.21.15.102:0/809364532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d010de10 0x7f00d0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 --2- 172.21.15.102:0/809364532 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d01049b0 0x7f00d0104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 -- 172.21.15.102:0/809364532 >> 172.21.15.102:0/809364532 conn(0x7f00d0079730 msgr2=0x7f00d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 -- 172.21.15.102:0/809364532 shutdown_connections 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 -- 172.21.15.102:0/809364532 wait complete. 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 Processor -- start 2024-09-21T03:37:01.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.900+0000 7f00d6f77640 1 -- start start 2024-09-21T03:37:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d0105300 0x7f00d019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 0x7f00d019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113b90 con 0x7f00d01049b0 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113a10 con 0x7f00d0105300 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d6f77640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00d0113d10 con 0x7f00d010de10 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43388/0 (socket says 172.21.15.102:43388) 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 -- 172.21.15.102:0/3825795102 learned_addr learned my addr 172.21.15.102:0/3825795102 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00cffff640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d0105300 0x7f00d019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d5514640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 0x7f00d019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 -- 172.21.15.102:0/3825795102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 msgr2=0x7f00d019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 0x7f00d019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 -- 172.21.15.102:0/3825795102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d0105300 msgr2=0x7f00d019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d0105300 0x7f00d019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 -- 172.21.15.102:0/3825795102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d01a04d0 con 0x7f00d01049b0 2024-09-21T03:37:01.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d5514640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 0x7f00d019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.901+0000 7f00d4d13640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f00c400d770 tx=0x7f00c400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.902+0000 7f00cdffb640 1 -- 172.21.15.102:0/3825795102 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4017070 con 0x7f00d01049b0 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.902+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d01a07c0 con 0x7f00d01049b0 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.902+0000 7f00cdffb640 1 -- 172.21.15.102:0/3825795102 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00c4009c30 con 0x7f00d01049b0 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.902+0000 7f00cdffb640 1 -- 172.21.15.102:0/3825795102 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4003d70 con 0x7f00d01049b0 2024-09-21T03:37:01.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.902+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d01a6f20 con 0x7f00d01049b0 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 Processor -- start 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 -- start start 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c0262490 0x5608c0632970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c026a670 0x5608c0632eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5608c05a8e60 con 0x5608c0262490 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5608c0598290 con 0x5608c028b350 2024-09-21T03:37:01.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5608c059c0a0 con 0x5608c026a670 2024-09-21T03:37:01.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00d5514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00d5514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52446/0 (socket says 172.21.15.102:52446) 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00d5514640 1 -- 172.21.15.102:0/4269387701 learned_addr learned my addr 172.21.15.102:0/4269387701 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.905+0000 7f00cffff640 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c026a670 0x5608c0632eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 -- 172.21.15.102:0/4269387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c026a670 msgr2=0x5608c0632eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c026a670 0x5608c0632eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 -- 172.21.15.102:0/4269387701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c0262490 msgr2=0x5608c0632970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c0262490 0x5608c0632970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 -- 172.21.15.102:0/4269387701 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c02f6930 con 0x5608c028b350 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00d5514640 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009ea0 tx=0x7f00c8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a89c8bb2da4709 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00cdffb640 1 -- 172.21.15.102:0/3825795102 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f00c4010460 con 0x7f00d01049b0 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00baffd640 1 -- 172.21.15.102:0/4269387701 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004d20 con 0x5608c028b350 2024-09-21T03:37:01.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00baffd640 1 -- 172.21.15.102:0/4269387701 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00c80054f0 con 0x5608c028b350 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.906+0000 7f00baffd640 1 -- 172.21.15.102:0/4269387701 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80119e0 con 0x5608c028b350 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00cdffb640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 0x7f00c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00d4d13640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 0x7f00c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00cdffb640 1 -- 172.21.15.102:0/3825795102 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f00c40e70c0 con 0x7f00d01049b0 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 -- 172.21.15.102:0/4269387701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 msgr2=0x5608c0632430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009ea0 tx=0x7f00c8009f90 comp rx=0 tx=0).stop 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 -- 172.21.15.102:0/4269387701 shutdown_connections 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c0262490 0x5608c0632970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c026a670 0x5608c0632eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/4269387701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0632430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 -- 172.21.15.102:0/4269387701 >> 172.21.15.102:0/4269387701 conn(0x5608c027f740 msgr2=0x5608c0630320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 -- 172.21.15.102:0/4269387701 shutdown_connections 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00dd4eb740 1 -- 172.21.15.102:0/4269387701 wait complete. 2024-09-21T03:37:01.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.907+0000 7f00d4d13640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 0x7f00c00b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5608c06310b0 tx=0x7f00c4015000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 -- start start 2024-09-21T03:37:01.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 Processor -- start 2024-09-21T03:37:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c06423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c064e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5608c03f9890 con 0x5608c026a670 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5608c0532d40 con 0x5608c028b350 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5608c0644f10 con 0x5608c0262490 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00dd4eb740 10 client.0 _ll_register_callbacks cb 0x5608c0596c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.908+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43402/0 (socket says 172.21.15.102:43402) 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 -- 172.21.15.102:0/1149075404 learned_addr learned my addr 172.21.15.102:0/1149075404 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00d5514640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c064e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00d5514640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c06423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 -- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 msgr2=0x5608c06423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c06423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 -- 172.21.15.102:0/1149075404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 msgr2=0x5608c064e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c064e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 -- 172.21.15.102:0/1149075404 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c064e800 con 0x5608c026a670 2024-09-21T03:37:01.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00cffff640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009230 tx=0x7f00bc032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73e560dde11d9cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00affff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc035040 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f00bc004040 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00c80054f0 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00bc031950 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00dd4eb740 10 client.16137 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.909+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608c0651110 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00c80054f0 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f00bc004990 con 0x5608c026a670 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 10 client.16137 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 20 client.16137 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c0249cd0 0x5608c0654720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 4 client.16137 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608c05aadb0 con 0x5608c0249cd0 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.910+0000 7f00d5514640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c0249cd0 0x5608c0654720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.911+0000 7f00affff640 10 client.16137 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.911+0000 7f00d5514640 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c0249cd0 0x5608c0654720 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e800ea4e882da64e server_cookie=3cd78f3364978118 in_seq=0 out_seq=0 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.911+0000 7f00affff640 1 -- 172.21.15.102:0/1149075404 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5608c05aadb0 con 0x5608c0249cd0 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.911+0000 7f00affff640 10 client.16137 handle_command_reply: tid=0 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 client.16137 shutdown 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 msgr2=0x5608c0642920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f00bc009230 tx=0x7f00bc032f50 comp rx=0 tx=0).stop 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 shutdown_connections 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c0249cd0 0x5608c0654720 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00affff640 0 client.16137 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0642920 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c064e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1149075404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c06423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 >> 172.21.15.102:0/1149075404 conn(0x5608c027f740 msgr2=0x5608c0633e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 shutdown_connections 2024-09-21T03:37:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1149075404 wait complete. 2024-09-21T03:37:01.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.912+0000 7f00dd4eb740 20 client.16137 trim_cache size 0 max 16384 2024-09-21T03:37:01.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.929+0000 7f00dd4eb740 1 Processor -- start 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.929+0000 7f00dd4eb740 1 -- start start 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 0x5608c0641a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c028b350 0x5608c063f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01b0090 con 0x5608c026a670 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01ad8a0 con 0x5608c0262490 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01ab6f0 con 0x5608c028b350 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43412/0 (socket says 172.21.15.102:43412) 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 -- 172.21.15.102:0/1286325550 learned_addr learned my addr 172.21.15.102:0/1286325550 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00d5514640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c028b350 0x5608c063f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00d5514640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 0x5608c0641a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 -- 172.21.15.102:0/1286325550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c028b350 msgr2=0x5608c063f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c028b350 0x5608c063f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 -- 172.21.15.102:0/1286325550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 msgr2=0x5608c0641a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 0x5608c0641a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 -- 172.21.15.102:0/1286325550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608c06434a0 con 0x5608c026a670 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00d5514640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 0x5608c0641a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00cffff640 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f00bc02a930 tx=0x7f00bc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a97ba945456495b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.930+0000 7f00ba7fc640 1 -- 172.21.15.102:0/1286325550 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc05a070 con 0x5608c026a670 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00ba7fc640 1 -- 172.21.15.102:0/1286325550 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00bc004fa0 con 0x5608c026a670 2024-09-21T03:37:01.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00ba7fc640 1 -- 172.21.15.102:0/1286325550 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc035030 con 0x5608c026a670 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1286325550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 msgr2=0x5608c0633b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f00bc02a930 tx=0x7f00bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1286325550 shutdown_connections 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0633b70 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c028b350 0x5608c063f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1286325550 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c0262490 0x5608c0641a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.931+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1286325550 >> 172.21.15.102:0/1286325550 conn(0x5608c027f740 msgr2=0x5608c0633460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1286325550 shutdown_connections 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1286325550 wait complete. 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- start start 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 Processor -- start 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c064a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0647360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01abd60 con 0x5608c026a670 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01ad1d0 con 0x5608c028b350 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.932+0000 7f00dd4eb740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01ac430 con 0x5608c0262490 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00dd4eb740 10 client.0 _ll_register_callbacks cb 0x7f00bc005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:01.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43424/0 (socket says 172.21.15.102:43424) 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 -- 172.21.15.102:0/1787960825 learned_addr learned my addr 172.21.15.102:0/1787960825 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00d5514640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c064a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00d5514640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0647360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 -- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 msgr2=0x5608c064a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c064a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 -- 172.21.15.102:0/1787960825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 msgr2=0x5608c0647360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0647360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 -- 172.21.15.102:0/1787960825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608c0647aa0 con 0x5608c026a670 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00d5514640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c064a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00cffff640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f00bc058040 tx=0x7f00bc004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc95936a4db90d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:01.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00affff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc035050 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f00bc005150 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.933+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00bc004fa0 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00bc05a040 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 10 client.16143 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5608c06bff90 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00bc004fa0 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f00bc05d070 con 0x5608c026a670 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 10 client.16143 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 10 client.16143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 20 client.16143 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c021f080 0x5608c06c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 4 client.16143 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608c05a6860 con 0x5608c021f080 2024-09-21T03:37:01.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.934+0000 7f00d5514640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c021f080 0x5608c06c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:01.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.935+0000 7f00affff640 10 client.16143 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:01.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.935+0000 7f00d5514640 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c021f080 0x5608c06c2710 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a90739748e7ff3bf server_cookie=a370233aa073d33f in_seq=0 out_seq=0 2024-09-21T03:37:01.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.936+0000 7f00affff640 1 -- 172.21.15.102:0/1787960825 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608c05a6860 con 0x5608c021f080 2024-09-21T03:37:01.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.936+0000 7f00affff640 10 client.16143 handle_command_reply: tid=0 2024-09-21T03:37:01.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.936+0000 7f00dd4eb740 1 client.16143 shutdown 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.936+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 msgr2=0x5608c0646e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.936+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f00bc058040 tx=0x7f00bc004a10 comp rx=0 tx=0).stop 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 shutdown_connections 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5608c021f080 0x5608c06c2710 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5608c026a670 0x5608c0646e20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5608c028b350 0x5608c0647360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 --2- 172.21.15.102:0/1787960825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5608c0262490 0x5608c064a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 >> 172.21.15.102:0/1787960825 conn(0x5608c027f740 msgr2=0x5608c06302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00affff640 0 client.16143 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 shutdown_connections 2024-09-21T03:37:01.942 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:37:01.943 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:37:01.943 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "5e6fcf1a-2ef2-4b37-8600-82f665a783c2", 2024-09-21T03:37:01.943 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:37:01.943 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:37:01.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 1 -- 172.21.15.102:0/1787960825 wait complete. 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00dd4eb740 20 client.16143 trim_cache size 0 max 16384 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 msgr2=0x7f00c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 0x7f00c00b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x5608c06310b0 tx=0x7f00c4015000 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 msgr2=0x7f00d019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.937+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f00c400d770 tx=0x7f00c400dc30 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 shutdown_connections 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00c00b6680 0x7f00c00b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00d010de10 0x7f00d019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00d0105300 0x7f00d019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 --2- 172.21.15.102:0/3825795102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00d01049b0 0x7f00d019a560 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 >> 172.21.15.102:0/3825795102 conn(0x7f00d0079730 msgr2=0x7f00d00ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 shutdown_connections 2024-09-21T03:37:01.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:01.938+0000 7f00d6f77640 1 -- 172.21.15.102:0/3825795102 wait complete. 2024-09-21T03:37:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:02 smithi102 ceph-mon[31392]: pgmap v428: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:02.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:02 smithi148 ceph-mon[34651]: pgmap v428: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:02 smithi121 ceph-mon[34316]: pgmap v428: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:02.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:37:03.130 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:03.557 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:03 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:37:03.557 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:03 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:03.557 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:03 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:37:03.557 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:03 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 -- 172.21.15.102:0/3814111828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 msgr2=0x7fce801087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 --2- 172.21.15.102:0/3814111828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce801087d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009900 tx=0x7fce6c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 -- 172.21.15.102:0/3814111828 shutdown_connections 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 --2- 172.21.15.102:0/3814111828 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce801087d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 --2- 172.21.15.102:0/3814111828 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 0x7fce8010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 --2- 172.21.15.102:0/3814111828 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 0x7fce80102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 -- 172.21.15.102:0/3814111828 >> 172.21.15.102:0/3814111828 conn(0x7fce80079740 msgr2=0x7fce80079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 -- 172.21.15.102:0/3814111828 shutdown_connections 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 -- 172.21.15.102:0/3814111828 wait complete. 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.648+0000 7fce87152640 1 Processor -- start 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 -- start start 2024-09-21T03:37:03.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 0x7fce80199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 0x7fce8019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fce80112aa0 con 0x7fce801083c0 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce80112920 con 0x7fce80108d10 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce87152640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce80112c20 con 0x7fce80102a80 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43440/0 (socket says 172.21.15.102:43440) 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 -- 172.21.15.102:0/895524713 learned_addr learned my addr 172.21.15.102:0/895524713 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce84eee640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 0x7fce80199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce856ef640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 0x7fce8019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 -- 172.21.15.102:0/895524713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 msgr2=0x7fce80199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 0x7fce80199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 -- 172.21.15.102:0/895524713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 msgr2=0x7fce8019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 0x7fce8019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.649+0000 7fce7ffff640 1 -- 172.21.15.102:0/895524713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8019f240 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce7ffff640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005940 tx=0x7fce6c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce7dffb640 1 -- 172.21.15.102:0/895524713 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c03f030 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce7dffb640 1 -- 172.21.15.102:0/895524713 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fce6c003cd0 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8019f4d0 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce7dffb640 1 -- 172.21.15.102:0/895524713 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c035070 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.650+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8019f9b0 con 0x7fce801083c0 2024-09-21T03:37:03.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 Processor -- start 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 -- start start 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eed27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e1ee48e50 con 0x564e1eb0a390 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564e1ee38280 con 0x564e1eb2b070 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564e1ee3c090 con 0x564e1eb021b0 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce7dffb640 1 -- 172.21.15.102:0/895524713 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fce6c042030 con 0x7fce801083c0 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52506/0 (socket says 172.21.15.102:52506) 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43450/0 (socket says 172.21.15.102:43450) 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 -- 172.21.15.102:0/300461242 learned_addr learned my addr 172.21.15.102:0/300461242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce84eee640 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eed27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 -- 172.21.15.102:0/300461242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 msgr2=0x564e1eed27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eed27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 -- 172.21.15.102:0/300461242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 msgr2=0x564e1eed2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.653+0000 7fce856ef640 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce856ef640 1 -- 172.21.15.102:0/300461242 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e1eb96650 con 0x564e1eb2b070 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce7ffff640 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce856ef640 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce78007f40 tx=0x7fce7800f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bca5f903766ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce6affd640 1 -- 172.21.15.102:0/300461242 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78010900 con 0x564e1eb2b070 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce6affd640 1 -- 172.21.15.102:0/300461242 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fce780183f0 con 0x564e1eb2b070 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce6affd640 1 -- 172.21.15.102:0/300461242 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78017600 con 0x564e1eb2b070 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce7dffb640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 0x7fce700b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce84eee640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 0x7fce700b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.654+0000 7fce7dffb640 1 -- 172.21.15.102:0/895524713 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fce6c107df0 con 0x7fce801083c0 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce84eee640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 0x7fce700b8bc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564e1eed0ef0 tx=0x7fce7400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 -- 172.21.15.102:0/300461242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 msgr2=0x564e1eed2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fce78007f40 tx=0x7fce7800f850 comp rx=0 tx=0).stop 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 -- 172.21.15.102:0/300461242 shutdown_connections 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eed2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eed27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/300461242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eed2270 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 -- 172.21.15.102:0/300461242 >> 172.21.15.102:0/300461242 conn(0x564e1eb1f460 msgr2=0x564e1eed0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 -- 172.21.15.102:0/300461242 shutdown_connections 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.655+0000 7fce8d6c6740 1 -- 172.21.15.102:0/300461242 wait complete. 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 -- start start 2024-09-21T03:37:03.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 Processor -- start 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eedd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eee9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e1ec99700 con 0x564e1eb0a390 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564e1edd3110 con 0x564e1eb2b070 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x564e1eee0a50 con 0x564e1eb021b0 2024-09-21T03:37:03.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce8d6c6740 10 client.0 _ll_register_callbacks cb 0x564e1edec990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43454/0 (socket says 172.21.15.102:43454) 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce7ffff640 1 -- 172.21.15.102:0/74942714 learned_addr learned my addr 172.21.15.102:0/74942714 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce856ef640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eee9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.656+0000 7fce84eee640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eedd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 -- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 msgr2=0x564e1eedd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eedd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 -- 172.21.15.102:0/74942714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 msgr2=0x564e1eee9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eee9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 -- 172.21.15.102:0/74942714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e1ee00c40 con 0x564e1eb0a390 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce856ef640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eee9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce84eee640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eedd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce7ffff640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0cd930 tx=0x7fce6c005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c77515e494733b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:03.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c049030 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fce6c0f10b0 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce780183f0 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce6c0ca280 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce8d6c6740 10 client.16155 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e1eeec750 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.657+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fce780183f0 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fce6c003800 con 0x564e1eb0a390 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 10 client.16155 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 20 client.16155 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eae99f0 0x564e1eeefcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 4 client.16155 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e1ee4ada0 con 0x564e1eae99f0 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce84eee640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eae99f0 0x564e1eeefcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce84eee640 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eae99f0 0x564e1eeefcc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dfd2a14b7b85014 server_cookie=d82d212e15098f87 in_seq=0 out_seq=0 2024-09-21T03:37:03.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.658+0000 7fce5ffff640 10 client.16155 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce5ffff640 1 -- 172.21.15.102:0/74942714 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e1ee4ada0 con 0x564e1eae99f0 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce5ffff640 10 client.16155 handle_command_reply: tid=0 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 client.16155 shutdown 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 msgr2=0x564e1eedde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0cd930 tx=0x7fce6c005c90 comp rx=0 tx=0).stop 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 shutdown_connections 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eae99f0 0x564e1eeefcc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb0a390 0x564e1eedde30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb2b070 0x564e1eee9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce5ffff640 0 client.16155 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/74942714 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb021b0 0x564e1eedd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.659+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 >> 172.21.15.102:0/74942714 conn(0x564e1eb1f460 msgr2=0x564e1eed5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.660+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 shutdown_connections 2024-09-21T03:37:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.660+0000 7fce8d6c6740 1 -- 172.21.15.102:0/74942714 wait complete. 2024-09-21T03:37:03.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.660+0000 7fce8d6c6740 20 client.16155 trim_cache size 0 max 16384 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 Processor -- start 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 -- start start 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eae99f0 0x564e1eedc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 0x564e1eee9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fce801b0fb0 con 0x564e1eb021b0 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce801ae7c0 con 0x564e1eb0a390 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce801ac610 con 0x564e1eae99f0 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43468/0 (socket says 172.21.15.102:43468) 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 -- 172.21.15.102:0/1627131894 learned_addr learned my addr 172.21.15.102:0/1627131894 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce84eee640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eae99f0 0x564e1eedc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce856ef640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 0x564e1eee9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 -- 172.21.15.102:0/1627131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eae99f0 msgr2=0x564e1eedc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eae99f0 0x564e1eedc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 -- 172.21.15.102:0/1627131894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 msgr2=0x564e1eee9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 0x564e1eee9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.677+0000 7fce7ffff640 1 -- 172.21.15.102:0/1627131894 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e1eef01c0 con 0x564e1eb021b0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.678+0000 7fce856ef640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 0x564e1eee9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.678+0000 7fce7ffff640 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fce6c032fd0 tx=0x7fce6c10b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244f35610736b995 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.678+0000 7fce6a7fc640 1 -- 172.21.15.102:0/1627131894 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c049030 con 0x564e1eb021b0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.678+0000 7fce6a7fc640 1 -- 172.21.15.102:0/1627131894 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fce6c005de0 con 0x564e1eb021b0 2024-09-21T03:37:03.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.678+0000 7fce6a7fc640 1 -- 172.21.15.102:0/1627131894 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0cd3a0 con 0x564e1eb021b0 2024-09-21T03:37:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- 172.21.15.102:0/1627131894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 msgr2=0x564e1eed39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fce6c032fd0 tx=0x7fce6c10b9b0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- 172.21.15.102:0/1627131894 shutdown_connections 2024-09-21T03:37:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eb021b0 0x564e1eed39b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb0a390 0x564e1eee9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/1627131894 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eae99f0 0x564e1eedc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- 172.21.15.102:0/1627131894 >> 172.21.15.102:0/1627131894 conn(0x564e1eb1f460 msgr2=0x564e1eed32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- 172.21.15.102:0/1627131894 shutdown_connections 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- 172.21.15.102:0/1627131894 wait complete. 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 -- start start 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.679+0000 7fce8d6c6740 1 Processor -- start 2024-09-21T03:37:03.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb021b0 0x564e1eee4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 0x564e1ef546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fce801acc80 con 0x564e1eae99f0 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce801ae0f0 con 0x564e1eb021b0 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fce801ad350 con 0x564e1eb0a390 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 10 client.0 _ll_register_callbacks cb 0x7fce6c10b630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43472/0 (socket says 172.21.15.102:43472) 2024-09-21T03:37:03.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 -- 172.21.15.102:0/3667958151 learned_addr learned my addr 172.21.15.102:0/3667958151 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce856ef640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 0x564e1ef546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce7ffff640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb021b0 0x564e1eee4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 -- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 msgr2=0x564e1ef546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 0x564e1ef546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 -- 172.21.15.102:0/3667958151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb021b0 msgr2=0x564e1eee4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb021b0 0x564e1eee4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 -- 172.21.15.102:0/3667958151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e1ef54d40 con 0x564e1eae99f0 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce856ef640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 0x564e1ef546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:03.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce84eee640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564e1eef0420 tx=0x7fce740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9e69eec2008ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce5ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74033060 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fce7402e410 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.680+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e1ee46850 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fce7402a070 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 10 client.16161 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564e1ef5d270 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x564e1ee46850 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fce74028770 con 0x564e1eae99f0 2024-09-21T03:37:03.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 10 client.16161 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 10 client.16161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 20 client.16161 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eb2b070 0x564e1ef5faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 4 client.16161 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e1ee43c80 con 0x564e1eb2b070 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.681+0000 7fce7ffff640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eb2b070 0x564e1ef5faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce5ffff640 10 client.16161 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce7ffff640 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eb2b070 0x564e1ef5faa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=837f9a5dcee2c9f4 server_cookie=f5c7592c0e44541 in_seq=0 out_seq=0 2024-09-21T03:37:03.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce5ffff640 1 -- 172.21.15.102:0/3667958151 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x564e1ee43c80 con 0x564e1eb2b070 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce5ffff640 10 client.16161 handle_command_reply: tid=0 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 client.16161 shutdown 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 msgr2=0x564e1eee4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x564e1eef0420 tx=0x7fce740046c0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 shutdown_connections 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x564e1eb0a390 0x564e1ef546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564e1eb021b0 0x564e1eee4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x564e1eb2b070 0x564e1ef5faa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 --2- 172.21.15.102:0/3667958151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e1eae99f0 0x564e1eee4820 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce5ffff640 0 client.16161 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.682+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 >> 172.21.15.102:0/3667958151 conn(0x564e1eb1f460 msgr2=0x564e1eedebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 shutdown_connections 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce8d6c6740 1 -- 172.21.15.102:0/3667958151 wait complete. 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce8d6c6740 20 client.16161 trim_cache size 0 max 16384 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.692 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "5e6fcf1a-2ef2-4b37-8600-82f665a783c2", 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.693 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:37:03.694 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:37:03.695 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:03.696 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 msgr2=0x7fce700b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 0x7fce700b8bc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564e1eed0ef0 tx=0x7fce7400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 msgr2=0x7fce80199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce6c005940 tx=0x7fce6c004360 comp rx=0 tx=0).stop 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 shutdown_connections 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fce700b66b0 0x7fce700b8bc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fce801083c0 0x7fce80199930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce80108d10 0x7fce8019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 --2- 172.21.15.102:0/895524713 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fce80102a80 0x7fce80199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.683+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 >> 172.21.15.102:0/895524713 conn(0x7fce80079740 msgr2=0x7fce80101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.684+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 shutdown_connections 2024-09-21T03:37:03.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:03.684+0000 7fce87152640 1 -- 172.21.15.102:0/895524713 wait complete. 2024-09-21T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:03 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:03 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:03 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:37:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:03 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:03 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:37:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:03 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:03 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:37:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:03 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:04.584 INFO:tasks.cephfs.filesystem:scrub status for tag:5e6fcf1a-2ef2-4b37-8600-82f665a783c2 - {'path': '/', 'tag': '5e6fcf1a-2ef2-4b37-8600-82f665a783c2', 'options': 'recursive,force'} 2024-09-21T03:37:04.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:04 smithi102 ceph-mon[31392]: pgmap v429: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:04.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:04 smithi148 ceph-mon[34651]: pgmap v429: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:04 smithi121 ceph-mon[34316]: pgmap v429: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:37:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:07 smithi102 ceph-mon[31392]: pgmap v430: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T03:37:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:07 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:37:07.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:07 smithi148 ceph-mon[34651]: pgmap v430: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T03:37:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:07 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:37:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:07 smithi121 ceph-mon[34316]: pgmap v430: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-09-21T03:37:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:07 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:37:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:09 smithi102 ceph-mon[31392]: pgmap v431: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:09.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:09 smithi148 ceph-mon[34651]: pgmap v431: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:09 smithi121 ceph-mon[34316]: pgmap v431: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:11 smithi102 ceph-mon[31392]: pgmap v432: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:11 smithi148 ceph-mon[34651]: pgmap v432: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:11 smithi121 ceph-mon[34316]: pgmap v432: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:37:13.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:13 smithi102 ceph-mon[31392]: pgmap v433: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:37:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:13 smithi148 ceph-mon[34651]: pgmap v433: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:37:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:13 smithi121 ceph-mon[34316]: pgmap v433: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:37:15.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:15 smithi102 ceph-mon[31392]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-21T03:37:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:15 smithi148 ceph-mon[34651]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-21T03:37:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:15 smithi121 ceph-mon[34316]: pgmap v434: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-09-21T03:37:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:17 smithi102 ceph-mon[31392]: pgmap v435: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:37:17.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:17 smithi148 ceph-mon[34651]: pgmap v435: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:37:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:17 smithi121 ceph-mon[34316]: pgmap v435: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:37:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:19 smithi102 ceph-mon[31392]: pgmap v436: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:37:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:19 smithi148 ceph-mon[34651]: pgmap v436: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:37:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:19 smithi121 ceph-mon[34316]: pgmap v436: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:37:21.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:21 smithi102 ceph-mon[31392]: pgmap v437: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:21 smithi148 ceph-mon[34651]: pgmap v437: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:21.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:21 smithi121 ceph-mon[34316]: pgmap v437: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:23 smithi102 ceph-mon[31392]: pgmap v438: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:23 smithi148 ceph-mon[34651]: pgmap v438: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:23 smithi121 ceph-mon[34316]: pgmap v438: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:24 smithi102 ceph-mon[31392]: pgmap v439: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:24 smithi148 ceph-mon[34651]: pgmap v439: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:24 smithi121 ceph-mon[34316]: pgmap v439: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:27 smithi102 ceph-mon[31392]: pgmap v440: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:27 smithi148 ceph-mon[34651]: pgmap v440: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:27 smithi121 ceph-mon[34316]: pgmap v440: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:29 smithi102 ceph-mon[31392]: pgmap v441: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:29.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:29 smithi148 ceph-mon[34651]: pgmap v441: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:29 smithi121 ceph-mon[34316]: pgmap v441: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:31 smithi102 ceph-mon[31392]: pgmap v442: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:31 smithi148 ceph-mon[34651]: pgmap v442: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:31 smithi121 ceph-mon[34316]: pgmap v442: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:33.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:33 smithi102 ceph-mon[31392]: pgmap v443: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:33 smithi148 ceph-mon[34651]: pgmap v443: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:33 smithi121 ceph-mon[34316]: pgmap v443: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:34.585 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:37:34.852 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:35.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 -- 172.21.15.102:0/4071998827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd341094d0 msgr2=0x7fbd341098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 --2- 172.21.15.102:0/4071998827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd341094d0 0x7fbd341098e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009900 tx=0x7fbd1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:37:35.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 -- 172.21.15.102:0/4071998827 shutdown_connections 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 --2- 172.21.15.102:0/4071998827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd341094d0 0x7fbd341098e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 --2- 172.21.15.102:0/4071998827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd34109e20 0x7fbd34110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 --2- 172.21.15.102:0/4071998827 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd34103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 -- 172.21.15.102:0/4071998827 >> 172.21.15.102:0/4071998827 conn(0x7fbd340ff600 msgr2=0x7fbd34101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 -- 172.21.15.102:0/4071998827 shutdown_connections 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.342+0000 7fbd39d10640 1 -- 172.21.15.102:0/4071998827 wait complete. 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.343+0000 7fbd39d10640 1 Processor -- start 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.343+0000 7fbd39d10640 1 -- start start 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd3419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 0x7fbd3419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd34113c00 con 0x7fbd34109e20 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd34113a80 con 0x7fbd341094d0 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd34113d80 con 0x7fbd34103b90 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46738/0 (socket says 172.21.15.102:46738) 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 -- 172.21.15.102:0/1354441731 learned_addr learned my addr 172.21.15.102:0/1354441731 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 0x7fbd3419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd3419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 -- 172.21.15.102:0/1354441731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 msgr2=0x7fbd3419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd3419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 -- 172.21.15.102:0/1354441731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 msgr2=0x7fbd3419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 0x7fbd3419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 -- 172.21.15.102:0/1354441731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd341a04e0 con 0x7fbd34109e20 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd3419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:35.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 0x7fbd3419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd33fff640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009fd0 tx=0x7fbd2c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd317fa640 1 -- 172.21.15.102:0/1354441731 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c017070 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd317fa640 1 -- 172.21.15.102:0/1354441731 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd2c003e40 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd317fa640 1 -- 172.21.15.102:0/1354441731 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c004820 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd341a07d0 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.344+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd341a6f30 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 Processor -- start 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd317fa640 1 -- 172.21.15.102:0/1354441731 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fbd2c003970 con 0x7fbd34109e20 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 -- start start 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55933711de50 con 0x559336e00070 2024-09-21T03:37:35.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55933710d280 con 0x559336dd71b0 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd40284740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559337111090 con 0x559336ddf390 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46750/0 (socket says 172.21.15.102:46750) 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.347+0000 7fbd2affd640 1 -- 172.21.15.102:0/1814204266 learned_addr learned my addr 172.21.15.102:0/1814204266 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 -- 172.21.15.102:0/1814204266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 msgr2=0x5593371a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 -- 172.21.15.102:0/1814204266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 msgr2=0x5593371a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371a77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 -- 172.21.15.102:0/1814204266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559336e6b650 con 0x559336e00070 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0314b0 tx=0x7fbd1c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc8a12d467a4673 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd317fa640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 0x7fbd200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd29ffb640 1 -- 172.21.15.102:0/1814204266 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c035050 con 0x559336e00070 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 0x7fbd200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd29ffb640 1 -- 172.21.15.102:0/1814204266 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd1c031710 con 0x559336e00070 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.348+0000 7fbd29ffb640 1 -- 172.21.15.102:0/1814204266 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0046c0 con 0x559336e00070 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd317fa640 1 -- 172.21.15.102:0/1354441731 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbd2c0e7580 con 0x7fbd34109e20 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 -- 172.21.15.102:0/1814204266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 msgr2=0x5593371a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0314b0 tx=0x7fbd1c005e50 comp rx=0 tx=0).stop 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 0x7fbd200b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5593371a5ef0 tx=0x7fbd24005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 -- 172.21.15.102:0/1814204266 shutdown_connections 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 --2- 172.21.15.102:0/1814204266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336e00070 0x5593371a7270 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 -- 172.21.15.102:0/1814204266 >> 172.21.15.102:0/1814204266 conn(0x559336df4460 msgr2=0x5593371a5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 -- 172.21.15.102:0/1814204266 shutdown_connections 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.349+0000 7fbd40284740 1 -- 172.21.15.102:0/1814204266 wait complete. 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 -- start start 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 Processor -- start 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 0x5593371b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336e00070 0x5593371bed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559336f6e700 con 0x559336dd71b0 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5593370a8110 con 0x559336ddf390 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5593371b59f0 con 0x559336e00070 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd40284740 10 client.0 _ll_register_callbacks cb 0x5593370c1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd337fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd337fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46754/0 (socket says 172.21.15.102:46754) 2024-09-21T03:37:35.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd337fe640 1 -- 172.21.15.102:0/821370725 learned_addr learned my addr 172.21.15.102:0/821370725 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.350+0000 7fbd2affd640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 0x5593371b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd33fff640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336e00070 0x5593371bed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 -- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336e00070 msgr2=0x5593371bed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336e00070 0x5593371bed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 -- 172.21.15.102:0/821370725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 msgr2=0x5593371b2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 0x5593371b2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 -- 172.21.15.102:0/821370725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593370d5c40 con 0x559336dd71b0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd2affd640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 0x5593371b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd337fe640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005940 tx=0x7fbd240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feaa528cc581b3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd24020620 con 0x559336dd71b0 2024-09-21T03:37:35.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbd240207c0 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd1c031710 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd240209c0 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd40284740 10 client.16173 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5593371c1780 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.351+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd1c031710 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbd2400f040 con 0x559336dd71b0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 10 client.16173 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 20 client.16173 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336dbe9f0 0x5593371c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 4 client.16173 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55933711fda0 con 0x559336dbe9f0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.352+0000 7fbd2affd640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336dbe9f0 0x5593371c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.353+0000 7fbd12ffd640 10 client.16173 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:35.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.353+0000 7fbd2affd640 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336dbe9f0 0x5593371c4d90 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fee2b528303feecb server_cookie=9c0ed0b2b116585d in_seq=0 out_seq=0 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.353+0000 7fbd12ffd640 1 -- 172.21.15.102:0/821370725 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55933711fda0 con 0x559336dbe9f0 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.353+0000 7fbd12ffd640 10 client.16173 handle_command_reply: tid=0 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.353+0000 7fbd40284740 1 client.16173 shutdown 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 msgr2=0x5593371b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005940 tx=0x7fbd240046c0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 shutdown_connections 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336e00070 0x5593371bed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336ddf390 0x5593371b2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336dbe9f0 0x5593371c4d90 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 --2- 172.21.15.102:0/821370725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b2930 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd12ffd640 0 client.16173 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 >> 172.21.15.102:0/821370725 conn(0x559336df4460 msgr2=0x5593371aa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 shutdown_connections 2024-09-21T03:37:35.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 1 -- 172.21.15.102:0/821370725 wait complete. 2024-09-21T03:37:35.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.354+0000 7fbd40284740 20 client.16173 trim_cache size 0 max 16384 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.371+0000 7fbd40284740 1 Processor -- start 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 -- start start 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 0x5593371b1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341b2110 con 0x559336dd71b0 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341af920 con 0x559336dbe9f0 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd40284740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341ad770 con 0x559336ddf390 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46766/0 (socket says 172.21.15.102:46766) 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 -- 172.21.15.102:0/1560616149 learned_addr learned my addr 172.21.15.102:0/1560616149 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:35.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 0x5593371b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd33fff640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 -- 172.21.15.102:0/1560616149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 msgr2=0x5593371a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 -- 172.21.15.102:0/1560616149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 msgr2=0x5593371b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 0x5593371b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 -- 172.21.15.102:0/1560616149 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593371a99c0 con 0x559336dd71b0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd337fe640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 0x5593371b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.372+0000 7fbd2affd640 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c004650 tx=0x7fbd1c02abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee49f5d43a3051d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd297fa640 1 -- 172.21.15.102:0/1560616149 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c056070 con 0x559336dd71b0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd297fa640 1 -- 172.21.15.102:0/1560616149 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd1c031b40 con 0x559336dd71b0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd297fa640 1 -- 172.21.15.102:0/1560616149 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c035040 con 0x559336dd71b0 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 -- 172.21.15.102:0/1560616149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 msgr2=0x5593371b4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c004650 tx=0x7fbd1c02abb0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 -- 172.21.15.102:0/1560616149 shutdown_connections 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336dd71b0 0x5593371b4560 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336ddf390 0x5593371a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 --2- 172.21.15.102:0/1560616149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dbe9f0 0x5593371b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.373+0000 7fbd40284740 1 -- 172.21.15.102:0/1560616149 >> 172.21.15.102:0/1560616149 conn(0x559336df4460 msgr2=0x5593371b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- 172.21.15.102:0/1560616149 shutdown_connections 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- 172.21.15.102:0/1560616149 wait complete. 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- start start 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 Processor -- start 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336dbe9f0 0x5593371bb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341adde0 con 0x559336ddf390 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341af250 con 0x559336dd71b0 2024-09-21T03:37:35.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbd341ae4b0 con 0x559336dbe9f0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.374+0000 7fbd40284740 10 client.0 _ll_register_callbacks cb 0x7fbd24009a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46782/0 (socket says 172.21.15.102:46782) 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 -- 172.21.15.102:0/3337801729 learned_addr learned my addr 172.21.15.102:0/3337801729 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd337fe640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336dbe9f0 0x5593371bb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd2affd640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 -- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336dbe9f0 msgr2=0x5593371bb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336dbe9f0 0x5593371bb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 -- 172.21.15.102:0/3337801729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 msgr2=0x5593371b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 -- 172.21.15.102:0/3337801729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559337232ba0 con 0x559336ddf390 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd33fff640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a9990 tx=0x7fbd2c0acbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9416595a3e328dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:35.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c020070 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbd2c0e72b0 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd1c031b40 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbd2c0adac0 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd40284740 10 client.16179 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.375+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559337233d30 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbd1c031b40 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbd2c0a7ac0 con 0x559336ddf390 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 10 client.16179 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 10 client.16179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 20 client.16179 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336e00070 0x559337236550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 4 client.16179 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55933711b850 con 0x559336e00070 2024-09-21T03:37:35.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.376+0000 7fbd337fe640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336e00070 0x559337236550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd337fe640 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336e00070 0x559337236550 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afec6914d41ee0b7 server_cookie=62d4d7ff7c12efd in_seq=0 out_seq=0 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd12ffd640 10 client.16179 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd12ffd640 1 -- 172.21.15.102:0/3337801729 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55933711b850 con 0x559336e00070 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd12ffd640 10 client.16179 handle_command_reply: tid=0 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 client.16179 shutdown 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 msgr2=0x5593371b7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0a9990 tx=0x7fbd2c0acbf0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 shutdown_connections 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559336e00070 0x559337236550 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559336ddf390 0x5593371b7230 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559336dd71b0 0x5593371b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 --2- 172.21.15.102:0/3337801729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559336dbe9f0 0x5593371bb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd12ffd640 0 client.16179 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 >> 172.21.15.102:0/3337801729 conn(0x559336df4460 msgr2=0x5593371b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 shutdown_connections 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 1 -- 172.21.15.102:0/3337801729 wait complete. 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.377+0000 7fbd40284740 20 client.16179 trim_cache size 0 max 16384 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:37:35.390 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.391 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:37:35.392 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:37:35.393 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:35.394 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 msgr2=0x7fbd200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 0x7fbd200b8c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5593371a5ef0 tx=0x7fbd24005f90 comp rx=0 tx=0).stop 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 msgr2=0x7fbd3419fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:35.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009fd0 tx=0x7fbd2c00b260 comp rx=0 tx=0).stop 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 shutdown_connections 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbd200b6700 0x7fbd200b8c10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd34109e20 0x7fbd3419fdb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbd341094d0 0x7fbd3419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 --2- 172.21.15.102:0/1354441731 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbd34103b90 0x7fbd3419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 >> 172.21.15.102:0/1354441731 conn(0x7fbd340ff600 msgr2=0x7fbd34101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 shutdown_connections 2024-09-21T03:37:35.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:35.378+0000 7fbd39d10640 1 -- 172.21.15.102:0/1354441731 wait complete. 2024-09-21T03:37:35.670 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:35 smithi102 ceph-mon[31392]: pgmap v444: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:35 smithi148 ceph-mon[34651]: pgmap v444: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:35 smithi121 ceph-mon[34316]: pgmap v444: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:36.262 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:37:36.262 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:37:36.514 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 -- 172.21.15.102:0/498779260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94103b60 msgr2=0x7f7f94103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:37.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/498779260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94103b60 0x7f7f94103f70 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009ca0 tx=0x7f7f8402a8e0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 -- 172.21.15.102:0/498779260 shutdown_connections 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/498779260 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f94109df0 0x7f7f94110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/498779260 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f941094a0 0x7f7f941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/498779260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94103b60 0x7f7f94103f70 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 -- 172.21.15.102:0/498779260 >> 172.21.15.102:0/498779260 conn(0x7f7f9407b850 msgr2=0x7f7f9407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 -- 172.21.15.102:0/498779260 shutdown_connections 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.001+0000 7f7f9bd16640 1 -- 172.21.15.102:0/498779260 wait complete. 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 Processor -- start 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 -- start start 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f94103b60 0x7f7f9419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f941094a0 0x7f7f9419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:37.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94113c60 con 0x7f7f94109df0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94113ae0 con 0x7f7f941094a0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9bd16640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94113de0 con 0x7f7f94103b60 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46802/0 (socket says 172.21.15.102:46802) 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 -- 172.21.15.102:0/1408861706 learned_addr learned my addr 172.21.15.102:0/1408861706 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f992b1640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f941094a0 0x7f7f9419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f99ab2640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f94103b60 0x7f7f9419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 -- 172.21.15.102:0/1408861706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f94103b60 msgr2=0x7f7f9419a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f94103b60 0x7f7f9419a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 -- 172.21.15.102:0/1408861706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f941094a0 msgr2=0x7f7f9419ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f941094a0 0x7f7f9419ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.002+0000 7f7f9a2b3640 1 -- 172.21.15.102:0/1408861706 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f941a0640 con 0x7f7f94109df0 2024-09-21T03:37:37.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.003+0000 7f7f9a2b3640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009fd0 tx=0x7f7f8c00b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.003+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c015020 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.003+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f941a0930 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.003+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941a7090 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.004+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7f8c011d00 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.004+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c010e20 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.005+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f80005290 con 0x7f7f94109df0 2024-09-21T03:37:37.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.006+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7f8c018020 con 0x7f7f94109df0 2024-09-21T03:37:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.007+0000 7f7f92ffd640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 0x7f7f7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.007+0000 7f7f99ab2640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 0x7f7f7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.007+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f7f8c0e72c0 con 0x7f7f94109df0 2024-09-21T03:37:37.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.007+0000 7f7f99ab2640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 0x7f7f7c0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009a60 tx=0x7f7f84031000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:37.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.010+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f8c01f020 con 0x7f7f94109df0 2024-09-21T03:37:37.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.225+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f80005580 con 0x7f7f94109df0 2024-09-21T03:37:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.226+0000 7f7f92ffd640 1 -- 172.21.15.102:0/1408861706 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11942 (secure 0 0 0) 0x7f7f8c0ad800 con 0x7f7f94109df0 2024-09-21T03:37:37.228 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:37:37.228 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":29,"btime":"2024-09-21T03:35:52:382620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:35:51.414877+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:37:37.228 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 29 2024-09-21T03:37:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 msgr2=0x7f7f7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 0x7f7f7c0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009a60 tx=0x7f7f84031000 comp rx=0 tx=0).stop 2024-09-21T03:37:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 msgr2=0x7f7f9419ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:37.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009fd0 tx=0x7f7f8c00b820 comp rx=0 tx=0).stop 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 shutdown_connections 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7f7c0b6680 0x7f7f7c0b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7f94109df0 0x7f7f9419ff10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f941094a0 0x7f7f9419ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 --2- 172.21.15.102:0/1408861706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7f94103b60 0x7f7f9419a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 >> 172.21.15.102:0/1408861706 conn(0x7f7f9407b850 msgr2=0x7f7f941075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 shutdown_connections 2024-09-21T03:37:37.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:37.228+0000 7f7f9bd16640 1 -- 172.21.15.102:0/1408861706 wait complete. 2024-09-21T03:37:37.626 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:37 smithi102 ceph-mon[31392]: pgmap v445: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:37.626 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:37 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1408861706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:37:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:37 smithi148 ceph-mon[34651]: pgmap v445: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:37 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1408861706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:37:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:37 smithi121 ceph-mon[34316]: pgmap v445: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:37 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1408861706' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:37:38.031 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:37:38.278 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 -- 172.21.15.102:0/3052482736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c1094a0 msgr2=0x7f112c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 --2- 172.21.15.102:0/3052482736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c1094a0 0x7f112c1098b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1120009900 tx=0x7f112002a410 comp rx=0 tx=0).stop 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 -- 172.21.15.102:0/3052482736 shutdown_connections 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 --2- 172.21.15.102:0/3052482736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c1094a0 0x7f112c1098b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 --2- 172.21.15.102:0/3052482736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 --2- 172.21.15.102:0/3052482736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c103b60 0x7f112c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 -- 172.21.15.102:0/3052482736 >> 172.21.15.102:0/3052482736 conn(0x7f112c07b850 msgr2=0x7f112c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 -- 172.21.15.102:0/3052482736 shutdown_connections 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 -- 172.21.15.102:0/3052482736 wait complete. 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.812+0000 7f1132096640 1 Processor -- start 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 -- start start 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 0x7f112c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f112c113c30 con 0x7f112c103b60 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f112c113ab0 con 0x7f112c1094a0 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f1132096640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f112c113db0 con 0x7f112c109df0 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46832/0 (socket says 172.21.15.102:46832) 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 -- 172.21.15.102:0/2448928930 learned_addr learned my addr 172.21.15.102:0/2448928930 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:38.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112affd640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 0x7f112c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112bfff640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 -- 172.21.15.102:0/2448928930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 msgr2=0x7f112c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 -- 172.21.15.102:0/2448928930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 msgr2=0x7f112c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 0x7f112c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112b7fe640 1 -- 172.21.15.102:0/2448928930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112c1a88e0 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112affd640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 0x7f112c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.813+0000 7f112bfff640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f112b7fe640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f111c00ba50 tx=0x7f111c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f1128ff9640 1 -- 172.21.15.102:0/2448928930 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c019070 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f112c1a8bd0 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f1128ff9640 1 -- 172.21.15.102:0/2448928930 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f111c00cbe0 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f1128ff9640 1 -- 172.21.15.102:0/2448928930 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111c0076e0 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.814+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f112c1a90e0 con 0x7f112c103b60 2024-09-21T03:37:38.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.816+0000 7f1128ff9640 1 -- 172.21.15.102:0/2448928930 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f111c01c070 con 0x7f112c103b60 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 Processor -- start 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 -- start start 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566945f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x5566945f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55669456cea0 con 0x55669424f070 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55669455c2d0 con 0x55669422e390 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f113860a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5566945600e0 con 0x5566942261b0 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46848/0 (socket says 172.21.15.102:46848) 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 -- 172.21.15.102:0/164349406 learned_addr learned my addr 172.21.15.102:0/164349406 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112b7fe640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566945f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f1128ff9640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 0x7f11140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112affd640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x5566945f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 -- 172.21.15.102:0/164349406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 msgr2=0x5566945f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566945f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 -- 172.21.15.102:0/164349406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 msgr2=0x5566945f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x5566945f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.817+0000 7f112bfff640 1 -- 172.21.15.102:0/164349406 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566942ba650 con 0x55669424f070 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f112affd640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x5566945f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f112bfff640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 0x7f11140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f1128ff9640 1 -- 172.21.15.102:0/2448928930 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f111c0e6e30 con 0x7f112c103b60 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f112bfff640 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d50 tx=0x7f112400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcab3fe0ab4bc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f1111ffb640 1 -- 172.21.15.102:0/164349406 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112400ed70 con 0x55669424f070 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f1111ffb640 1 -- 172.21.15.102:0/164349406 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1124011930 con 0x55669424f070 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f112bfff640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 0x7f11140b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f112401f000 tx=0x7f1124020000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.818+0000 7f1111ffb640 1 -- 172.21.15.102:0/164349406 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112401a9a0 con 0x55669424f070 2024-09-21T03:37:38.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- 172.21.15.102:0/164349406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 msgr2=0x5566945f62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1124009d50 tx=0x7f112400e6c0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- 172.21.15.102:0/164349406 shutdown_connections 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x5566945f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566945f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 --2- 172.21.15.102:0/164349406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x5566945f62c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- 172.21.15.102:0/164349406 >> 172.21.15.102:0/164349406 conn(0x556694243460 msgr2=0x5566945f41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- 172.21.15.102:0/164349406 shutdown_connections 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- 172.21.15.102:0/164349406 wait complete. 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.819+0000 7f113860a740 1 -- start start 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 Processor -- start 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566946019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x556694601ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5566943bd700 con 0x55669424f070 2024-09-21T03:37:38.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5566944f7160 con 0x55669422e390 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556694604aa0 con 0x5566942261b0 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f113860a740 10 client.0 _ll_register_callbacks cb 0x5566945109e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46852/0 (socket says 172.21.15.102:46852) 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 -- 172.21.15.102:0/4164865250 learned_addr learned my addr 172.21.15.102:0/4164865250 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112affd640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x556694601ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566946019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 -- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 msgr2=0x5566946019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566946019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 -- 172.21.15.102:0/4164865250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 msgr2=0x556694601ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x556694601ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.820+0000 7f112bfff640 1 -- 172.21.15.102:0/4164865250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556694524c90 con 0x55669424f070 2024-09-21T03:37:38.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f112bfff640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c00 tx=0x7f1124011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c9574d7de1341c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112400ed70 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f1124021030 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1124011930 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1124009850 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 10 client.16197 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5566946107e0 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1124011930 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f112400f040 con 0x55669424f070 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 10 client.16197 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 20 client.16197 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669420d9f0 0x556694613cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 4 client.16197 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:38.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.821+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55669456edf0 con 0x55669420d9f0 2024-09-21T03:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.822+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669420d9f0 0x556694613cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.822+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669420d9f0 0x556694613cb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82e241fb9d2d16ff server_cookie=85bc2b9e72b90c0a in_seq=0 out_seq=0 2024-09-21T03:37:38.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.822+0000 7f110affd640 10 client.16197 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f110affd640 1 -- 172.21.15.102:0/4164865250 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55669456edf0 con 0x55669420d9f0 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f110affd640 10 client.16197 handle_command_reply: tid=0 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 client.16197 shutdown 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 msgr2=0x55669460dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1124000c00 tx=0x7f1124011d60 comp rx=0 tx=0).stop 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 shutdown_connections 2024-09-21T03:37:38.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669420d9f0 0x556694613cb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f110affd640 0 client.16197 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55669424f070 0x55669460dd90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669422e390 0x556694601ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 --2- 172.21.15.102:0/4164865250 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5566942261b0 0x5566946019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 >> 172.21.15.102:0/4164865250 conn(0x556694243460 msgr2=0x5566945f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 shutdown_connections 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 1 -- 172.21.15.102:0/4164865250 wait complete. 2024-09-21T03:37:38.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.823+0000 7f113860a740 20 client.16197 trim_cache size 0 max 16384 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.836+0000 7f113860a740 1 Processor -- start 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.836+0000 7f113860a740 1 -- start start 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x5566945f9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x5566945f3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1b44c0 con 0x5566942261b0 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1b1cd0 con 0x55669420d9f0 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f113860a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1afb20 con 0x55669422e390 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46856/0 (socket says 172.21.15.102:46856) 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 -- 172.21.15.102:0/3465903256 learned_addr learned my addr 172.21.15.102:0/3465903256 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112bfff640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x5566945f3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112b7fe640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x5566945f9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 -- 172.21.15.102:0/3465903256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 msgr2=0x5566945f3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x5566945f3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 -- 172.21.15.102:0/3465903256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 msgr2=0x5566945f9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x5566945f9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 -- 172.21.15.102:0/3465903256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556694602c70 con 0x5566942261b0 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112b7fe640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x5566945f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.837+0000 7f112affd640 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f11200096c0 tx=0x7f1120032ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fa2e3eebff158c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f11117fa640 1 -- 172.21.15.102:0/3465903256 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120035040 con 0x5566942261b0 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f11117fa640 1 -- 172.21.15.102:0/3465903256 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11200318d0 con 0x5566942261b0 2024-09-21T03:37:38.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f11117fa640 1 -- 172.21.15.102:0/3465903256 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120004920 con 0x5566942261b0 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 -- 172.21.15.102:0/3465903256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 msgr2=0x55669460dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f11200096c0 tx=0x7f1120032ed0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 -- 172.21.15.102:0/3465903256 shutdown_connections 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x55669460dc90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x5566945f3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 --2- 172.21.15.102:0/3465903256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x5566945f9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 -- 172.21.15.102:0/3465903256 >> 172.21.15.102:0/3465903256 conn(0x556694243460 msgr2=0x5566945f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 -- 172.21.15.102:0/3465903256 shutdown_connections 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.838+0000 7f113860a740 1 -- 172.21.15.102:0/3465903256 wait complete. 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 -- start start 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 Processor -- start 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x55669460a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x556694606040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1b0190 con 0x5566942261b0 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1b1600 con 0x55669420d9f0 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f112c1b0860 con 0x55669422e390 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f113860a740 10 client.0 _ll_register_callbacks cb 0x7f112401e020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.839+0000 7f112affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46862/0 (socket says 172.21.15.102:46862) 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 -- 172.21.15.102:0/4011972372 learned_addr learned my addr 172.21.15.102:0/4011972372 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112bfff640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x556694606040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x55669460a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 -- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 msgr2=0x556694606040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x556694606040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 -- 172.21.15.102:0/4011972372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 msgr2=0x55669460a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x55669460a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 -- 172.21.15.102:0/4011972372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556694606820 con 0x5566942261b0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x55669460a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f112affd640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f112002a930 tx=0x7f1120003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5cfca2dc28d0ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f110affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1120035040 con 0x5566942261b0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f1120003c20 con 0x5566942261b0 2024-09-21T03:37:38.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11200318d0 con 0x5566942261b0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f1120005620 con 0x5566942261b0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f113860a740 10 client.16203 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.840+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55669467e510 con 0x5566942261b0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f11200318d0 con 0x5566942261b0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f112004e450 con 0x5566942261b0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 10 client.16203 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 20 client.16203 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669424f070 0x556694680c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 4 client.16203 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55669456a8a0 con 0x55669424f070 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.841+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669424f070 0x556694680c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f110affd640 10 client.16203 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f112b7fe640 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669424f070 0x556694680c30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a64fc6da65d3c0cc server_cookie=dfacdca31ce2e7b0 in_seq=0 out_seq=0 2024-09-21T03:37:38.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f110affd640 1 -- 172.21.15.102:0/4011972372 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55669456a8a0 con 0x55669424f070 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f110affd640 10 client.16203 handle_command_reply: tid=0 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 client.16203 shutdown 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 msgr2=0x556694605a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f112002a930 tx=0x7f1120003820 comp rx=0 tx=0).stop 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 shutdown_connections 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55669424f070 0x556694680c30 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5566942261b0 0x556694605a40 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55669422e390 0x556694606040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 --2- 172.21.15.102:0/4011972372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55669420d9f0 0x55669460a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 >> 172.21.15.102:0/4011972372 conn(0x556694243460 msgr2=0x5566945f3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f110affd640 0 client.16203 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 shutdown_connections 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 1 -- 172.21.15.102:0/4011972372 wait complete. 2024-09-21T03:37:38.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.842+0000 7f113860a740 20 client.16203 trim_cache size 0 max 16384 2024-09-21T03:37:38.850 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 msgr2=0x7f11140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 0x7f11140b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f112401f000 tx=0x7f1124020000 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 msgr2=0x7f112c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f111c00ba50 tx=0x7f111c00bf10 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 shutdown_connections 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f11140b6680 0x7f11140b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f112c109df0 0x7f112c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f112c1094a0 0x7f112c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 --2- 172.21.15.102:0/2448928930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f112c103b60 0x7f112c075710 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 >> 172.21.15.102:0/2448928930 conn(0x7f112c07b850 msgr2=0x7f112c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 shutdown_connections 2024-09-21T03:37:38.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:38.843+0000 7f1132096640 1 -- 172.21.15.102:0/2448928930 wait complete. 2024-09-21T03:37:39.646 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:39 smithi102 ceph-mon[31392]: pgmap v446: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:39.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:37:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:39 smithi148 ceph-mon[34651]: pgmap v446: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:39 smithi121 ceph-mon[34316]: pgmap v446: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:39.918 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 -- 172.21.15.102:0/2423681567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1083c0 msgr2=0x7f44fc1087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 --2- 172.21.15.102:0/2423681567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1083c0 0x7f44fc1087d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e802a410 comp rx=0 tx=0).stop 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 -- 172.21.15.102:0/2423681567 shutdown_connections 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 --2- 172.21.15.102:0/2423681567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc1083c0 0x7f44fc1087d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 --2- 172.21.15.102:0/2423681567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc108d10 0x7f44fc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 --2- 172.21.15.102:0/2423681567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc102a80 0x7f44fc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 -- 172.21.15.102:0/2423681567 >> 172.21.15.102:0/2423681567 conn(0x7f44fc079740 msgr2=0x7f44fc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 -- 172.21.15.102:0/2423681567 shutdown_connections 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.423+0000 7f45031c0640 1 -- 172.21.15.102:0/2423681567 wait complete. 2024-09-21T03:37:40.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 Processor -- start 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 -- start start 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc102a80 0x7f44fc19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc1083c0 0x7f44fc19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc113c50 con 0x7f44fc108d10 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc113ad0 con 0x7f44fc1083c0 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f45031c0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc113dd0 con 0x7f44fc102a80 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46884/0 (socket says 172.21.15.102:46884) 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.424+0000 7f450175d640 1 -- 172.21.15.102:0/3860243762 learned_addr learned my addr 172.21.15.102:0/3860243762 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc102a80 0x7f44fc19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f44fbfff640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc1083c0 0x7f44fc19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 -- 172.21.15.102:0/3860243762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc102a80 msgr2=0x7f44fc19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc102a80 0x7f44fc19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 -- 172.21.15.102:0/3860243762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc1083c0 msgr2=0x7f44fc19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc1083c0 0x7f44fc19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 -- 172.21.15.102:0/3860243762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44fc1a0690 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f450175d640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b970 tx=0x7f44f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f44f9ffb640 1 -- 172.21.15.102:0/3860243762 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4019070 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f44f9ffb640 1 -- 172.21.15.102:0/3860243762 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f400cb40 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44fc1a0980 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.425+0000 7f44f9ffb640 1 -- 172.21.15.102:0/3860243762 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f4007650 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.426+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44fc1a70e0 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 Processor -- start 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f44f9ffb640 1 -- 172.21.15.102:0/3860243762 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f44f401c070 con 0x7f44fc108d10 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 -- start start 2024-09-21T03:37:40.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c849b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c849bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5568c8411ea0 con 0x5568c80f4070 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5568c84012d0 con 0x5568c80d3390 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f4509734740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568c84050e0 con 0x5568c80cb1b0 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46898/0 (socket says 172.21.15.102:46898) 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f44fbfff640 1 -- 172.21.15.102:0/960061054 learned_addr learned my addr 172.21.15.102:0/960061054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.429+0000 7f44fbfff640 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c849bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f4500f5c640 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c849b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 -- 172.21.15.102:0/960061054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 msgr2=0x5568c849b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c849b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 -- 172.21.15.102:0/960061054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 msgr2=0x5568c849bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c849bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 -- 172.21.15.102:0/960061054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c815f650 con 0x5568c80f4070 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44f9ffb640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 0x7f44ec0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44fbfff640 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfe22f097598836 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 0x7f44ec0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44e6ffd640 1 -- 172.21.15.102:0/960061054 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8035040 con 0x5568c80f4070 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44f9ffb640 1 -- 172.21.15.102:0/3860243762 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44f40e6b60 con 0x7f44fc108d10 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44e6ffd640 1 -- 172.21.15.102:0/960061054 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44e80054f0 con 0x5568c80f4070 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.430+0000 7f44e6ffd640 1 -- 172.21.15.102:0/960061054 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8003850 con 0x5568c80f4070 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 -- 172.21.15.102:0/960061054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 msgr2=0x5568c849b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 0x7f44ec0b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5568c8499f40 tx=0x7f44f000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e8005fd0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 -- 172.21.15.102:0/960061054 shutdown_connections 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c849bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c849b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 --2- 172.21.15.102:0/960061054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c849b2c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 -- 172.21.15.102:0/960061054 >> 172.21.15.102:0/960061054 conn(0x5568c80e8460 msgr2=0x5568c84991b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 -- 172.21.15.102:0/960061054 shutdown_connections 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.431+0000 7f4509734740 1 -- 172.21.15.102:0/960061054 wait complete. 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 -- start start 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 Processor -- start 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80cb1b0 0x5568c84a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80d3390 0x5568c84a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5568c8262700 con 0x5568c80f4070 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5568c839c160 con 0x5568c80cb1b0 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5568c84a9a40 con 0x5568c80d3390 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4509734740 10 client.0 _ll_register_callbacks cb 0x5568c83b59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46912/0 (socket says 172.21.15.102:46912) 2024-09-21T03:37:40.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f450175d640 1 -- 172.21.15.102:0/1027613816 learned_addr learned my addr 172.21.15.102:0/1027613816 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f4500f5c640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80cb1b0 0x5568c84a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.432+0000 7f44fbfff640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80d3390 0x5568c84a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 -- 172.21.15.102:0/1027613816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80d3390 msgr2=0x5568c84a6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80d3390 0x5568c84a6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 -- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80cb1b0 msgr2=0x5568c84a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80cb1b0 0x5568c84a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 -- 172.21.15.102:0/1027613816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568c83c9c90 con 0x5568c80f4070 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f450175d640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f44f40ac9e0 tx=0x7f44f40ac950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4233e773b2a4d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40ac560 con 0x5568c80f4070 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44f40abec0 con 0x5568c80f4070 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44e80054f0 con 0x5568c80f4070 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44f40b1480 con 0x5568c80f4070 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f4509734740 10 client.16215 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:40.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568c84b5720 con 0x5568c80f4070 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44e80054f0 con 0x5568c80f4070 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.433+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f44f40ab720 con 0x5568c80f4070 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 10 client.16215 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 10 client.16215 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 20 client.16215 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c80b29f0 0x5568c84b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 4 client.16215 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568c8413df0 con 0x5568c80b29f0 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4500f5c640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c80b29f0 0x5568c84b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f44dbfff640 10 client.16215 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.434+0000 7f4500f5c640 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c80b29f0 0x5568c84b8c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d04f833267222a43 server_cookie=34789771e05bd613 in_seq=0 out_seq=0 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f44dbfff640 1 -- 172.21.15.102:0/1027613816 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568c8413df0 con 0x5568c80b29f0 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f44dbfff640 10 client.16215 handle_command_reply: tid=0 2024-09-21T03:37:40.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 client.16215 shutdown 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 msgr2=0x5568c84b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f44f40ac9e0 tx=0x7f44f40ac950 comp rx=0 tx=0).stop 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 shutdown_connections 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c80b29f0 0x5568c84b8c80 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c84b2d30 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80d3390 0x5568c84a6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f44dbfff640 0 client.16215 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 --2- 172.21.15.102:0/1027613816 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80cb1b0 0x5568c84a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 >> 172.21.15.102:0/1027613816 conn(0x5568c80e8460 msgr2=0x5568c849e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 shutdown_connections 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 1 -- 172.21.15.102:0/1027613816 wait complete. 2024-09-21T03:37:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.435+0000 7f4509734740 20 client.16215 trim_cache size 0 max 16384 2024-09-21T03:37:40.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.455+0000 7f4509734740 1 Processor -- start 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 -- start start 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84a5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c84a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1b2220 con 0x5568c80f4070 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1afa30 con 0x5568c80d3390 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4509734740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ad880 con 0x5568c80cb1b0 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46920/0 (socket says 172.21.15.102:46920) 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 -- 172.21.15.102:0/2189438935 learned_addr learned my addr 172.21.15.102:0/2189438935 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f4500f5c640 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f44fbfff640 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c84a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 -- 172.21.15.102:0/2189438935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 msgr2=0x5568c84a5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84a5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 -- 172.21.15.102:0/2189438935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 msgr2=0x5568c84a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c84a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.456+0000 7f450175d640 1 -- 172.21.15.102:0/2189438935 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568c849e120 con 0x5568c80f4070 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.457+0000 7f450175d640 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44f40e6e80 tx=0x7f44f40c3f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e57d322566e624f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.457+0000 7f44e67fc640 1 -- 172.21.15.102:0/2189438935 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40ac1c0 con 0x5568c80f4070 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.457+0000 7f44e67fc640 1 -- 172.21.15.102:0/2189438935 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f40ac560 con 0x5568c80f4070 2024-09-21T03:37:40.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.457+0000 7f44e67fc640 1 -- 172.21.15.102:0/2189438935 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f40090a0 con 0x5568c80f4070 2024-09-21T03:37:40.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- 172.21.15.102:0/2189438935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 msgr2=0x5568c8498760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f44f40e6e80 tx=0x7f44f40c3f90 comp rx=0 tx=0).stop 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- 172.21.15.102:0/2189438935 shutdown_connections 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80f4070 0x5568c8498760 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80d3390 0x5568c84a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 --2- 172.21.15.102:0/2189438935 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84a5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- 172.21.15.102:0/2189438935 >> 172.21.15.102:0/2189438935 conn(0x5568c80e8460 msgr2=0x5568c84a7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- 172.21.15.102:0/2189438935 shutdown_connections 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- 172.21.15.102:0/2189438935 wait complete. 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 -- start start 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.458+0000 7f4509734740 1 Processor -- start 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80f4070 0x5568c84ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1adef0 con 0x5568c80d3390 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1af360 con 0x5568c80f4070 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f44fc1ae5c0 con 0x5568c80cb1b0 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4509734740 10 client.0 _ll_register_callbacks cb 0x7f44f000b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46932/0 (socket says 172.21.15.102:46932) 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 -- 172.21.15.102:0/3377874914 learned_addr learned my addr 172.21.15.102:0/3377874914 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f450175d640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80f4070 0x5568c84ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 -- 172.21.15.102:0/3377874914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 msgr2=0x5568c84af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 -- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80f4070 msgr2=0x5568c84ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80f4070 0x5568c84ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 -- 172.21.15.102:0/3377874914 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568c85226d0 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44fbfff640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e8005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791e48de820cb04c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.459+0000 7f44dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8035040 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44f40ac560 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f44e80046c0 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f44e80048c0 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 10 client.16221 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5568c85237a0 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f44f40ac560 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f44e8031510 con 0x5568c80d3390 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 10 client.16221 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 20 client.16221 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c8087da0 0x5568c8525ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 4 client.16221 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568c840f8a0 con 0x5568c8087da0 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.460+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c8087da0 0x5568c8525ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4500f5c640 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c8087da0 0x5568c8525ac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9a2916a596a53e4 server_cookie=ad46154cf32acaf in_seq=0 out_seq=0 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f44dbfff640 10 client.16221 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f44dbfff640 1 -- 172.21.15.102:0/3377874914 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568c840f8a0 con 0x5568c8087da0 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f44dbfff640 10 client.16221 handle_command_reply: tid=0 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 client.16221 shutdown 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 msgr2=0x5568c84aaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f44e8009900 tx=0x7f44e8005270 comp rx=0 tx=0).stop 2024-09-21T03:37:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 shutdown_connections 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5568c8087da0 0x5568c8525ac0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5568c80d3390 0x5568c84aaab0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5568c80f4070 0x5568c84ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 --2- 172.21.15.102:0/3377874914 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5568c80cb1b0 0x5568c84af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 >> 172.21.15.102:0/3377874914 conn(0x5568c80e8460 msgr2=0x5568c84a87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f44dbfff640 0 client.16221 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 shutdown_connections 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.461+0000 7f4509734740 1 -- 172.21.15.102:0/3377874914 wait complete. 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f4509734740 20 client.16221 trim_cache size 0 max 16384 2024-09-21T03:37:40.468 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 msgr2=0x7f44ec0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 0x7f44ec0b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5568c8499f40 tx=0x7f44f000b390 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 msgr2=0x7f44fc19ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f44f400b970 tx=0x7f44f400be30 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 shutdown_connections 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f44ec0b6700 0x7f44ec0b8c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f44fc108d10 0x7f44fc19ff60 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f44fc1083c0 0x7f44fc19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 --2- 172.21.15.102:0/3860243762 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f44fc102a80 0x7f44fc19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 >> 172.21.15.102:0/3860243762 conn(0x7f44fc079740 msgr2=0x7f44fc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:40.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 shutdown_connections 2024-09-21T03:37:40.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:40.462+0000 7f45031c0640 1 -- 172.21.15.102:0/3860243762 wait complete. 2024-09-21T03:37:41.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:37:41.501 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:41.621 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:41 smithi102 ceph-mon[31392]: pgmap v447: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:41 smithi148 ceph-mon[34651]: pgmap v447: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:41 smithi121 ceph-mon[34316]: pgmap v447: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916884806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 msgr2=0x7f2eac102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916884806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac102e90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009900 tx=0x7f2ea802a410 comp rx=0 tx=0).stop 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916884806 shutdown_connections 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916884806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 0x7f2eac10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916884806 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 0x7f2eac1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916884806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac102e90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916884806 >> 172.21.15.102:0/1916884806 conn(0x7f2eac079740 msgr2=0x7f2eac079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.985+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916884806 shutdown_connections 2024-09-21T03:37:41.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.986+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916884806 wait complete. 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.986+0000 7f2eb4502640 1 Processor -- start 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.986+0000 7f2eb4502640 1 -- start start 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 0x7f2eac19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 0x7f2eac19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac112ac0 con 0x7f2eac102a80 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac112940 con 0x7f2eac108d10 2024-09-21T03:37:41.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb4502640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac112c40 con 0x7f2eac1083c0 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46964/0 (socket says 172.21.15.102:46964) 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 -- 172.21.15.102:0/1916286732 learned_addr learned my addr 172.21.15.102:0/1916286732 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 0x7f2eac19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 0x7f2eac19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 -- 172.21.15.102:0/1916286732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 msgr2=0x7f2eac19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 0x7f2eac19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 -- 172.21.15.102:0/1916286732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 msgr2=0x7f2eac19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 0x7f2eac19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 -- 172.21.15.102:0/1916286732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eac1a6660 con 0x7f2eac102a80 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.987+0000 7f2eb229e640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8005ab0 tx=0x7f2ea80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.988+0000 7f2e9f7fe640 1 -- 172.21.15.102:0/1916286732 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea803f030 con 0x7f2eac102a80 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.988+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eac1a68f0 con 0x7f2eac102a80 2024-09-21T03:37:41.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.988+0000 7f2e9f7fe640 1 -- 172.21.15.102:0/1916286732 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea8003cd0 con 0x7f2eac102a80 2024-09-21T03:37:41.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.988+0000 7f2e9f7fe640 1 -- 172.21.15.102:0/1916286732 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8035070 con 0x7f2eac102a80 2024-09-21T03:37:41.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.988+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eac1a6dd0 con 0x7f2eac102a80 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.990+0000 7f2ebaa76740 1 Processor -- start 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 -- start start 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2e9f7fe640 1 -- 172.21.15.102:0/1916286732 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f2ea8042030 con 0x7f2eac102a80 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aeb62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aeb6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c70ae2cea0 con 0x55c70aaee390 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c70ae1c2d0 con 0x55c70ab0f070 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c70ae200e0 con 0x55c70aae61b0 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46966/0 (socket says 172.21.15.102:46966) 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/1455326228 learned_addr learned my addr 172.21.15.102:0/1455326228 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aeb62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.991+0000 7f2eb229e640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aeb6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/1455326228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 msgr2=0x55c70aeb6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aeb6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/1455326228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 msgr2=0x55c70aeb62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aeb62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/1455326228 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70ab7a650 con 0x55c70aaee390 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb229e640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aeb6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aeb62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:37:41.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000b6c0 tx=0x7f2ea000bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cea03761b70a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2e9f7fe640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2e9cff9640 1 -- 172.21.15.102:0/1455326228 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003b70 con 0x55c70aaee390 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2e9cff9640 1 -- 172.21.15.102:0/1455326228 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2e9cff9640 1 -- 172.21.15.102:0/1455326228 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0004d00 con 0x55c70aaee390 2024-09-21T03:37:41.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.992+0000 7f2e9f7fe640 1 -- 172.21.15.102:0/1916286732 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2ea8107b90 con 0x7f2eac102a80 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 -- 172.21.15.102:0/1455326228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 msgr2=0x55c70aeb6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 0x7f2e980b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005fd0 tx=0x7f2ea40096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000b6c0 tx=0x7f2ea000bb80 comp rx=0 tx=0).stop 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 -- 172.21.15.102:0/1455326228 shutdown_connections 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aeb6d40 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aeb6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/1455326228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aeb62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 -- 172.21.15.102:0/1455326228 >> 172.21.15.102:0/1455326228 conn(0x55c70ab03460 msgr2=0x55c70aeb41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 -- 172.21.15.102:0/1455326228 shutdown_connections 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.993+0000 7f2ebaa76740 1 -- 172.21.15.102:0/1455326228 wait complete. 2024-09-21T03:37:41.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 -- start start 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 Processor -- start 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aec5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aed2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c70ac7d700 con 0x55c70aaee390 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c70adb7160 con 0x55c70ab0f070 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c70aec8e00 con 0x55c70aae61b0 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2ebaa76740 10 client.0 _ll_register_callbacks cb 0x55c70add09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46980/0 (socket says 172.21.15.102:46980) 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/2360210443 learned_addr learned my addr 172.21.15.102:0/2360210443 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb229e640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aec5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aed2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 msgr2=0x55c70aec5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aec5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/2360210443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 msgr2=0x55c70aed2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aed2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/2360210443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70ade4c90 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.994+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aed2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0004880 tx=0x7f2ea0003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431302e91dfd5dc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0028060 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2ea0011650 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ea0011850 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2ebaa76740 10 client.16233 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c70aed4b10 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ea0022070 con 0x55c70aaee390 2024-09-21T03:37:42.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2ebaa76740 10 client.16233 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.995+0000 7f2ebaa76740 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2ebaa76740 20 client.16233 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aacd9f0 0x55c70aed7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2ebaa76740 4 client.16233 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c70ae2edf0 con 0x55c70aacd9f0 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2eb229e640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aacd9f0 0x55c70aed7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2eb229e640 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aacd9f0 0x55c70aed7f20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0a5a86d7515cc9a server_cookie=c7ff5f227d83851c in_seq=0 out_seq=0 2024-09-21T03:37:42.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.996+0000 7f2e95ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.997+0000 7f2e95ffb640 1 -- 172.21.15.102:0/2360210443 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c70ae2edf0 con 0x55c70aacd9f0 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.997+0000 7f2e95ffb640 10 client.16233 handle_command_reply: tid=0 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.997+0000 7f2ebaa76740 1 client.16233 shutdown 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.997+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 msgr2=0x55c70aec62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.997+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0004880 tx=0x7f2ea0003da0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 shutdown_connections 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aacd9f0 0x55c70aed7f20 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec62c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aed2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/2360210443 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aec5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 >> 172.21.15.102:0/2360210443 conn(0x55c70ab03460 msgr2=0x55c70aeb7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2e95ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 shutdown_connections 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 1 -- 172.21.15.102:0/2360210443 wait complete. 2024-09-21T03:37:42.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:41.998+0000 7f2ebaa76740 20 client.16233 trim_cache size 0 max 16384 2024-09-21T03:37:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 Processor -- start 2024-09-21T03:37:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 -- start start 2024-09-21T03:37:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aed20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aec6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1affd0 con 0x55c70aaee390 2024-09-21T03:37:42.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1ad7e0 con 0x55c70ab0f070 2024-09-21T03:37:42.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1ab630 con 0x55c70aae61b0 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46984/0 (socket says 172.21.15.102:46984) 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/938350563 learned_addr learned my addr 172.21.15.102:0/938350563 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aec6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/938350563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 msgr2=0x55c70aed20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb229e640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aed20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aed20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/938350563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 msgr2=0x55c70aec6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aec6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/938350563 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c70aeb7100 con 0x55c70aaee390 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.011+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aec6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0019ba0 tx=0x7f2ea0003e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8825c3c0aea4f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2e97fff640 1 -- 172.21.15.102:0/938350563 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0028040 con 0x55c70aaee390 2024-09-21T03:37:42.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2e97fff640 1 -- 172.21.15.102:0/938350563 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2e97fff640 1 -- 172.21.15.102:0/938350563 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0019680 con 0x55c70aaee390 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2ebaa76740 1 -- 172.21.15.102:0/938350563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 msgr2=0x55c70aec5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.012+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0019ba0 tx=0x7f2ea0003e10 comp rx=0 tx=0).stop 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- 172.21.15.102:0/938350563 shutdown_connections 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aec5b30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70ab0f070 0x55c70aec6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/938350563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70aae61b0 0x55c70aed20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- 172.21.15.102:0/938350563 >> 172.21.15.102:0/938350563 conn(0x55c70ab03460 msgr2=0x55c70aec4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- 172.21.15.102:0/938350563 shutdown_connections 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- 172.21.15.102:0/938350563 wait complete. 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- start start 2024-09-21T03:37:42.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 Processor -- start 2024-09-21T03:37:42.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 0x55c70aedb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 0x55c70aed8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1abca0 con 0x55c70aaee390 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1ad110 con 0x55c70aae61b0 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2eac1ac370 con 0x55c70ab0f070 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2ebaa76740 10 client.0 _ll_register_callbacks cb 0x7f2ea4009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2eb1a9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46998/0 (socket says 172.21.15.102:46998) 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.013+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/4195912245 learned_addr learned my addr 172.21.15.102:0/4195912245 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb229e640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 0x55c70aedb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 0x55c70aed8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 msgr2=0x55c70aed8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 0x55c70aed8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/4195912245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 msgr2=0x55c70aedb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 0x55c70aedb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 -- 172.21.15.102:0/4195912245 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c70aed9490 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb2a9f640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 0x55c70aed8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb229e640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 0x55c70aedb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2eb1a9d640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0014040 tx=0x7f2ea000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd3fcbac5c4878 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2e95ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0028030 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2ea0019420 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ea00039c0 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2ebaa76740 10 client.16239 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.014+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c70af423c0 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2ea0015070 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ea0022070 con 0x55c70aaee390 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 10 client.16239 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:42.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 20 client.16239 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aaa2da0 0x55c70af44b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 4 client.16239 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c70ae2a8a0 con 0x55c70aaa2da0 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2eb229e640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aaa2da0 0x55c70af44b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2e95ffb640 10 client.16239 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.015+0000 7f2eb229e640 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aaa2da0 0x55c70af44b20 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a70fedf574cf6a server_cookie=7c137061d024357 in_seq=0 out_seq=0 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2e95ffb640 1 -- 172.21.15.102:0/4195912245 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c70ae2a8a0 con 0x55c70aaa2da0 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2e95ffb640 10 client.16239 handle_command_reply: tid=0 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 client.16239 shutdown 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 msgr2=0x55c70aed89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0014040 tx=0x7f2ea000bee0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 shutdown_connections 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c70aaa2da0 0x55c70af44b20 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c70aaee390 0x55c70aed89e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2e95ffb640 0 client.16239 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c70ab0f070 0x55c70aed8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 --2- 172.21.15.102:0/4195912245 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c70aae61b0 0x55c70aedb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 >> 172.21.15.102:0/4195912245 conn(0x55c70ab03460 msgr2=0x55c70aec4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 shutdown_connections 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 1 -- 172.21.15.102:0/4195912245 wait complete. 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.016+0000 7f2ebaa76740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T03:37:42.024 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 msgr2=0x7f2e980b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 0x7f2e980b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4005fd0 tx=0x7f2ea40096a0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 msgr2=0x7f2eac19b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8005ab0 tx=0x7f2ea80042f0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 shutdown_connections 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e980b66b0 0x7f2e980b8bc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2eac108d10 0x7f2eac19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2eac1083c0 0x7f2eac19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 --2- 172.21.15.102:0/1916286732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2eac102a80 0x7f2eac19b3d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 >> 172.21.15.102:0/1916286732 conn(0x7f2eac079740 msgr2=0x7f2eac1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 shutdown_connections 2024-09-21T03:37:42.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:42.017+0000 7f2eb4502640 1 -- 172.21.15.102:0/1916286732 wait complete. 2024-09-21T03:37:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:43 smithi102 ceph-mon[31392]: pgmap v448: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:43 smithi148 ceph-mon[34651]: pgmap v448: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:43 smithi121 ceph-mon[34316]: pgmap v448: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:37:43.830 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:37:43.830 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:37:44.097 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:44.505 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:44 smithi102 ceph-mon[31392]: pgmap v449: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 -- 172.21.15.102:0/615545127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 msgr2=0x7f5ee8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/615545127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8103f70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009900 tx=0x7f5ed802a410 comp rx=0 tx=0).stop 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 -- 172.21.15.102:0/615545127 shutdown_connections 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/615545127 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 0x7f5ee8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/615545127 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/615545127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8103f70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 -- 172.21.15.102:0/615545127 >> 172.21.15.102:0/615545127 conn(0x7f5ee807b850 msgr2=0x7f5ee807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 -- 172.21.15.102:0/615545127 shutdown_connections 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.596+0000 7f5eeefa4640 1 -- 172.21.15.102:0/615545127 wait complete. 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 Processor -- start 2024-09-21T03:37:44.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 -- start start 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 0x7f5ee8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113bd0 con 0x7f5ee8103b60 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113a50 con 0x7f5ee8109df0 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eeefa4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee8113d50 con 0x7f5ee81094a0 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33196/0 (socket says 172.21.15.102:33196) 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 -- 172.21.15.102:0/1028184491 learned_addr learned my addr 172.21.15.102:0/1028184491 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eed541640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 0x7f5ee8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 -- 172.21.15.102:0/1028184491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 msgr2=0x7f5ee8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 -- 172.21.15.102:0/1028184491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 msgr2=0x7f5ee8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 0x7f5ee8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 -- 172.21.15.102:0/1028184491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee81a87b0 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.597+0000 7f5eecd40640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006010 tx=0x7f5ed8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.598+0000 7f5ee5ffb640 1 -- 172.21.15.102:0/1028184491 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed803f070 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.598+0000 7f5ee5ffb640 1 -- 172.21.15.102:0/1028184491 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ed8031e10 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.598+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee81a8a40 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.598+0000 7f5ee5ffb640 1 -- 172.21.15.102:0/1028184491 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8035030 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.598+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee81a8f70 con 0x7f5ee8103b60 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 Processor -- start 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 -- start start 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab825430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab825970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fbab79be60 con 0x55fbab455490 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fbab78b290 con 0x55fbab45d670 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ef5518740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fbab78f0a0 con 0x55fbab47e350 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.601+0000 7f5ee5ffb640 1 -- 172.21.15.102:0/1028184491 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f5ed8042070 con 0x7f5ee8103b60 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5eed541640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab825430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5eecd40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab825970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:52638/0 (socket says 172.21.15.102:52638) 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5eed541640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab825430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:45998/0 (socket says 172.21.15.102:45998) 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 -- 172.21.15.102:0/2441055394 learned_addr learned my addr 172.21.15.102:0/2441055394 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 -- 172.21.15.102:0/2441055394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 msgr2=0x55fbab825430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab825430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 -- 172.21.15.102:0/2441055394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 msgr2=0x55fbab825970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab825970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 -- 172.21.15.102:0/2441055394 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbab4e9930 con 0x55fbab45d670 2024-09-21T03:37:44.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00cc00 tx=0x7f5edc00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6eb76107d7aade20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5ee5ffb640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 0x7f5ed00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5eceffd640 1 -- 172.21.15.102:0/2441055394 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc005220 con 0x55fbab45d670 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.602+0000 7f5eceffd640 1 -- 172.21.15.102:0/2441055394 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5edc004c70 con 0x55fbab45d670 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.603+0000 7f5eed541640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 0x7f5ed00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.603+0000 7f5eceffd640 1 -- 172.21.15.102:0/2441055394 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5edc010790 con 0x55fbab45d670 2024-09-21T03:37:44.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.603+0000 7f5ee5ffb640 1 -- 172.21.15.102:0/1028184491 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5ed81080e0 con 0x7f5ee8103b60 2024-09-21T03:37:44.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- 172.21.15.102:0/2441055394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 msgr2=0x55fbab825eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5eed541640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 0x7f5ed00b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0007f80 tx=0x7f5ee0007520 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00cc00 tx=0x7f5edc00e720 comp rx=0 tx=0).stop 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- 172.21.15.102:0/2441055394 shutdown_connections 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab825970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab825eb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2441055394 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab825430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- 172.21.15.102:0/2441055394 >> 172.21.15.102:0/2441055394 conn(0x55fbab472740 msgr2=0x55fbab823320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- 172.21.15.102:0/2441055394 shutdown_connections 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- 172.21.15.102:0/2441055394 wait complete. 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 -- start start 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.604+0000 7f5ef5518740 1 Processor -- start 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab831450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab83cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fbab5ec890 con 0x55fbab455490 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fbab725d40 con 0x55fbab45d670 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fbab833c10 con 0x55fbab47e350 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ef5518740 10 client.0 _ll_register_callbacks cb 0x55fbab789c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33214/0 (socket says 172.21.15.102:33214) 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 -- 172.21.15.102:0/3362787184 learned_addr learned my addr 172.21.15.102:0/3362787184 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab831450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eed541640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab83cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 -- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 msgr2=0x55fbab83cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab83cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 -- 172.21.15.102:0/3362787184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 msgr2=0x55fbab831450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab831450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 -- 172.21.15.102:0/3362787184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbab83d440 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eed541640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab83cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5eecd40640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5ed804a000 tx=0x7f5ed803b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f7168931f8b2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.605+0000 7f5ec7fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8049070 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5ed80d74b0 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5edc004c70 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ed80c9dc0 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 10 client.16251 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fbab83fd20 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5edc004c70 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5ed80b50d0 con 0x55fbab455490 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 10 client.16251 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:44.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 20 client.16251 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab43ccd0 0x55fbab8431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 4 client.16251 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.606+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbab79ddb0 con 0x55fbab43ccd0 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.607+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab43ccd0 0x55fbab8431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.607+0000 7f5ec7fff640 10 client.16251 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.607+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab43ccd0 0x55fbab8431f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec63cc3ce660053f server_cookie=b209ed3e8b485361 in_seq=0 out_seq=0 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ec7fff640 1 -- 172.21.15.102:0/3362787184 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fbab79ddb0 con 0x55fbab43ccd0 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ec7fff640 10 client.16251 handle_command_reply: tid=0 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 client.16251 shutdown 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 msgr2=0x55fbab830f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5ed804a000 tx=0x7f5ed803b6e0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 shutdown_connections 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab47e350 0x55fbab83cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab45d670 0x55fbab831450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab43ccd0 0x55fbab8431f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 --2- 172.21.15.102:0/3362787184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab830f10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ec7fff640 0 client.16251 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 >> 172.21.15.102:0/3362787184 conn(0x55fbab472740 msgr2=0x55fbab8285c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 shutdown_connections 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.608+0000 7f5ef5518740 1 -- 172.21.15.102:0/3362787184 wait complete. 2024-09-21T03:37:44.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.609+0000 7f5ef5518740 20 client.16251 trim_cache size 0 max 16384 2024-09-21T03:37:44.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 Processor -- start 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 -- start start 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab472740 0x55fbab82b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab826b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81b4250 con 0x55fbab455490 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81b1a60 con 0x55fbab43ccd0 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ef5518740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81af8b0 con 0x55fbab472740 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33218/0 (socket says 172.21.15.102:33218) 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 -- 172.21.15.102:0/1181037259 learned_addr learned my addr 172.21.15.102:0/1181037259 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eecd40640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab472740 0x55fbab82b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab826b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 -- 172.21.15.102:0/1181037259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab472740 msgr2=0x55fbab82b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab472740 0x55fbab82b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 -- 172.21.15.102:0/1181037259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 msgr2=0x55fbab826b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.626+0000 7f5eed541640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab826b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5eed541640 1 -- 172.21.15.102:0/1181037259 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbab82fc70 con 0x55fbab455490 2024-09-21T03:37:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab826b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:44.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5eed541640 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011010 tx=0x7f5ee0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d13122149cbd8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5ece7fc640 1 -- 172.21.15.102:0/1181037259 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee002b070 con 0x55fbab455490 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5ece7fc640 1 -- 172.21.15.102:0/1181037259 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ee000fdf0 con 0x55fbab455490 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.627+0000 7f5ece7fc640 1 -- 172.21.15.102:0/1181037259 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0026990 con 0x55fbab455490 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- 172.21.15.102:0/1181037259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 msgr2=0x55fbab82df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0011010 tx=0x7f5ee0015000 comp rx=0 tx=0).stop 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- 172.21.15.102:0/1181037259 shutdown_connections 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab455490 0x55fbab82df00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab826b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 --2- 172.21.15.102:0/1181037259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab472740 0x55fbab82b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- 172.21.15.102:0/1181037259 >> 172.21.15.102:0/1181037259 conn(0x55fbab8315d0 msgr2=0x55fbab826460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- 172.21.15.102:0/1181037259 shutdown_connections 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- 172.21.15.102:0/1181037259 wait complete. 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 -- start start 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.628+0000 7f5ef5518740 1 Processor -- start 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab8394b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 0x55fbab835970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81aff20 con 0x55fbab472740 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81b1390 con 0x55fbab43ccd0 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee81b05f0 con 0x55fbab455490 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ef5518740 10 client.0 _ll_register_callbacks cb 0x7f5ed810b920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ee7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 0x55fbab835970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33224/0 (socket says 172.21.15.102:33224) 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 -- 172.21.15.102:0/2361852472 learned_addr learned my addr 172.21.15.102:0/2361852472 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eecd40640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab8394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 -- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 msgr2=0x55fbab835970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 0x55fbab835970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 -- 172.21.15.102:0/2361852472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 msgr2=0x55fbab8394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab8394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 -- 172.21.15.102:0/2361852472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbab8364a0 con 0x55fbab472740 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eecd40640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab8394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ee7fff640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 0x55fbab835970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5eed541640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000ffe0 tx=0x7f5ee001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0f6a00b5b6987b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.629+0000 7f5ec7fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee002b030 con 0x55fbab472740 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f5ee0023040 con 0x55fbab472740 2024-09-21T03:37:44.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ee000fdf0 con 0x55fbab472740 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5ee000fb30 con 0x55fbab472740 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fbab8ae910 con 0x55fbab472740 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5ee000fdf0 con 0x55fbab472740 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f5ee0005040 con 0x55fbab472740 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 10 client.16257 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 20 client.16257 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab45d670 0x55fbab8b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 4 client.16257 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.630+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fbab799860 con 0x55fbab45d670 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.631+0000 7f5eecd40640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab45d670 0x55fbab8b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:44.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.631+0000 7f5ec7fff640 10 client.16257 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.631+0000 7f5eecd40640 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab45d670 0x55fbab8b1110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f4103fd2dd7fc9e server_cookie=e6e337e6834cdb19 in_seq=0 out_seq=0 2024-09-21T03:37:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ec7fff640 1 -- 172.21.15.102:0/2361852472 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbab799860 con 0x55fbab45d670 2024-09-21T03:37:44.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ec7fff640 10 client.16257 handle_command_reply: tid=0 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 client.16257 shutdown 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 msgr2=0x55fbab835eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000ffe0 tx=0x7f5ee001d380 comp rx=0 tx=0).stop 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 shutdown_connections 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55fbab45d670 0x55fbab8b1110 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ec7fff640 0 client.16257 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fbab472740 0x55fbab835eb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fbab455490 0x55fbab835970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 --2- 172.21.15.102:0/2361852472 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fbab43ccd0 0x55fbab8394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 >> 172.21.15.102:0/2361852472 conn(0x55fbab8315d0 msgr2=0x55fbab831fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 shutdown_connections 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 1 -- 172.21.15.102:0/2361852472 wait complete. 2024-09-21T03:37:44.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.633+0000 7f5ef5518740 20 client.16257 trim_cache size 0 max 16384 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "c875cda8-19d4-4e15-a058-ce0806c690fa", 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 msgr2=0x7f5ed00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 0x7f5ed00b8c10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0007f80 tx=0x7f5ee0007520 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 msgr2=0x7f5ee8075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8006010 tx=0x7f5ed8004430 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 shutdown_connections 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5ed00b6700 0x7f5ed00b8c10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ee8109df0 0x7f5ee8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5ee81094a0 0x7f5ee8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 --2- 172.21.15.102:0/1028184491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5ee8103b60 0x7f5ee8075710 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 >> 172.21.15.102:0/1028184491 conn(0x7f5ee807b850 msgr2=0x7f5ee8107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 shutdown_connections 2024-09-21T03:37:44.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:44.634+0000 7f5eeefa4640 1 -- 172.21.15.102:0/1028184491 wait complete. 2024-09-21T03:37:44.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:44 smithi148 ceph-mon[34651]: pgmap v449: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:44 smithi121 ceph-mon[34316]: pgmap v449: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-09-21T03:37:45.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:37:45.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:45 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:37:45.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:45 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:45.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:45 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:37:45.711 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:37:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:45 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:37:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:45 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:45 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:37:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:45 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:37:45.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:45 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:45.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:45 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 -- 172.21.15.102:0/3362467961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4108730 msgr2=0x7fa2b4108b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/3362467961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4108730 0x7fa2b4108b40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4009cd0 tx=0x7fa2a402a8e0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 -- 172.21.15.102:0/3362467961 shutdown_connections 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/3362467961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4102770 0x7fa2b41105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/3362467961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4101e20 0x7fa2b4102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/3362467961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4108730 0x7fa2b4108b40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 -- 172.21.15.102:0/3362467961 >> 172.21.15.102:0/3362467961 conn(0x7fa2b4077cc0 msgr2=0x7fa2b4078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 -- 172.21.15.102:0/3362467961 shutdown_connections 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.246+0000 7fa2b8a20640 1 -- 172.21.15.102:0/3362467961 wait complete. 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 Processor -- start 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 -- start start 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4102770 0x7fa2b4103590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 0x7fa2b4103ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b4113c50 con 0x7fa2b4101e20 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b4113ad0 con 0x7fa2b4108730 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b8a20640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b4113dd0 con 0x7fa2b4102770 2024-09-21T03:37:46.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33240/0 (socket says 172.21.15.102:33240) 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 -- 172.21.15.102:0/1139606826 learned_addr learned my addr 172.21.15.102:0/1139606826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 0x7fa2b4103ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4102770 0x7fa2b4103590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 -- 172.21.15.102:0/1139606826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4102770 msgr2=0x7fa2b4103590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4102770 0x7fa2b4103590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 -- 172.21.15.102:0/1139606826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 msgr2=0x7fa2b4103ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 0x7fa2b4103ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b259c640 1 -- 172.21.15.102:0/1139606826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b41a88d0 con 0x7fa2b4101e20 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.247+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 0x7fa2b4103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2b259c640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4031e90 tx=0x7fa2a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2a37fe640 1 -- 172.21.15.102:0/1139606826 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4004450 con 0x7fa2b4101e20 2024-09-21T03:37:46.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b41a8b60 con 0x7fa2b4101e20 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2a37fe640 1 -- 172.21.15.102:0/1139606826 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2a4003e30 con 0x7fa2b4101e20 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2a37fe640 1 -- 172.21.15.102:0/1139606826 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4045670 con 0x7fa2b4101e20 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.248+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b41a90f0 con 0x7fa2b4101e20 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.250+0000 7fa2bef94740 1 Processor -- start 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 -- start start 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2a37fe640 1 -- 172.21.15.102:0/1139606826 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa2a4043020 con 0x7fa2b4101e20 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdc77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9ff390 0x55ffccdc7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ffccd3de50 con 0x55ffcca20070 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ffccd2d280 con 0x55ffcc9ff390 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2bef94740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ffccd31090 con 0x55ffcc9f71b0 2024-09-21T03:37:46.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33250/0 (socket says 172.21.15.102:33250) 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/3939517599 learned_addr learned my addr 172.21.15.102:0/3939517599 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9ff390 0x55ffccdc7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b259c640 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdc77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/3939517599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 msgr2=0x55ffccdc77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdc77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/3939517599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9ff390 msgr2=0x55ffccdc7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9ff390 0x55ffccdc7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.251+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/3939517599 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffcca8b650 con 0x55ffcca20070 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007800 tx=0x7fa2ac007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de101cfc6fcb28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2a37fe640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 0x7fa29c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2b259c640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 0x7fa29c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2a0ff9640 1 -- 172.21.15.102:0/3939517599 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac00d950 con 0x55ffcca20070 2024-09-21T03:37:46.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2a0ff9640 1 -- 172.21.15.102:0/3939517599 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2ac018070 con 0x55ffcca20070 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2a0ff9640 1 -- 172.21.15.102:0/3939517599 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0123e0 con 0x55ffcca20070 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.252+0000 7fa2a37fe640 1 -- 172.21.15.102:0/1139606826 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa2a402e030 con 0x7fa2b4101e20 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- 172.21.15.102:0/3939517599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 msgr2=0x55ffccdc7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2b259c640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 0x7fa29c0b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2a41061c0 tx=0x7fa2a404d000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007800 tx=0x7fa2ac007cc0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- 172.21.15.102:0/3939517599 shutdown_connections 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9ff390 0x55ffccdc7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdc77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3939517599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdc7270 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- 172.21.15.102:0/3939517599 >> 172.21.15.102:0/3939517599 conn(0x55ffcca14460 msgr2=0x55ffccdc5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- 172.21.15.102:0/3939517599 shutdown_connections 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- 172.21.15.102:0/3939517599 wait complete. 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 -- start start 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.253+0000 7fa2bef94740 1 Processor -- start 2024-09-21T03:37:46.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdd2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ffccb8e700 con 0x55ffcca20070 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ffcccc8110 con 0x55ffcc9f71b0 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ffccdd5a50 con 0x55ffcc9ff390 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2bef94740 10 client.0 _ll_register_callbacks cb 0x55ffccce1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33256/0 (socket says 172.21.15.102:33256) 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/1327434480 learned_addr learned my addr 172.21.15.102:0/1327434480 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdd2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 msgr2=0x55ffccdd2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdd2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/1327434480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 msgr2=0x55ffccdd28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/1327434480 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffcccf5c40 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac006f60 tx=0x7fa2ac013a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0fd0d154715556 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.254+0000 7fa299ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac028420 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa2ac0285c0 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2ac018070 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac0287c0 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 10 client.16269 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffccde1700 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2ac018070 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa2ac02aa30 con 0x55ffcca20070 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 10 client.16269 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:46.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 20 client.16269 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9de9f0 0x55ffccde4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 4 client.16269 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.255+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffccd3fda0 con 0x55ffcc9de9f0 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.256+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9de9f0 0x55ffccde4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.256+0000 7fa299ffb640 10 client.16269 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.256+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9de9f0 0x55ffccde4ac0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db536e9f17d566b server_cookie=c334c442edb21b71 in_seq=0 out_seq=0 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa299ffb640 1 -- 172.21.15.102:0/1327434480 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffccd3fda0 con 0x55ffcc9de9f0 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa299ffb640 10 client.16269 handle_command_reply: tid=0 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 client.16269 shutdown 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 msgr2=0x55ffccdded40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac006f60 tx=0x7fa2ac013a50 comp rx=0 tx=0).stop 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 shutdown_connections 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9de9f0 0x55ffccde4ac0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdded40 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdd2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa299ffb640 0 client.16269 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 --2- 172.21.15.102:0/1327434480 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 >> 172.21.15.102:0/1327434480 conn(0x55ffcca14460 msgr2=0x55ffccdca450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 shutdown_connections 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 1 -- 172.21.15.102:0/1327434480 wait complete. 2024-09-21T03:37:46.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.257+0000 7fa2bef94740 20 client.16269 trim_cache size 0 max 16384 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.274+0000 7fa2bef94740 1 Processor -- start 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.274+0000 7fa2bef94740 1 -- start start 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccddec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdcfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41b44d0 con 0x55ffcca20070 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41b1ce0 con 0x55ffcc9f71b0 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2bef94740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41afb30 con 0x55ffcc9ff390 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33266/0 (socket says 172.21.15.102:33266) 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/2952192759 learned_addr learned my addr 172.21.15.102:0/2952192759 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:46.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccddec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdcfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/2952192759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 msgr2=0x55ffccdcfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdcfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/2952192759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 msgr2=0x55ffccddec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccddec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 -- 172.21.15.102:0/2952192759 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffccdd3b80 con 0x55ffcca20070 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdcfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.275+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007fd0 tx=0x7fa2ac007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec57e0b5498afe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa29bfff640 1 -- 172.21.15.102:0/2952192759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac034020 con 0x55ffcca20070 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa29bfff640 1 -- 172.21.15.102:0/2952192759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2ac018070 con 0x55ffcca20070 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa29bfff640 1 -- 172.21.15.102:0/2952192759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac01d8b0 con 0x55ffcca20070 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa2bef94740 1 -- 172.21.15.102:0/2952192759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 msgr2=0x55ffccdcfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa2bef94740 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac007fd0 tx=0x7fa2ac007cc0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa2bef94740 1 -- 172.21.15.102:0/2952192759 shutdown_connections 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.276+0000 7fa2bef94740 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcca20070 0x55ffccdcfff0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9ff390 0x55ffccdcfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 --2- 172.21.15.102:0/2952192759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcc9f71b0 0x55ffccddec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- 172.21.15.102:0/2952192759 >> 172.21.15.102:0/2952192759 conn(0x55ffcca14460 msgr2=0x55ffccdd2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- 172.21.15.102:0/2952192759 shutdown_connections 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- 172.21.15.102:0/2952192759 wait complete. 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- start start 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 Processor -- start 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 0x55ffccdd76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41b01a0 con 0x55ffcc9ff390 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41b1610 con 0x55ffcca20070 2024-09-21T03:37:46.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b41b0870 con 0x55ffcc9f71b0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2bef94740 10 client.0 _ll_register_callbacks cb 0x7fa2a800c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.277+0000 7fa2b1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:33268/0 (socket says 172.21.15.102:33268) 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 -- 172.21.15.102:0/3391355815 learned_addr learned my addr 172.21.15.102:0/3391355815 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 0x55ffccdd76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 -- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 msgr2=0x55ffccdd6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 -- 172.21.15.102:0/3391355815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 msgr2=0x55ffccdd76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 0x55ffccdd76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 -- 172.21.15.102:0/3391355815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffcce4e260 con 0x55ffcc9ff390 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 0x55ffccdd76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2b1d9b640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55ffccb8e850 tx=0x7fa2a800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e8d1c858a74a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa299ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:37:46.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8005220 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa2a80053c0 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2ac018070 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2a80055c0 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2bef94740 10 client.16275 fetch_fsmap learned FSMap version 29 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.278+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffcce4f480 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa2ac018070 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa2a801c8e0 con 0x55ffcc9ff390 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 10 client.16275 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 10 client.16275 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 20 client.16275 populate_metadata read hostname 'smithi102' 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9b3da0 0x55ffcce51c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 4 client.16275 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffccd3b850 con 0x55ffcc9b3da0 2024-09-21T03:37:46.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9b3da0 0x55ffcce51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa299ffb640 10 client.16275 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.279+0000 7fa2b2d9d640 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9b3da0 0x55ffcce51c80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5eb3ec0171fbf01 server_cookie=9e369ad7ad07b845 in_seq=0 out_seq=0 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa299ffb640 1 -- 172.21.15.102:0/3391355815 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55ffccd3b850 con 0x55ffcc9b3da0 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa299ffb640 10 client.16275 handle_command_reply: tid=0 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 client.16275 shutdown 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 msgr2=0x55ffccdd71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x55ffccb8e850 tx=0x7fa2a800c430 comp rx=0 tx=0).stop 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 shutdown_connections 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ffcc9b3da0 0x55ffcce51c80 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ffcc9ff390 0x55ffccdd71a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ffcca20070 0x55ffccdd76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 --2- 172.21.15.102:0/3391355815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ffcc9f71b0 0x55ffccdd6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 >> 172.21.15.102:0/3391355815 conn(0x55ffcca14460 msgr2=0x55ffccdd3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa299ffb640 0 client.16275 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:37:46.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 shutdown_connections 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 1 -- 172.21.15.102:0/3391355815 wait complete. 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.280+0000 7fa2bef94740 20 client.16275 trim_cache size 0 max 16384 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "c875cda8-19d4-4e15-a058-ce0806c690fa", 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:37:46.297 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.299 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:37:46.301 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 msgr2=0x7fa29c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 0x7fa29c0b8b90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa2a41061c0 tx=0x7fa2a404d000 comp rx=0 tx=0).stop 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 msgr2=0x7fa2b4103050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4031e90 tx=0x7fa2a4003c10 comp rx=0 tx=0).stop 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 shutdown_connections 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa29c0b6680 0x7fa29c0b8b90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2b4108730 0x7fa2b4103ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa2b4102770 0x7fa2b4103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 --2- 172.21.15.102:0/1139606826 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2b4101e20 0x7fa2b4103050 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:37:46.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 >> 172.21.15.102:0/1139606826 conn(0x7fa2b4077cc0 msgr2=0x7fa2b4107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:37:46.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 shutdown_connections 2024-09-21T03:37:46.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:37:46.281+0000 7fa2b8a20640 1 -- 172.21.15.102:0/1139606826 wait complete. 2024-09-21T03:37:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:46 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:46 smithi102 ceph-mon[31392]: pgmap v450: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:37:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:46 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:46 smithi148 ceph-mon[34651]: pgmap v450: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:37:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:46 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:37:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:46 smithi121 ceph-mon[34316]: pgmap v450: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T03:37:46.989 INFO:tasks.cephfs.filesystem:scrub status for tag:c875cda8-19d4-4e15-a058-ce0806c690fa - {'path': '/', 'tag': 'c875cda8-19d4-4e15-a058-ce0806c690fa', 'options': 'recursive,force'} 2024-09-21T03:37:47.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:47 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:37:47.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:47 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:37:47.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:47 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:37:48.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:48 smithi102 ceph-mon[31392]: pgmap v451: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:48.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:48 smithi148 ceph-mon[34651]: pgmap v451: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:48 smithi121 ceph-mon[34316]: pgmap v451: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:51 smithi102 ceph-mon[31392]: pgmap v452: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:51 smithi148 ceph-mon[34651]: pgmap v452: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:51 smithi121 ceph-mon[34316]: pgmap v452: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:53 smithi102 ceph-mon[31392]: pgmap v453: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:37:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:53 smithi148 ceph-mon[34651]: pgmap v453: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:37:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:53 smithi121 ceph-mon[34316]: pgmap v453: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:37:55.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:55 smithi102 ceph-mon[31392]: pgmap v454: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:55.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:55 smithi148 ceph-mon[34651]: pgmap v454: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:55.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:55 smithi121 ceph-mon[34316]: pgmap v454: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:37:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:57 smithi102 ceph-mon[31392]: pgmap v455: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-21T03:37:57.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:57 smithi148 ceph-mon[34651]: pgmap v455: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-21T03:37:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:57 smithi121 ceph-mon[34316]: pgmap v455: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-09-21T03:37:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:37:59 smithi102 ceph-mon[31392]: pgmap v456: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:37:59 smithi148 ceph-mon[34651]: pgmap v456: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:37:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:37:59 smithi121 ceph-mon[34316]: pgmap v456: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:01 smithi102 ceph-mon[31392]: pgmap v457: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:01.752 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:01.752 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:01.752 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:01.752 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:38:01.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:01 smithi148 ceph-mon[34651]: pgmap v457: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:01.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:01.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:01.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:01.753 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:38:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:01 smithi121 ceph-mon[34316]: pgmap v457: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:38:01.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:38:01.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:38:01.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:38:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:03 smithi102 ceph-mon[31392]: pgmap v458: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:03.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:03 smithi148 ceph-mon[34651]: pgmap v458: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:03 smithi121 ceph-mon[34316]: pgmap v458: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:04.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:04 smithi102 ceph-mon[31392]: pgmap v459: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:04 smithi148 ceph-mon[34651]: pgmap v459: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:04 smithi121 ceph-mon[34316]: pgmap v459: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:38:07.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:07 smithi102 ceph-mon[31392]: pgmap v460: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:07 smithi148 ceph-mon[34651]: pgmap v460: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:07 smithi121 ceph-mon[34316]: pgmap v460: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:09 smithi102 ceph-mon[31392]: pgmap v461: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:09 smithi148 ceph-mon[34651]: pgmap v461: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:09 smithi121 ceph-mon[34316]: pgmap v461: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:11 smithi102 ceph-mon[31392]: pgmap v462: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:11.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:11 smithi148 ceph-mon[34651]: pgmap v462: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:11 smithi121 ceph-mon[34316]: pgmap v462: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:38:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:12 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:12 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:12 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:13.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:13 smithi102 ceph-mon[31392]: pgmap v463: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:13.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:13 smithi148 ceph-mon[34651]: pgmap v463: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:13 smithi121 ceph-mon[34316]: pgmap v463: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:38:14.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:14 smithi102 ceph-mon[31392]: pgmap v464: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:38:14.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:14 smithi148 ceph-mon[34651]: pgmap v464: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:38:14.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:14 smithi121 ceph-mon[34316]: pgmap v464: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:38:16.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:38:17.248 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:17.653 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:17 smithi102 ceph-mon[31392]: pgmap v465: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:38:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:17 smithi148 ceph-mon[34651]: pgmap v465: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:38:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:17 smithi121 ceph-mon[34316]: pgmap v465: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3850487864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8109e10 msgr2=0x7f27d8110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3850487864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8109e10 0x7f27d8110640 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009ca0 tx=0x7f27d002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3850487864 shutdown_connections 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3850487864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8109e10 0x7f27d8110640 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3850487864 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d81098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3850487864 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8103b80 0x7f27d8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3850487864 >> 172.21.15.102:0/3850487864 conn(0x7f27d80ff610 msgr2=0x7f27d8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3850487864 shutdown_connections 2024-09-21T03:38:17.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.794+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3850487864 wait complete. 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 Processor -- start 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 -- start start 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d819aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8109e10 0x7f27d819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27d8113c10 con 0x7f27d8103b80 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27d8113a90 con 0x7f27d81094c0 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27ddf7d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f27d8113d90 con 0x7f27d8109e10 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34634/0 (socket says 172.21.15.102:34634) 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27d77fe640 1 -- 172.21.15.102:0/3809908169 learned_addr learned my addr 172.21.15.102:0/3809908169 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.795+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8109e10 0x7f27d819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d819aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 -- 172.21.15.102:0/3809908169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8109e10 msgr2=0x7f27d819fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8109e10 0x7f27d819fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 -- 172.21.15.102:0/3809908169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 msgr2=0x7f27d819aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d819aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 -- 172.21.15.102:0/3809908169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d81a04a0 con 0x7f27d8103b80 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00d770 tx=0x7f27cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d4ff9640 1 -- 172.21.15.102:0/3809908169 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc017070 con 0x7f27d8103b80 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d81a0790 con 0x7f27d8103b80 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d4ff9640 1 -- 172.21.15.102:0/3809908169 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27cc0054f0 con 0x7f27d8103b80 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27d4ff9640 1 -- 172.21.15.102:0/3809908169 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc004de0 con 0x7f27d8103b80 2024-09-21T03:38:17.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.796+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d81a6ef0 con 0x7f27d8103b80 2024-09-21T03:38:17.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27d4ff9640 1 -- 172.21.15.102:0/3809908169 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f27cc004f80 con 0x7f27d8103b80 2024-09-21T03:38:17.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 Processor -- start 2024-09-21T03:38:17.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 -- start start 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aef20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c99ae67e50 con 0x55c99ab4a070 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c99ae57280 con 0x55c99ab29390 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27e44f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c99ae5b090 con 0x55c99ab211b0 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34640/0 (socket says 172.21.15.102:34640) 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.799+0000 7f27d7fff640 1 -- 172.21.15.102:0/3715420808 learned_addr learned my addr 172.21.15.102:0/3715420808 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aef20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d4ff9640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 0x7f27c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 -- 172.21.15.102:0/3715420808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 msgr2=0x55c99aef1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 -- 172.21.15.102:0/3715420808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 msgr2=0x55c99aef20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aef20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 -- 172.21.15.102:0/3715420808 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c99abb5650 con 0x55c99ab4a070 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d4ff9640 1 -- 172.21.15.102:0/3809908169 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f27cc0e7250 con 0x7f27d8103b80 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 0x7f27c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.800+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098b0 tx=0x7f27d00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12fb8d00361953f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.801+0000 7f27bdffb640 1 -- 172.21.15.102:0/3715420808 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0003970 con 0x55c99ab4a070 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.801+0000 7f27bdffb640 1 -- 172.21.15.102:0/3715420808 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27d0036030 con 0x55c99ab4a070 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.801+0000 7f27bdffb640 1 -- 172.21.15.102:0/3715420808 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d002f660 con 0x55c99ab4a070 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- 172.21.15.102:0/3715420808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 msgr2=0x55c99aef1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f27d00098b0 tx=0x7f27d00098e0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 0x7f27c00b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27d004a000 tx=0x7f27d004b000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- 172.21.15.102:0/3715420808 shutdown_connections 2024-09-21T03:38:17.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aef20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3715420808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aef1650 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- 172.21.15.102:0/3715420808 >> 172.21.15.102:0/3715420808 conn(0x55c99ab3e460 msgr2=0x55c99aeef540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- 172.21.15.102:0/3715420808 shutdown_connections 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- 172.21.15.102:0/3715420808 wait complete. 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.802+0000 7f27e44f1740 1 -- start start 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 Processor -- start 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 0x55c99aefd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab4a070 0x55c99aefd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c99acb8700 con 0x55c99ab211b0 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c99adf2110 con 0x55c99ab4a070 2024-09-21T03:38:17.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55c99aeffcb0 con 0x55c99ab29390 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27e44f1740 10 client.0 _ll_register_callbacks cb 0x55c99ae0b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34652/0 (socket says 172.21.15.102:34652) 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d77fe640 1 -- 172.21.15.102:0/3547013402 learned_addr learned my addr 172.21.15.102:0/3547013402 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 0x55c99aefd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab4a070 0x55c99aefd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d77fe640 1 -- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 msgr2=0x55c99aefd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.803+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 0x55c99aefd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27d77fe640 1 -- 172.21.15.102:0/3547013402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab4a070 msgr2=0x55c99aefd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab4a070 0x55c99aefd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27d77fe640 1 -- 172.21.15.102:0/3547013402 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c99ae1fc40 con 0x55c99ab211b0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 0x55c99aefd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00d740 tx=0x7f27cc0ace60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e61098aaff0ad0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:17.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc020050 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f27cc0a9300 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d0036030 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27cc092e60 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27e44f1740 10 client.16287 fetch_fsmap learned FSMap version 30 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c99af0b9c0 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.804+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27d0036030 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f27cc0981a0 con 0x55c99ab211b0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 10 client.16287 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 20 client.16287 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99ab089f0 0x55c99af0ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 4 client.16287 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c99ae69da0 con 0x55c99ab089f0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.805+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99ab089f0 0x55c99af0ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.806+0000 7f27b6ffd640 10 client.16287 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:17.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.806+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99ab089f0 0x55c99af0ee20 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=967a88d3b3726f2e server_cookie=46c939e96ece8934 in_seq=0 out_seq=0 2024-09-21T03:38:17.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.806+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3547013402 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c99ae69da0 con 0x55c99ab089f0 2024-09-21T03:38:17.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.806+0000 7f27b6ffd640 10 client.16287 handle_command_reply: tid=0 2024-09-21T03:38:17.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.806+0000 7f27e44f1740 1 client.16287 shutdown 2024-09-21T03:38:17.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 msgr2=0x55c99aefcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00d740 tx=0x7f27cc0ace60 comp rx=0 tx=0).stop 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 shutdown_connections 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab4a070 0x55c99aefd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab29390 0x55c99aefd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99ab089f0 0x55c99af0ee20 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3547013402 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99aefcd50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27b6ffd640 0 client.16287 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 >> 172.21.15.102:0/3547013402 conn(0x55c99ab3e460 msgr2=0x55c99aef4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 shutdown_connections 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 1 -- 172.21.15.102:0/3547013402 wait complete. 2024-09-21T03:38:17.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.807+0000 7f27e44f1740 20 client.16287 trim_cache size 0 max 16384 2024-09-21T03:38:17.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 Processor -- start 2024-09-21T03:38:17.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 -- start start 2024-09-21T03:38:17.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aefe980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81b21d0 con 0x55c99ab4a070 2024-09-21T03:38:17.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81afa10 con 0x55c99ab29390 2024-09-21T03:38:17.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.824+0000 7f27e44f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81ad860 con 0x55c99ab211b0 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34666/0 (socket says 172.21.15.102:34666) 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d7fff640 1 -- 172.21.15.102:0/3700552909 learned_addr learned my addr 172.21.15.102:0/3700552909 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aefe980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 -- 172.21.15.102:0/3700552909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 msgr2=0x55c99aefe980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aefe980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 -- 172.21.15.102:0/3700552909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 msgr2=0x55c99aeeeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 -- 172.21.15.102:0/3700552909 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c99aef3b90 con 0x55c99ab211b0 2024-09-21T03:38:17.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:17.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.825+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef3040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0e4f90 tx=0x7f27cc0a8f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=629c3d02746355f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.826+0000 7f27bd7fa640 1 -- 172.21.15.102:0/3700552909 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc020070 con 0x55c99ab211b0 2024-09-21T03:38:17.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.826+0000 7f27bd7fa640 1 -- 172.21.15.102:0/3700552909 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27cc0acba0 con 0x55c99ab211b0 2024-09-21T03:38:17.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.826+0000 7f27bd7fa640 1 -- 172.21.15.102:0/3700552909 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0abe50 con 0x55c99ab211b0 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.826+0000 7f27e44f1740 1 -- 172.21.15.102:0/3700552909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 msgr2=0x55c99aef3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.826+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef3040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0e4f90 tx=0x7f27cc0a8f30 comp rx=0 tx=0).stop 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 -- 172.21.15.102:0/3700552909 shutdown_connections 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab4a070 0x55c99aeeeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99aefe980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3700552909 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab211b0 0x55c99aef3040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 -- 172.21.15.102:0/3700552909 >> 172.21.15.102:0/3700552909 conn(0x55c99ab3e460 msgr2=0x55c99aefe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 -- 172.21.15.102:0/3700552909 shutdown_connections 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 -- 172.21.15.102:0/3700552909 wait complete. 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 -- start start 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.827+0000 7f27e44f1740 1 Processor -- start 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99af01410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 0x55c99af01950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81aded0 con 0x55c99ab211b0 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81af340 con 0x55c99ab29390 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f27d81ae5a0 con 0x55c99ab4a070 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27e44f1740 10 client.0 _ll_register_callbacks cb 0x7f27cc009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34678/0 (socket says 172.21.15.102:34678) 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 -- 172.21.15.102:0/3505963220 learned_addr learned my addr 172.21.15.102:0/3505963220 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99af01410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 0x55c99af01950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 -- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 msgr2=0x55c99af01950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 0x55c99af01950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 -- 172.21.15.102:0/3505963220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 msgr2=0x55c99af01410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99af01410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d77fe640 1 -- 172.21.15.102:0/3505963220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c99af08ed0 con 0x55c99ab211b0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.828+0000 7f27d7fff640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 0x55c99af01950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27d77fe640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0e4ad0 tx=0x7f27cc005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b7f5b97dec54b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27cc020070 con 0x55c99ab211b0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f27cc0ac050 con 0x55c99ab211b0 2024-09-21T03:38:17.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27cc0acba0 con 0x55c99ab211b0 2024-09-21T03:38:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27cc0ad790 con 0x55c99ab211b0 2024-09-21T03:38:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 10 client.16293 fetch_fsmap learned FSMap version 30 2024-09-21T03:38:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c99af798b0 con 0x55c99ab211b0 2024-09-21T03:38:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f27cc0acba0 con 0x55c99ab211b0 2024-09-21T03:38:17.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7f27cc0eacd0 con 0x55c99ab211b0 2024-09-21T03:38:17.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 10 client.16293 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T03:38:17.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:17.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 20 client.16293 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99aaddda0 0x55c99af7bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 4 client.16293 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.829+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c99ae65850 con 0x55c99aaddda0 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.830+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99aaddda0 0x55c99af7bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.830+0000 7f27d6ffd640 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99aaddda0 0x55c99af7bea0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f81904dc862419 server_cookie=e0515150f4216aff in_seq=0 out_seq=0 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.830+0000 7f27b6ffd640 10 client.16293 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.830+0000 7f27b6ffd640 1 -- 172.21.15.102:0/3505963220 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55c99ae65850 con 0x55c99aaddda0 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.830+0000 7f27b6ffd640 10 client.16293 handle_command_reply: tid=0 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 client.16293 shutdown 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 msgr2=0x55c99af00ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f27cc0e4ad0 tx=0x7f27cc005480 comp rx=0 tx=0).stop 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 shutdown_connections 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55c99ab4a070 0x55c99af01950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c99ab29390 0x55c99af01410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55c99aaddda0 0x55c99af7bea0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 --2- 172.21.15.102:0/3505963220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c99ab211b0 0x55c99af00ed0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 >> 172.21.15.102:0/3505963220 conn(0x55c99ab3e460 msgr2=0x55c99aef2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27b6ffd640 0 client.16293 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 shutdown_connections 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 1 -- 172.21.15.102:0/3505963220 wait complete. 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.831+0000 7f27e44f1740 20 client.16293 trim_cache size 0 max 16384 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:38:17.837 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.838 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.839 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.840 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:38:17.842 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 msgr2=0x7f27c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 0x7f27c00b8b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f27d004a000 tx=0x7f27d004b000 comp rx=0 tx=0).stop 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 msgr2=0x7f27d819a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00d770 tx=0x7f27cc00dc30 comp rx=0 tx=0).stop 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 shutdown_connections 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f27c00b6680 0x7f27c00b8b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f27d8109e10 0x7f27d819fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27d81094c0 0x7f27d819aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 --2- 172.21.15.102:0/3809908169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f27d8103b80 0x7f27d819a530 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 >> 172.21.15.102:0/3809908169 conn(0x7f27d80ff610 msgr2=0x7f27d8108a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 shutdown_connections 2024-09-21T03:38:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:17.832+0000 7f27ddf7d640 1 -- 172.21.15.102:0/3809908169 wait complete. 2024-09-21T03:38:18.726 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:38:18.727 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:38:18.974 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 -- 172.21.15.102:0/2582625896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0102080 msgr2=0x7f76d0102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 --2- 172.21.15.102:0/2582625896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0102080 0x7f76d0102490 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009900 tx=0x7f76c002a410 comp rx=0 tx=0).stop 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 -- 172.21.15.102:0/2582625896 shutdown_connections 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 --2- 172.21.15.102:0/2582625896 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109eb0 0x7f76d01106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 --2- 172.21.15.102:0/2582625896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0109560 0x7f76d0109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 --2- 172.21.15.102:0/2582625896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0102080 0x7f76d0102490 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 -- 172.21.15.102:0/2582625896 >> 172.21.15.102:0/2582625896 conn(0x7f76d0079ec0 msgr2=0x7f76d007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:19.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 -- 172.21.15.102:0/2582625896 shutdown_connections 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.508+0000 7f76d5128640 1 -- 172.21.15.102:0/2582625896 wait complete. 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.509+0000 7f76d5128640 1 Processor -- start 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.509+0000 7f76d5128640 1 -- start start 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.509+0000 7f76d5128640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0102080 0x7f76d019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.509+0000 7f76d5128640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109560 0x7f76d019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.509+0000 7f76d5128640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76d5128640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0113d10 con 0x7f76d0109eb0 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76d5128640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0113b90 con 0x7f76d0102080 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76d5128640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0113e90 con 0x7f76d0109560 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34684/0 (socket says 172.21.15.102:34684) 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 -- 172.21.15.102:0/4176120903 learned_addr learned my addr 172.21.15.102:0/4176120903 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76ced9d640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0102080 0x7f76d019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:19.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76ce59c640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109560 0x7f76d019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 -- 172.21.15.102:0/4176120903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109560 msgr2=0x7f76d019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109560 0x7f76d019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 -- 172.21.15.102:0/4176120903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0102080 msgr2=0x7f76d019a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0102080 0x7f76d019a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 -- 172.21.15.102:0/4176120903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d01a0590 con 0x7f76d0109eb0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76cf59e640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b970 tx=0x7f76c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8019070 con 0x7f76d0109eb0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f76c800cb40 con 0x7f76d0109eb0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d01a0880 con 0x7f76d0109eb0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.510+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8007650 con 0x7f76d0109eb0 2024-09-21T03:38:19.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.511+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d01a70a0 con 0x7f76d0109eb0 2024-09-21T03:38:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.512+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d0102490 con 0x7f76d0109eb0 2024-09-21T03:38:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.513+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f76c801c070 con 0x7f76d0109eb0 2024-09-21T03:38:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.514+0000 7f76c7fff640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 0x7f76bc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.514+0000 7f76ced9d640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 0x7f76bc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:19.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.514+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f76c80e6ba0 con 0x7f76d0109eb0 2024-09-21T03:38:19.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.515+0000 7f76ced9d640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 0x7f76bc0b8bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009230 tx=0x7f76c00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:19.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.519+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76c80b14c0 con 0x7f76d0109eb0 2024-09-21T03:38:19.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:19 smithi102 ceph-mon[31392]: pgmap v466: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:38:19.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.730+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76d019b810 con 0x7f76d0109eb0 2024-09-21T03:38:19.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.731+0000 7f76c7fff640 1 -- 172.21.15.102:0/4176120903 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11940 (secure 0 0 0) 0x7f76c80b6400 con 0x7f76d0109eb0 2024-09-21T03:38:19.733 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:38:19.734 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":30,"btime":"2024-09-21T03:38:11:386529+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:38:10.881518+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:38:19.734 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 30 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 msgr2=0x7f76bc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 0x7f76bc0b8bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009230 tx=0x7f76c00058d0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 msgr2=0x7f76d019ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b970 tx=0x7f76c800be30 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 shutdown_connections 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76bc0b66b0 0x7f76bc0b8bc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76d0109eb0 0x7f76d019ff20 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76d0109560 0x7f76d019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 --2- 172.21.15.102:0/4176120903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76d0102080 0x7f76d019a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.733+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 >> 172.21.15.102:0/4176120903 conn(0x7f76d0079ec0 msgr2=0x7f76d01075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:19.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.734+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 shutdown_connections 2024-09-21T03:38:19.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:19.734+0000 7f76d5128640 1 -- 172.21.15.102:0/4176120903 wait complete. 2024-09-21T03:38:19.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:19 smithi148 ceph-mon[34651]: pgmap v466: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:38:19.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:19 smithi121 ceph-mon[34316]: pgmap v466: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T03:38:20.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:38:20.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:20 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4176120903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:38:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:20 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4176120903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:38:20.773 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:20.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:20 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4176120903' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 -- 172.21.15.102:0/2593158717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5281094b0 msgr2=0x7fa5281098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 --2- 172.21.15.102:0/2593158717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5281094b0 0x7fa5281098c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51002a410 comp rx=0 tx=0).stop 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 -- 172.21.15.102:0/2593158717 shutdown_connections 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 --2- 172.21.15.102:0/2593158717 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5281094b0 0x7fa5281098c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 --2- 172.21.15.102:0/2593158717 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa528109e00 0x7fa528110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 --2- 172.21.15.102:0/2593158717 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 0x7fa528103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 -- 172.21.15.102:0/2593158717 >> 172.21.15.102:0/2593158717 conn(0x7fa52807b910 msgr2=0x7fa52807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 -- 172.21.15.102:0/2593158717 shutdown_connections 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.244+0000 7fa52d845640 1 -- 172.21.15.102:0/2593158717 wait complete. 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 Processor -- start 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 -- start start 2024-09-21T03:38:21.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 0x7fa52819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5281094b0 0x7fa52819ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113c20 con 0x7fa528109e00 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113aa0 con 0x7fa528103bc0 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.245+0000 7fa52d845640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa528113da0 con 0x7fa5281094b0 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34706/0 (socket says 172.21.15.102:34706) 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 -- 172.21.15.102:0/1277383457 learned_addr learned my addr 172.21.15.102:0/1277383457 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa526ffd640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 0x7fa52819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5267fc640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5281094b0 0x7fa52819ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 -- 172.21.15.102:0/1277383457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5281094b0 msgr2=0x7fa52819ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5281094b0 0x7fa52819ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 -- 172.21.15.102:0/1277383457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 msgr2=0x7fa52819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 0x7fa52819a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 -- 172.21.15.102:0/1277383457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5281a04a0 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa5277fe640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa520009fd0 tx=0x7fa52000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa52c843640 1 -- 172.21.15.102:0/1277383457 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520011830 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa52c843640 1 -- 172.21.15.102:0/1277383457 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa520016070 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5281a0790 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa52c843640 1 -- 172.21.15.102:0/1277383457 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52000f2e0 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.246+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281a6fb0 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.249+0000 7fa533db9740 1 Processor -- start 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa52c843640 1 -- 172.21.15.102:0/1277383457 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa5200119d0 con 0x7fa528109e00 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 -- start start 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4edb6070 0x556b4f15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed95390 0x556b4f15e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b4f0d3ea0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556b4f0c32d0 con 0x556b4ed95390 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa533db9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556b4f0c70e0 con 0x556b4edb6070 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34712/0 (socket says 172.21.15.102:34712) 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 -- 172.21.15.102:0/3167547232 learned_addr learned my addr 172.21.15.102:0/3167547232 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa5267fc640 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4edb6070 0x556b4f15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa5267fc640 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed95390 0x556b4f15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 -- 172.21.15.102:0/3167547232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4edb6070 msgr2=0x556b4f15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4edb6070 0x556b4f15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 -- 172.21.15.102:0/3167547232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed95390 msgr2=0x556b4f15e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed95390 0x556b4f15e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 -- 172.21.15.102:0/3167547232 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b4ee21650 con 0x556b4ed8d1b0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.250+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa518007f90 tx=0x7fa51800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af58eedd31f2e3ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa52c843640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 0x7fa5140b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa51dffb640 1 -- 172.21.15.102:0/3167547232 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518004d20 con 0x556b4ed8d1b0 2024-09-21T03:38:21.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa5267fc640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 0x7fa5140b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa51dffb640 1 -- 172.21.15.102:0/3167547232 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa518010bd0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa51dffb640 1 -- 172.21.15.102:0/3167547232 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5180057b0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.251+0000 7fa52c843640 1 -- 172.21.15.102:0/1277383457 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa5200e6c10 con 0x7fa528109e00 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- 172.21.15.102:0/3167547232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 msgr2=0x556b4f15dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa518007f90 tx=0x7fa51800f850 comp rx=0 tx=0).stop 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa5267fc640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 0x7fa5140b8bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa510005940 tx=0x7fa5100058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- 172.21.15.102:0/3167547232 shutdown_connections 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f15dbe0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed95390 0x556b4f15e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 --2- 172.21.15.102:0/3167547232 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4edb6070 0x556b4f15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- 172.21.15.102:0/3167547232 >> 172.21.15.102:0/3167547232 conn(0x556b4edaa460 msgr2=0x556b4f15b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- 172.21.15.102:0/3167547232 shutdown_connections 2024-09-21T03:38:21.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- 172.21.15.102:0/3167547232 wait complete. 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 -- start start 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.252+0000 7fa533db9740 1 Processor -- start 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 0x556b4f168d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f1692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b4ef24700 con 0x556b4edb6070 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556b4f05e160 con 0x556b4ed8d1b0 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556b4f16be80 con 0x556b4ed95390 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa533db9740 10 client.0 _ll_register_callbacks cb 0x556b4f0779e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34726/0 (socket says 172.21.15.102:34726) 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 -- 172.21.15.102:0/3251523052 learned_addr learned my addr 172.21.15.102:0/3251523052 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5267fc640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f1692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 0x556b4f168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 -- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 msgr2=0x556b4f1692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f1692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 -- 172.21.15.102:0/3251523052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 msgr2=0x556b4f168d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 0x556b4f168d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 -- 172.21.15.102:0/3251523052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b4f08bc90 con 0x556b4edb6070 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 0x556b4f168d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5267fc640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f1692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa5277fe640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa5200a9020 tx=0x7fa5200ac8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4509d63afd796b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.253+0000 7fa506ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5200a81c0 con 0x556b4edb6070 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa5200b1220 con 0x556b4edb6070 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa518010bd0 con 0x556b4edb6070 2024-09-21T03:38:21.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa5200ac560 con 0x556b4edb6070 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 10 client.16311 fetch_fsmap learned FSMap version 30 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556b4f177b60 con 0x556b4edb6070 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa518010bd0 con 0x556b4edb6070 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fa5200a8cc0 con 0x556b4edb6070 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 10 client.16311 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 10 client.16311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 20 client.16311 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed749f0 0x556b4f17b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 4 client.16311 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.254+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b4f0d5df0 con 0x556b4ed749f0 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.255+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed749f0 0x556b4f17b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.255+0000 7fa526ffd640 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed749f0 0x556b4f17b1c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a36f9ce95ba33ea server_cookie=533e5d8079e124a1 in_seq=0 out_seq=0 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.255+0000 7fa506ffd640 10 client.16311 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa506ffd640 1 -- 172.21.15.102:0/3251523052 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b4f0d5df0 con 0x556b4ed749f0 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa506ffd640 10 client.16311 handle_command_reply: tid=0 2024-09-21T03:38:21.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 client.16311 shutdown 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 msgr2=0x556b4f1751a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa5200a9020 tx=0x7fa5200ac8e0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 shutdown_connections 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed749f0 0x556b4f17b1c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4edb6070 0x556b4f1751a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f1692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa506ffd640 0 client.16311 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 --2- 172.21.15.102:0/3251523052 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4ed8d1b0 0x556b4f168d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 >> 172.21.15.102:0/3251523052 conn(0x556b4edaa460 msgr2=0x556b4f160830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 shutdown_connections 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 1 -- 172.21.15.102:0/3251523052 wait complete. 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.256+0000 7fa533db9740 20 client.16311 trim_cache size 0 max 16384 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 Processor -- start 2024-09-21T03:38:21.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 -- start start 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed8d1b0 0x556b4f16a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f15b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281b2110 con 0x556b4ed95390 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281af950 con 0x556b4edb6070 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.269+0000 7fa533db9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281ad7a0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34732/0 (socket says 172.21.15.102:34732) 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 -- 172.21.15.102:0/2290622853 learned_addr learned my addr 172.21.15.102:0/2290622853 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa526ffd640 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed8d1b0 0x556b4f16a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5277fe640 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f15b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 -- 172.21.15.102:0/2290622853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed8d1b0 msgr2=0x556b4f16a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed8d1b0 0x556b4f16a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 -- 172.21.15.102:0/2290622853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 msgr2=0x556b4f15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f15b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 -- 172.21.15.102:0/2290622853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b4f16a020 con 0x556b4ed95390 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa5267fc640 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2d0acb3d8cb4d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa51d7fa640 1 -- 172.21.15.102:0/2290622853 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510004240 con 0x556b4ed95390 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa51d7fa640 1 -- 172.21.15.102:0/2290622853 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5100043e0 con 0x556b4ed95390 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.270+0000 7fa51d7fa640 1 -- 172.21.15.102:0/2290622853 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa510053990 con 0x556b4ed95390 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 -- 172.21.15.102:0/2290622853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 msgr2=0x556b4f15abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa510009900 tx=0x7fa51003f040 comp rx=0 tx=0).stop 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 -- 172.21.15.102:0/2290622853 shutdown_connections 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed95390 0x556b4f15abc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f15b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 --2- 172.21.15.102:0/2290622853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed8d1b0 0x556b4f16a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 -- 172.21.15.102:0/2290622853 >> 172.21.15.102:0/2290622853 conn(0x556b4edaa460 msgr2=0x556b4f16a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 -- 172.21.15.102:0/2290622853 shutdown_connections 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.271+0000 7fa533db9740 1 -- 172.21.15.102:0/2290622853 wait complete. 2024-09-21T03:38:21.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 -- start start 2024-09-21T03:38:21.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 Processor -- start 2024-09-21T03:38:21.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f16d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f16dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281ade10 con 0x556b4ed8d1b0 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281af280 con 0x556b4edb6070 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5281ae4e0 con 0x556b4ed95390 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa533db9740 10 client.0 _ll_register_callbacks cb 0x7fa520010800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa526ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34740/0 (socket says 172.21.15.102:34740) 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa526ffd640 1 -- 172.21.15.102:0/718847183 learned_addr learned my addr 172.21.15.102:0/718847183 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa5267fc640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f16d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.272+0000 7fa5277fe640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f16dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 -- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 msgr2=0x556b4f16d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f16d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 -- 172.21.15.102:0/718847183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 msgr2=0x556b4f16dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f16dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 -- 172.21.15.102:0/718847183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b4f1e4c00 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa5267fc640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f16d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa526ffd640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa518012010 tx=0x7fa518007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d94553174b4d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa506ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51801d040 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa518010b90 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5100043e0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fa51803a050 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa533db9740 10 client.16317 fetch_fsmap learned FSMap version 30 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556b4f1e5e60 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.273+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5100043e0 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 30) ==== 8366+0+0 (secure 0 0 0) 0x7fa518004f40 con 0x556b4ed8d1b0 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 10 client.16317 fetch_fsmap finished waiting for FSMap version 30 2024-09-21T03:38:21.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 10 client.16317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 20 client.16317 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed49da0 0x556b4f1e8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 4 client.16317 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b4f0d18a0 con 0x556b4ed49da0 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.274+0000 7fa5267fc640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed49da0 0x556b4f1e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa5267fc640 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed49da0 0x556b4f1e8230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8f9b1819e054e73 server_cookie=bde0ab4dda9d3e81 in_seq=0 out_seq=0 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa506ffd640 10 client.16317 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa506ffd640 1 -- 172.21.15.102:0/718847183 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b4f0d18a0 con 0x556b4ed49da0 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa506ffd640 10 client.16317 handle_command_reply: tid=0 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 client.16317 shutdown 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 msgr2=0x556b4f16d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa518012010 tx=0x7fa518007660 comp rx=0 tx=0).stop 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 shutdown_connections 2024-09-21T03:38:21.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556b4ed49da0 0x556b4f1e8230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556b4edb6070 0x556b4f16dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556b4ed95390 0x556b4f16d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 --2- 172.21.15.102:0/718847183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b4ed8d1b0 0x556b4f16d140 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 >> 172.21.15.102:0/718847183 conn(0x556b4edaa460 msgr2=0x556b4f1607a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa506ffd640 0 client.16317 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 shutdown_connections 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 1 -- 172.21.15.102:0/718847183 wait complete. 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.275+0000 7fa533db9740 20 client.16317 trim_cache size 0 max 16384 2024-09-21T03:38:21.291 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 msgr2=0x7fa5140b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 0x7fa5140b8bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa510005940 tx=0x7fa5100058d0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 msgr2=0x7fa52819fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa520009fd0 tx=0x7fa52000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 shutdown_connections 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5140b66b0 0x7fa5140b8bc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa528109e00 0x7fa52819fe30 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5281094b0 0x7fa52819ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 --2- 172.21.15.102:0/1277383457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa528103bc0 0x7fa52819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 >> 172.21.15.102:0/1277383457 conn(0x7fa52807b910 msgr2=0x7fa528107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 shutdown_connections 2024-09-21T03:38:21.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:21.276+0000 7fa52d845640 1 -- 172.21.15.102:0/1277383457 wait complete. 2024-09-21T03:38:21.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:21 smithi102 ceph-mon[31392]: pgmap v467: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:21.687 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:21 smithi121 ceph-mon[34316]: pgmap v467: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:21 smithi148 ceph-mon[34651]: pgmap v467: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:22.107 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:38:22.353 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:22.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:22 smithi102 ceph-mon[31392]: pgmap v468: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:38:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:22 smithi148 ceph-mon[34651]: pgmap v468: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:38:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:22 smithi121 ceph-mon[34316]: pgmap v468: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T03:38:22.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 -- 172.21.15.102:0/15040637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 msgr2=0x7f72ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 --2- 172.21.15.102:0/15040637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac10f520 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009ca0 tx=0x7f72a402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 -- 172.21.15.102:0/15040637 shutdown_connections 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 --2- 172.21.15.102:0/15040637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac10f520 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 --2- 172.21.15.102:0/15040637 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac1083a0 0x7f72ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 --2- 172.21.15.102:0/15040637 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac102a60 0x7f72ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.938+0000 7f72b16b0640 1 -- 172.21.15.102:0/15040637 >> 172.21.15.102:0/15040637 conn(0x7f72ac079730 msgr2=0x7f72ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.939+0000 7f72b16b0640 1 -- 172.21.15.102:0/15040637 shutdown_connections 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.939+0000 7f72b16b0640 1 -- 172.21.15.102:0/15040637 wait complete. 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.939+0000 7f72b16b0640 1 Processor -- start 2024-09-21T03:38:22.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.939+0000 7f72b16b0640 1 -- start start 2024-09-21T03:38:22.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac102a60 0x7f72ac19b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac1083a0 0x7f72ac19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac112a80 con 0x7f72ac108cf0 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac112900 con 0x7f72ac102a60 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72b16b0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac112c00 con 0x7f72ac1083a0 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34748/0 (socket says 172.21.15.102:34748) 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 -- 172.21.15.102:0/1836512768 learned_addr learned my addr 172.21.15.102:0/1836512768 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac1083a0 0x7f72ac19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72aaffd640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac102a60 0x7f72ac19b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 -- 172.21.15.102:0/1836512768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac1083a0 msgr2=0x7f72ac19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac1083a0 0x7f72ac19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 -- 172.21.15.102:0/1836512768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac102a60 msgr2=0x7f72ac19b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac102a60 0x7f72ac19b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 -- 172.21.15.102:0/1836512768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72ac1a6600 con 0x7f72ac108cf0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.940+0000 7f72ab7fe640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72a4005e30 tx=0x7f72a4003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.941+0000 7f72a3fff640 1 -- 172.21.15.102:0/1836512768 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a4031650 con 0x7f72ac108cf0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.941+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72ac1a6890 con 0x7f72ac108cf0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.941+0000 7f72a3fff640 1 -- 172.21.15.102:0/1836512768 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a40317f0 con 0x7f72ac108cf0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.941+0000 7f72a3fff640 1 -- 172.21.15.102:0/1836512768 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a402fb70 con 0x7f72ac108cf0 2024-09-21T03:38:22.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.941+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72ac1a6dd0 con 0x7f72ac108cf0 2024-09-21T03:38:22.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.943+0000 7f72b7c24740 1 Processor -- start 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.943+0000 7f72a3fff640 1 -- 172.21.15.102:0/1836512768 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f72a402fd10 con 0x7f72ac108cf0 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.943+0000 7f72b7c24740 1 -- start start 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01dda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555b01d4fea0 con 0x555b01a11390 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b01d3f2d0 con 0x555b01a32070 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72b7c24740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b01d430e0 con 0x555b01a091b0 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01dda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:35756/0 (socket says 172.21.15.102:35756) 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 -- 172.21.15.102:0/2660524649 learned_addr learned my addr 172.21.15.102:0/2660524649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:22.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:37674/0 (socket says 172.21.15.102:37674) 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72a3fff640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 0x7f72980b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 -- 172.21.15.102:0/2660524649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 msgr2=0x555b01dd96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 -- 172.21.15.102:0/2660524649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 msgr2=0x555b01dda120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.944+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01dda120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72aaffd640 1 -- 172.21.15.102:0/2660524649 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b01a9d650 con 0x555b01a091b0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72ab7fe640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 0x7f72980b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f729400bcb0 tx=0x7f72940107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d863de8327bf0af7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72a3fff640 1 -- 172.21.15.102:0/1836512768 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f72a4108b90 con 0x7f72ac108cf0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72a17fa640 1 -- 172.21.15.102:0/2660524649 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729401c480 con 0x555b01a091b0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72ab7fe640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 0x7f72980b8bc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f72a4106380 tx=0x7f72a4030000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72a17fa640 1 -- 172.21.15.102:0/2660524649 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f729401caf0 con 0x555b01a091b0 2024-09-21T03:38:22.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.945+0000 7f72a17fa640 1 -- 172.21.15.102:0/2660524649 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294011c60 con 0x555b01a091b0 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 -- 172.21.15.102:0/2660524649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 msgr2=0x555b01dd9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f729400bcb0 tx=0x7f72940107a0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 -- 172.21.15.102:0/2660524649 shutdown_connections 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01dda120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01dd9be0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2660524649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a32070 0x555b01dd96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 -- 172.21.15.102:0/2660524649 >> 172.21.15.102:0/2660524649 conn(0x555b01a26460 msgr2=0x555b01dd7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 -- 172.21.15.102:0/2660524649 shutdown_connections 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.946+0000 7f72b7c24740 1 -- 172.21.15.102:0/2660524649 wait complete. 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 -- start start 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 Processor -- start 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01de9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01de9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555b01ba0700 con 0x555b01a32070 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555b01cda160 con 0x555b01a11390 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555b01dec1e0 con 0x555b01a091b0 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72b7c24740 10 client.0 _ll_register_callbacks cb 0x555b01cf39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34772/0 (socket says 172.21.15.102:34772) 2024-09-21T03:38:22.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72aa7fc640 1 -- 172.21.15.102:0/2226936635 learned_addr learned my addr 172.21.15.102:0/2226936635 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01de9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.947+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01de9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 -- 172.21.15.102:0/2226936635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 msgr2=0x555b01de9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01de9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 -- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 msgr2=0x555b01de9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01de9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 -- 172.21.15.102:0/2226936635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b01d07c90 con 0x555b01a32070 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bd30 tx=0x7f729c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad1c0f2165f415b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c004320 con 0x555b01a32070 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f729c005020 con 0x555b01a32070 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f729401caf0 con 0x555b01a32070 2024-09-21T03:38:22.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f729c0044c0 con 0x555b01a32070 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72b7c24740 10 client.16329 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555b01df7ed0 con 0x555b01a32070 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f729401caf0 con 0x555b01a32070 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.948+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f729c004830 con 0x555b01a32070 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 10 client.16329 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 10 client.16329 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 20 client.16329 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019f09f0 0x555b01dfb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 4 client.16329 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b01d51df0 con 0x555b019f09f0 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019f09f0 0x555b01dfb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72927fc640 10 client.16329 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.949+0000 7f72aaffd640 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019f09f0 0x555b01dfb430 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e1a86d966ae008e server_cookie=4c7738b09c7a098d in_seq=0 out_seq=0 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72927fc640 1 -- 172.21.15.102:0/2226936635 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b01d51df0 con 0x555b019f09f0 2024-09-21T03:38:22.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72927fc640 10 client.16329 handle_command_reply: tid=0 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 client.16329 shutdown 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 msgr2=0x555b01df5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f729c00bd30 tx=0x7f729c014040 comp rx=0 tx=0).stop 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 shutdown_connections 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019f09f0 0x555b01dfb430 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a32070 0x555b01df5510 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01de9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 --2- 172.21.15.102:0/2226936635 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a091b0 0x555b01de9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 >> 172.21.15.102:0/2226936635 conn(0x555b01a26460 msgr2=0x555b01ddb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.950+0000 7f72927fc640 0 client.16329 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.951+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 shutdown_connections 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.951+0000 7f72b7c24740 1 -- 172.21.15.102:0/2226936635 wait complete. 2024-09-21T03:38:22.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.951+0000 7f72b7c24740 20 client.16329 trim_cache size 0 max 16384 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.963+0000 7f72b7c24740 1 Processor -- start 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.963+0000 7f72b7c24740 1 -- start start 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a091b0 0x555b01de9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01de6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1b0060 con 0x555b01a11390 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1ad8d0 con 0x555b01a091b0 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72b7c24740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1ab740 con 0x555b01a32070 2024-09-21T03:38:22.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34784/0 (socket says 172.21.15.102:34784) 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 -- 172.21.15.102:0/612976810 learned_addr learned my addr 172.21.15.102:0/612976810 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a091b0 0x555b01de9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 -- 172.21.15.102:0/612976810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 msgr2=0x555b01de6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01de6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 -- 172.21.15.102:0/612976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a091b0 msgr2=0x555b01de9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a091b0 0x555b01de9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 -- 172.21.15.102:0/612976810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b01df5b80 con 0x555b01a11390 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.964+0000 7f72aaffd640 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f729400bcb0 tx=0x7f72940118a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29a60ebc03bdead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.965+0000 7f72a0ff9640 1 -- 172.21.15.102:0/612976810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294011910 con 0x555b01a11390 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.965+0000 7f72a0ff9640 1 -- 172.21.15.102:0/612976810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7294005040 con 0x555b01a11390 2024-09-21T03:38:22.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.965+0000 7f72a0ff9640 1 -- 172.21.15.102:0/612976810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729401c6e0 con 0x555b01a11390 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.965+0000 7f72b7c24740 1 -- 172.21.15.102:0/612976810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 msgr2=0x555b01de6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.965+0000 7f72b7c24740 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f729400bcb0 tx=0x7f72940118a0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- 172.21.15.102:0/612976810 shutdown_connections 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a11390 0x555b01de6330 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01de6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- 172.21.15.102:0/612976810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a091b0 0x555b01de9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- 172.21.15.102:0/612976810 >> 172.21.15.102:0/612976810 conn(0x555b01a26460 msgr2=0x555b01de8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- 172.21.15.102:0/612976810 shutdown_connections 2024-09-21T03:38:22.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- 172.21.15.102:0/612976810 wait complete. 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- start start 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 Processor -- start 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01ded220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01ded820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1abd90 con 0x555b01a091b0 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1ad200 con 0x555b01a11390 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72ac1ac460 con 0x555b01a32070 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72b7c24740 10 client.0 _ll_register_callbacks cb 0x7f729c00bc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.966+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34794/0 (socket says 172.21.15.102:34794) 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 -- 172.21.15.102:0/1579366986 learned_addr learned my addr 172.21.15.102:0/1579366986 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aaffd640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01ded220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 -- 172.21.15.102:0/1579366986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 msgr2=0x555b01ded820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01ded820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 -- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 msgr2=0x555b01ded220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01ded220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 -- 172.21.15.102:0/1579366986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b01dedfb0 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72aa7fc640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f729c00b6b0 tx=0x7f729c0036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ccb344d4ea9aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72927fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729c035020 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f729c003960 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7294005040 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f729c004320 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72b7c24740 10 client.16335 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.967+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555b01e65e00 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7294005040 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f729c004e70 con 0x555b01a091b0 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 10 client.16335 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:22.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 10 client.16335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 20 client.16335 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019c5da0 0x555b01e68560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 4 client.16335 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555b01d4d8a0 con 0x555b019c5da0 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72aaffd640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019c5da0 0x555b01e68560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72927fc640 10 client.16335 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.968+0000 7f72aaffd640 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019c5da0 0x555b01e68560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7cf44a0e20849c1c server_cookie=5c87a186a6de2b89 in_seq=0 out_seq=0 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72927fc640 1 -- 172.21.15.102:0/1579366986 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555b01d4d8a0 con 0x555b019c5da0 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72927fc640 10 client.16335 handle_command_reply: tid=0 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 client.16335 shutdown 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 msgr2=0x555b01df1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f729c00b6b0 tx=0x7f729c0036b0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 shutdown_connections 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x555b019c5da0 0x555b01e68560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555b01a32070 0x555b01ded820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555b01a11390 0x555b01ded220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 --2- 172.21.15.102:0/1579366986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555b01a091b0 0x555b01df1d20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 >> 172.21.15.102:0/1579366986 conn(0x555b01a26460 msgr2=0x555b01dea510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72927fc640 0 client.16335 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 shutdown_connections 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 1 -- 172.21.15.102:0/1579366986 wait complete. 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.969+0000 7f72b7c24740 20 client.16335 trim_cache size 0 max 16384 2024-09-21T03:38:22.976 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 msgr2=0x7f72980b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 0x7f72980b8bc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f72a4106380 tx=0x7f72a4030000 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 msgr2=0x7f72ac19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72a4005e30 tx=0x7f72a4003f90 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 shutdown_connections 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72980b66b0 0x7f72980b8bc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72ac108cf0 0x7f72ac19bdf0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72ac1083a0 0x7f72ac19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 --2- 172.21.15.102:0/1836512768 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72ac102a60 0x7f72ac19b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:22.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 >> 172.21.15.102:0/1836512768 conn(0x7f72ac079730 msgr2=0x7f72ac1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:22.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 shutdown_connections 2024-09-21T03:38:22.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:22.970+0000 7f72b16b0640 1 -- 172.21.15.102:0/1836512768 wait complete. 2024-09-21T03:38:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:23 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:23 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:23 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:23.817 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:38:24.062 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:24.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:24 smithi102 ceph-mon[31392]: pgmap v469: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/3360323293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 msgr2=0x7f2c84110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/3360323293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c84110630 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c009900 tx=0x7f2c7c02a410 comp rx=0 tx=0).stop 2024-09-21T03:38:24.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/3360323293 shutdown_connections 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/3360323293 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c84110630 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/3360323293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c841094b0 0x7f2c841098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/3360323293 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c84103bc0 0x7f2c84103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/3360323293 >> 172.21.15.102:0/3360323293 conn(0x7f2c8407b910 msgr2=0x7f2c8407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/3360323293 shutdown_connections 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.583+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/3360323293 wait complete. 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 Processor -- start 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 -- start start 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c84103bc0 0x7f2c8419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c841094b0 0x7f2c8419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84113c00 con 0x7f2c84109e00 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84113a80 con 0x7f2c84103bc0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8c0bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c84113d80 con 0x7f2c841094b0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8a65c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8a65c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52344/0 (socket says 172.21.15.102:52344) 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8a65c640 1 -- 172.21.15.102:0/2523468313 learned_addr learned my addr 172.21.15.102:0/2523468313 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c8965a640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c841094b0 0x7f2c8419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.584+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c84103bc0 0x7f2c8419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 -- 172.21.15.102:0/2523468313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c841094b0 msgr2=0x7f2c8419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c841094b0 0x7f2c8419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 -- 172.21.15.102:0/2523468313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c84103bc0 msgr2=0x7f2c8419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c84103bc0 0x7f2c8419a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 -- 172.21.15.102:0/2523468313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c841a0500 con 0x7f2c84109e00 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8a65c640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005ab0 tx=0x7f2c7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c82ffd640 1 -- 172.21.15.102:0/2523468313 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c03f030 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c82ffd640 1 -- 172.21.15.102:0/2523468313 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c7c003cd0 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c841a0790 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c82ffd640 1 -- 172.21.15.102:0/2523468313 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c035070 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.585+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c841a6f50 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.587+0000 7f2c92633740 1 Processor -- start 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c82ffd640 1 -- 172.21.15.102:0/2523468313 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f2c7c042030 con 0x7f2c84109e00 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 -- start start 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4f15070 0x5629c52bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 0x5629c52bcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5629c5232ea0 con 0x5629c4ef4390 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629c52222d0 con 0x5629c4eec1b0 2024-09-21T03:38:24.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c92633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629c52260e0 con 0x5629c4f15070 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c8965a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c8965a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52352/0 (socket says 172.21.15.102:52352) 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c8965a640 1 -- 172.21.15.102:0/42762997 learned_addr learned my addr 172.21.15.102:0/42762997 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.588+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 0x5629c52bcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c8965a640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4f15070 0x5629c52bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c82ffd640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 0x7f2c6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 -- 172.21.15.102:0/42762997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4f15070 msgr2=0x5629c52bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4f15070 0x5629c52bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 -- 172.21.15.102:0/42762997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 msgr2=0x5629c52bd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 -- 172.21.15.102:0/42762997 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c4f80650 con 0x5629c4eec1b0 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c8a65c640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 0x7f2c6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c8965a640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c82ffd640 1 -- 172.21.15.102:0/2523468313 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2c7c107ea0 con 0x7f2c84109e00 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 0x5629c52bcbe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400ae70 tx=0x7f2c7400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb6679e0fc0121a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c8a65c640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 0x7f2c6c0b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c105690 tx=0x7f2c7c0977e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c6bfff640 1 -- 172.21.15.102:0/42762997 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74003b70 con 0x5629c4eec1b0 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c6bfff640 1 -- 172.21.15.102:0/42762997 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c74003d10 con 0x5629c4eec1b0 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.589+0000 7f2c6bfff640 1 -- 172.21.15.102:0/42762997 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74010b40 con 0x5629c4eec1b0 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 -- 172.21.15.102:0/42762997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 msgr2=0x5629c52bcbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 0x5629c52bcbe0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400ae70 tx=0x7f2c7400f790 comp rx=0 tx=0).stop 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 -- 172.21.15.102:0/42762997 shutdown_connections 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52bd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4eec1b0 0x5629c52bcbe0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 --2- 172.21.15.102:0/42762997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4f15070 0x5629c52bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 -- 172.21.15.102:0/42762997 >> 172.21.15.102:0/42762997 conn(0x5629c4f09460 msgr2=0x5629c52ba590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 -- 172.21.15.102:0/42762997 shutdown_connections 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.590+0000 7f2c92633740 1 -- 172.21.15.102:0/42762997 wait complete. 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 -- start start 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 Processor -- start 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c52c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5629c5083700 con 0x5629c4ef4390 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5629c51bd160 con 0x5629c4f15070 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.591+0000 7f2c92633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5629c52cae80 con 0x5629c4eec1b0 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c92633740 10 client.0 _ll_register_callbacks cb 0x5629c51d69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52366/0 (socket says 172.21.15.102:52366) 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3468185231 learned_addr learned my addr 172.21.15.102:0/3468185231 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:24.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c52c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 msgr2=0x5629c52c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52c7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3468185231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 msgr2=0x5629c52c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c52c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3468185231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c51eac90 con 0x5629c4ef4390 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c52c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400ac20 tx=0x7f2c740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cf8ae350124c39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74027020 con 0x5629c4ef4390 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2c74004d50 con 0x5629c4ef4390 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c74003d10 con 0x5629c4ef4390 2024-09-21T03:38:24.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c74032050 con 0x5629c4ef4390 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c92633740 10 client.16347 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.592+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5629c52d6a90 con 0x5629c4ef4390 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c74003d10 con 0x5629c4ef4390 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2c74023470 con 0x5629c4ef4390 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 10 client.16347 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 20 client.16347 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ed39f0 0x5629c52d9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 4 client.16347 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629c5234df0 con 0x5629c4ed39f0 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.593+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ed39f0 0x5629c52d9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.594+0000 7f2c697fa640 10 client.16347 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.594+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ed39f0 0x5629c52d9f00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b242488973f0f7 server_cookie=558c9a10ad7c9a44 in_seq=0 out_seq=0 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.594+0000 7f2c697fa640 1 -- 172.21.15.102:0/3468185231 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629c5234df0 con 0x5629c4ed39f0 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.594+0000 7f2c697fa640 10 client.16347 handle_command_reply: tid=0 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.594+0000 7f2c92633740 1 client.16347 shutdown 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 msgr2=0x5629c52c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400ac20 tx=0x7f2c740047c0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 shutdown_connections 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ed39f0 0x5629c52d9f00 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52c8170 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c52c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 --2- 172.21.15.102:0/3468185231 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52c7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c697fa640 0 client.16347 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:24.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 >> 172.21.15.102:0/3468185231 conn(0x5629c4f09460 msgr2=0x5629c52bf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 shutdown_connections 2024-09-21T03:38:24.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 1 -- 172.21.15.102:0/3468185231 wait complete. 2024-09-21T03:38:24.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.595+0000 7f2c92633740 20 client.16347 trim_cache size 0 max 16384 2024-09-21T03:38:24.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 Processor -- start 2024-09-21T03:38:24.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 -- start start 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52be090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 0x5629c52c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841b2100 con 0x5629c4f15070 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841af970 con 0x5629c4ef4390 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c92633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841ad7c0 con 0x5629c4eec1b0 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c8965a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c8965a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52378/0 (socket says 172.21.15.102:52378) 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.608+0000 7f2c8965a640 1 -- 172.21.15.102:0/3414825841 learned_addr learned my addr 172.21.15.102:0/3414825841 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 -- 172.21.15.102:0/3414825841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 msgr2=0x5629c52be090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52be090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 0x5629c52c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 -- 172.21.15.102:0/3414825841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 msgr2=0x5629c52c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 0x5629c52c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 -- 172.21.15.102:0/3414825841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629c52ca9b0 con 0x5629c4f15070 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 0x5629c52c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2c78012780 tx=0x7f2c7800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874dfdd6857279d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c6b7fe640 1 -- 172.21.15.102:0/3414825841 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78010b00 con 0x5629c4f15070 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c6b7fe640 1 -- 172.21.15.102:0/3414825841 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c78010ca0 con 0x5629c4f15070 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.609+0000 7f2c6b7fe640 1 -- 172.21.15.102:0/3414825841 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c7800f620 con 0x5629c4f15070 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- 172.21.15.102:0/3414825841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 msgr2=0x5629c52c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2c78012780 tx=0x7f2c7800b390 comp rx=0 tx=0).stop 2024-09-21T03:38:24.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- 172.21.15.102:0/3414825841 shutdown_connections 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4f15070 0x5629c52c5360 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4ef4390 0x5629c52c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 --2- 172.21.15.102:0/3414825841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52be090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- 172.21.15.102:0/3414825841 >> 172.21.15.102:0/3414825841 conn(0x5629c4f09460 msgr2=0x5629c52c64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- 172.21.15.102:0/3414825841 shutdown_connections 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- 172.21.15.102:0/3414825841 wait complete. 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 -- start start 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.610+0000 7f2c92633740 1 Processor -- start 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c533d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841ade30 con 0x5629c4ef4390 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841af2a0 con 0x5629c4f15070 2024-09-21T03:38:24.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2c841ae500 con 0x5629c4eec1b0 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c92633740 10 client.0 _ll_register_callbacks cb 0x7f2c7400acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c8965a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52382/0 (socket says 172.21.15.102:52382) 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3054126499 learned_addr learned my addr 172.21.15.102:0/3054126499 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c533d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 msgr2=0x5629c52ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3054126499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 msgr2=0x5629c533d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c533d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.611+0000 7f2c89e5b640 1 -- 172.21.15.102:0/3054126499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629c533de20 con 0x5629c4ef4390 2024-09-21T03:38:24.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c89e5b640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400a6e0 tx=0x7f2c7400afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6083d09bd9db8ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74027070 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f2c74002030 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c78010ca0 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c74023ce0 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 10 client.16353 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5629c5345190 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2c78010ca0 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2c74003ea0 con 0x5629c4ef4390 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 20 client.16353 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ea8da0 0x5629c5347900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:24.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 4 client.16353 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.612+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5629c52308a0 con 0x5629c4ea8da0 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ea8da0 0x5629c5347900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c697fa640 10 client.16353 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c8965a640 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ea8da0 0x5629c5347900 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292b0af1ed0bad7b server_cookie=ffec942c0a397304 in_seq=0 out_seq=0 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c697fa640 1 -- 172.21.15.102:0/3054126499 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5629c52308a0 con 0x5629c4ea8da0 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c697fa640 10 client.16353 handle_command_reply: tid=0 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 client.16353 shutdown 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 msgr2=0x5629c52cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400a6e0 tx=0x7f2c7400afd0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 shutdown_connections 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5629c4ea8da0 0x5629c5347900 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5629c4ef4390 0x5629c52cd100 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5629c4f15070 0x5629c533d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c697fa640 0 client.16353 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 --2- 172.21.15.102:0/3054126499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5629c4eec1b0 0x5629c52ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.613+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 >> 172.21.15.102:0/3054126499 conn(0x5629c4f09460 msgr2=0x5629c52c9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 shutdown_connections 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c92633740 1 -- 172.21.15.102:0/3054126499 wait complete. 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c92633740 20 client.16353 trim_cache size 0 max 16384 2024-09-21T03:38:24.623 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 msgr2=0x7f2c6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 0x7f2c6c0b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c105690 tx=0x7f2c7c0977e0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 msgr2=0x7f2c8419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2c7c005ab0 tx=0x7f2c7c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 shutdown_connections 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2c6c0b6680 0x7f2c6c0b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c84109e00 0x7f2c8419fdd0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2c841094b0 0x7f2c8419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 --2- 172.21.15.102:0/2523468313 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2c84103bc0 0x7f2c8419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:24.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 >> 172.21.15.102:0/2523468313 conn(0x7f2c8407b910 msgr2=0x7f2c84105440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:24.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 shutdown_connections 2024-09-21T03:38:24.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:24.614+0000 7f2c8c0bf640 1 -- 172.21.15.102:0/2523468313 wait complete. 2024-09-21T03:38:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:24 smithi148 ceph-mon[34651]: pgmap v469: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:24 smithi121 ceph-mon[34316]: pgmap v469: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:26.488 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:38:26.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:38:26.743 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.260+0000 7f14b82a0640 1 -- 172.21.15.102:0/2756112853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 msgr2=0x7f14b0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.260+0000 7f14b82a0640 1 --2- 172.21.15.102:0/2756112853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 0x7f14b0110620 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009900 tx=0x7f14a802a410 comp rx=0 tx=0).stop 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 -- 172.21.15.102:0/2756112853 shutdown_connections 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 --2- 172.21.15.102:0/2756112853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0109df0 0x7f14b0110620 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 --2- 172.21.15.102:0/2756112853 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b01094a0 0x7f14b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 --2- 172.21.15.102:0/2756112853 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b0103b60 0x7f14b0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 -- 172.21.15.102:0/2756112853 >> 172.21.15.102:0/2756112853 conn(0x7f14b007b850 msgr2=0x7f14b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 -- 172.21.15.102:0/2756112853 shutdown_connections 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 -- 172.21.15.102:0/2756112853 wait complete. 2024-09-21T03:38:27.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 Processor -- start 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.261+0000 7f14b82a0640 1 -- start start 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 0x7f14b0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 0x7f14b0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113bd0 con 0x7f14b0103b60 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113a50 con 0x7f14b01094a0 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14b0113d50 con 0x7f14b0109df0 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52410/0 (socket says 172.21.15.102:52410) 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 -- 172.21.15.102:0/1687335040 learned_addr learned my addr 172.21.15.102:0/1687335040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b583b640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 0x7f14b0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b683d640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 0x7f14b0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 -- 172.21.15.102:0/1687335040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 msgr2=0x7f14b0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 0x7f14b0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 -- 172.21.15.102:0/1687335040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 msgr2=0x7f14b0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 0x7f14b0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 -- 172.21.15.102:0/1687335040 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b01a8770 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b683d640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 0x7f14b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b603c640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00eab0 tx=0x7f14ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14a77fe640 1 -- 172.21.15.102:0/1687335040 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00cd80 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14a77fe640 1 -- 172.21.15.102:0/1687335040 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14ac011940 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b01a8a60 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14a77fe640 1 -- 172.21.15.102:0/1687335040 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac010a30 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.262+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b01a8fa0 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.265+0000 7f14be814740 1 Processor -- start 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.265+0000 7f14be814740 1 -- start start 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.265+0000 7f14a77fe640 1 -- 172.21.15.102:0/1687335040 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f14ac011af0 con 0x7f14b0103b60 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55864790d350 0x558647cb4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cb4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558647c2ae60 con 0x5586478e4490 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558647c1a290 con 0x5586478ec670 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14be814740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558647c1e0a0 con 0x55864790d350 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52420/0 (socket says 172.21.15.102:52420) 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 -- 172.21.15.102:0/946919384 learned_addr learned my addr 172.21.15.102:0/946919384 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b683d640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55864790d350 0x558647cb4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b583b640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cb4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 -- 172.21.15.102:0/946919384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55864790d350 msgr2=0x558647cb4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55864790d350 0x558647cb4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 -- 172.21.15.102:0/946919384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 msgr2=0x558647cb4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cb4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 -- 172.21.15.102:0/946919384 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558647978930 con 0x5586478e4490 2024-09-21T03:38:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b583b640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cb4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b603c640 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0e53f0 tx=0x7f14ac0ebf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7fc0da5a9fed66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14a77fe640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 0x7f149c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14b683d640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 0x7f149c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.266+0000 7f14a4d9a640 1 -- 172.21.15.102:0/946919384 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0aa1d0 con 0x5586478e4490 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.267+0000 7f14a77fe640 1 -- 172.21.15.102:0/1687335040 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f14ac0e7d40 con 0x7f14b0103b60 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.267+0000 7f14a4d9a640 1 -- 172.21.15.102:0/946919384 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14ac0ad690 con 0x5586478e4490 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.267+0000 7f14a4d9a640 1 -- 172.21.15.102:0/946919384 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0ac690 con 0x5586478e4490 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- 172.21.15.102:0/946919384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 msgr2=0x558647cb4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14b683d640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 0x7f149c0b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14a8005ab0 tx=0x7f14a8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0e53f0 tx=0x7f14ac0ebf90 comp rx=0 tx=0).stop 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- 172.21.15.102:0/946919384 shutdown_connections 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647cb4970 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cb4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 --2- 172.21.15.102:0/946919384 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55864790d350 0x558647cb4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- 172.21.15.102:0/946919384 >> 172.21.15.102:0/946919384 conn(0x558647901740 msgr2=0x558647cb2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- 172.21.15.102:0/946919384 shutdown_connections 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- 172.21.15.102:0/946919384 wait complete. 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 -- start start 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.268+0000 7f14be814740 1 Processor -- start 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cbff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647ccbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558647a7b890 con 0x5586478ec670 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558647bb4d40 con 0x55864790d350 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558647cc2c10 con 0x5586478e4490 2024-09-21T03:38:27.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14be814740 10 client.0 _ll_register_callbacks cb 0x558647c18c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52434/0 (socket says 172.21.15.102:52434) 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 -- 172.21.15.102:0/1420706212 learned_addr learned my addr 172.21.15.102:0/1420706212 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b603c640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cbff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b683d640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647ccbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 -- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 msgr2=0x558647cbff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cbff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 -- 172.21.15.102:0/1420706212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 msgr2=0x558647ccbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647ccbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 -- 172.21.15.102:0/1420706212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558647ccc4d0 con 0x5586478ec670 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f14b583b640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f14a00117d0 tx=0x7f14a0011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62ef8b672dcb471 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f1499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.269+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a001f060 con 0x5586478ec670 2024-09-21T03:38:27.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f14a000fd50 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14ac0ad690 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f14a0011e80 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 10 client.16365 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558647cced30 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14ac0ad690 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f14a00225f0 con 0x5586478ec670 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 10 client.16365 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 20 client.16365 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478cbcd0 0x558647cd22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 4 client.16365 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.270+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558647c2cdb0 con 0x5586478cbcd0 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.271+0000 7f14b603c640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478cbcd0 0x558647cd22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.271+0000 7f1499ffb640 10 client.16365 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.271+0000 7f14b603c640 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478cbcd0 0x558647cd22d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da89c595abf25004 server_cookie=d439e355f814230a in_seq=0 out_seq=0 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f1499ffb640 1 -- 172.21.15.102:0/1420706212 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558647c2cdb0 con 0x5586478cbcd0 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f1499ffb640 10 client.16365 handle_command_reply: tid=0 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 client.16365 shutdown 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 msgr2=0x558647cc0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f14a00117d0 tx=0x7f14a0011c90 comp rx=0 tx=0).stop 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 shutdown_connections 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478cbcd0 0x558647cd22d0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478ec670 0x558647cc0470 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647ccbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 --2- 172.21.15.102:0/1420706212 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cbff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 >> 172.21.15.102:0/1420706212 conn(0x558647901740 msgr2=0x558647cb75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f1499ffb640 0 client.16365 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:27.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 shutdown_connections 2024-09-21T03:38:27.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 1 -- 172.21.15.102:0/1420706212 wait complete. 2024-09-21T03:38:27.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.272+0000 7f14be814740 20 client.16365 trim_cache size 0 max 16384 2024-09-21T03:38:27.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 Processor -- start 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 -- start start 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478ec670 0x558647cba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647cbe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01b43a0 con 0x5586478e4490 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01b1c10 con 0x55864790d350 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14be814740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01afa60 con 0x5586478ec670 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14b603c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52436/0 (socket says 172.21.15.102:52436) 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14b603c640 1 -- 172.21.15.102:0/1731458379 learned_addr learned my addr 172.21.15.102:0/1731458379 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.290+0000 7f14b583b640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478ec670 0x558647cba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b683d640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647cbe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 -- 172.21.15.102:0/1731458379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478ec670 msgr2=0x558647cba550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478ec670 0x558647cba550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 -- 172.21.15.102:0/1731458379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 msgr2=0x558647cbe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647cbe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 -- 172.21.15.102:0/1731458379 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558647cb7290 con 0x5586478e4490 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b683d640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647cbe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f14b603c640 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0e5a80 tx=0x7f14ac0104d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3643648e2c2756d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f149bfff640 1 -- 172.21.15.102:0/1731458379 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0ad2f0 con 0x5586478e4490 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f149bfff640 1 -- 172.21.15.102:0/1731458379 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14ac0ad690 con 0x5586478e4490 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.291+0000 7f149bfff640 1 -- 172.21.15.102:0/1731458379 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0ad4d0 con 0x5586478e4490 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- 172.21.15.102:0/1731458379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 msgr2=0x558647ccbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0e5a80 tx=0x7f14ac0104d0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- 172.21.15.102:0/1731458379 shutdown_connections 2024-09-21T03:38:27.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55864790d350 0x558647cbe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478ec670 0x558647cba550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 --2- 172.21.15.102:0/1731458379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5586478e4490 0x558647ccbe90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- 172.21.15.102:0/1731458379 >> 172.21.15.102:0/1731458379 conn(0x558647901740 msgr2=0x558647cbaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- 172.21.15.102:0/1731458379 shutdown_connections 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- 172.21.15.102:0/1731458379 wait complete. 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 -- start start 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.292+0000 7f14be814740 1 Processor -- start 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cc3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cc43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01b00d0 con 0x55864790d350 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01b1540 con 0x5586478ec670 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f14b01b07a0 con 0x5586478e4490 2024-09-21T03:38:27.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14be814740 10 client.0 _ll_register_callbacks cb 0x7f14a000a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52446/0 (socket says 172.21.15.102:52446) 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 -- 172.21.15.102:0/1665441722 learned_addr learned my addr 172.21.15.102:0/1665441722 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b603c640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cc3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b583b640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cc43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 -- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 msgr2=0x558647cc3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cc3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 -- 172.21.15.102:0/1665441722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 msgr2=0x558647cc43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cc43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 -- 172.21.15.102:0/1665441722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558647d3bcd0 con 0x55864790d350 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f14b683d640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009900 tx=0x7f14a802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0a960e85de4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.293+0000 7f1499ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:27.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8035050 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14ac0ad690 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f14a8005030 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f14a8058050 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 10 client.16371 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558647d3cf60 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f14ac0ad690 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f14a80035f0 con 0x55864790d350 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 10 client.16371 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 20 client.16371 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478a1080 0x558647d3f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 4 client.16371 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.294+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558647c28860 con 0x5586478a1080 2024-09-21T03:38:27.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.295+0000 7f14b603c640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478a1080 0x558647d3f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.295+0000 7f14b603c640 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478a1080 0x558647d3f7e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a616d35db1910b server_cookie=103bd0004cbab3f3 in_seq=0 out_seq=0 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.295+0000 7f1499ffb640 10 client.16371 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f1499ffb640 1 -- 172.21.15.102:0/1665441722 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558647c28860 con 0x5586478a1080 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f1499ffb640 10 client.16371 handle_command_reply: tid=0 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 client.16371 shutdown 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 msgr2=0x558647cc4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009900 tx=0x7f14a802a410 comp rx=0 tx=0).stop 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 shutdown_connections 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5586478a1080 0x558647d3f7e0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55864790d350 0x558647cc4930 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586478ec670 0x558647cc43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 --2- 172.21.15.102:0/1665441722 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5586478e4490 0x558647cc3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 >> 172.21.15.102:0/1665441722 conn(0x558647901740 msgr2=0x558647cbe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f1499ffb640 0 client.16371 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:27.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 shutdown_connections 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 1 -- 172.21.15.102:0/1665441722 wait complete. 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.297+0000 7f14be814740 20 client.16371 trim_cache size 0 max 16384 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "d6f4a83e-9303-405b-9f1f-fe6c9139f926", 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:38:27.308 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 msgr2=0x7f149c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 0x7f149c0b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f14a8005ab0 tx=0x7f14a8031400 comp rx=0 tx=0).stop 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 msgr2=0x7f14b0075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00eab0 tx=0x7f14ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 shutdown_connections 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f149c0b6680 0x7f149c0b8b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f14b0109df0 0x7f14b0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14b01094a0 0x7f14b0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 --2- 172.21.15.102:0/1687335040 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14b0103b60 0x7f14b0075710 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:27.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 >> 172.21.15.102:0/1687335040 conn(0x7f14b007b850 msgr2=0x7f14b0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:27.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 shutdown_connections 2024-09-21T03:38:27.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:27.298+0000 7f14b82a0640 1 -- 172.21.15.102:0/1687335040 wait complete. 2024-09-21T03:38:27.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:27 smithi102 ceph-mon[31392]: pgmap v470: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:27 smithi148 ceph-mon[34651]: pgmap v470: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:27 smithi121 ceph-mon[34316]: pgmap v470: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:28.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:38:28.440 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:38:28.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:28 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:38:28.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:28 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:28 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:38:28.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:28 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:28 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:38:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:28 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:28 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:38:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:28 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:28 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:38:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:28 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:28 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:38:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:28 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 -- 172.21.15.102:0/1601636118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 msgr2=0x7f80dc105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1601636118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc105630 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009900 tx=0x7f80cc02a410 comp rx=0 tx=0).stop 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 -- 172.21.15.102:0/1601636118 shutdown_connections 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1601636118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc105630 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1601636118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 0x7f80dc10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1601636118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 -- 172.21.15.102:0/1601636118 >> 172.21.15.102:0/1601636118 conn(0x7f80dc079ea0 msgr2=0x7f80dc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 -- 172.21.15.102:0/1601636118 shutdown_connections 2024-09-21T03:38:28.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.978+0000 7f80e3e19640 1 -- 172.21.15.102:0/1601636118 wait complete. 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 Processor -- start 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 -- start start 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 0x7f80dc19eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc112c60 con 0x7f80dc105220 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc112ae0 con 0x7f80dc105b70 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e3e19640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc112de0 con 0x7f80dc103210 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52456/0 (socket says 172.21.15.102:52456) 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 -- 172.21.15.102:0/1007989346 learned_addr learned my addr 172.21.15.102:0/1007989346 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:28.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e23b6640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 0x7f80dc19eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 -- 172.21.15.102:0/1007989346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 msgr2=0x7f80dc1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 -- 172.21.15.102:0/1007989346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 msgr2=0x7f80dc19eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 0x7f80dc19eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e13b4640 1 -- 172.21.15.102:0/1007989346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80dc19f620 con 0x7f80dc105220 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.979+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006010 tx=0x7f80cc004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80d2ffd640 1 -- 172.21.15.102:0/1007989346 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc03f030 con 0x7f80dc105220 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80dc19f8b0 con 0x7f80dc105220 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80d2ffd640 1 -- 172.21.15.102:0/1007989346 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80cc0054d0 con 0x7f80dc105220 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80d2ffd640 1 -- 172.21.15.102:0/1007989346 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc035070 con 0x7f80dc105220 2024-09-21T03:38:28.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.980+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80dc1a6070 con 0x7f80dc105220 2024-09-21T03:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.982+0000 7f80ea38d740 1 Processor -- start 2024-09-21T03:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 -- start start 2024-09-21T03:38:28.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80d2ffd640 1 -- 172.21.15.102:0/1007989346 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f80cc042030 con 0x7f80dc105220 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 0x557d641ce650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d64144e50 con 0x557d63dfe1b0 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557d64134280 con 0x557d63e27070 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80ea38d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d64138090 con 0x557d63e06390 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80e1bb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80e1bb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52468/0 (socket says 172.21.15.102:52468) 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80e1bb5640 1 -- 172.21.15.102:0/3824329576 learned_addr learned my addr 172.21.15.102:0/3824329576 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80e13b4640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.983+0000 7f80e23b6640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 0x557d641ce650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 -- 172.21.15.102:0/3824329576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 msgr2=0x557d641cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 -- 172.21.15.102:0/3824329576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 msgr2=0x557d641ce650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 0x557d641ce650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 -- 172.21.15.102:0/3824329576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d63e92650 con 0x557d63dfe1b0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e23b6640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 0x557d641ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c450 tx=0x7f80d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403af330bb7d6600 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80d2ffd640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 0x7f80c80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80c7fff640 1 -- 172.21.15.102:0/3824329576 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d801a070 con 0x557d63dfe1b0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80e23b6640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 0x7f80c80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80c7fff640 1 -- 172.21.15.102:0/3824329576 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80d8007900 con 0x557d63dfe1b0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80c7fff640 1 -- 172.21.15.102:0/3824329576 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80158d0 con 0x557d63dfe1b0 2024-09-21T03:38:28.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.984+0000 7f80d2ffd640 1 -- 172.21.15.102:0/1007989346 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f80cc107ec0 con 0x7f80dc105220 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 -- 172.21.15.102:0/3824329576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 msgr2=0x557d641ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80e23b6640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 0x7f80c80b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009c40 tx=0x7f80d40090e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f80d800c450 tx=0x7f80d800c910 comp rx=0 tx=0).stop 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 -- 172.21.15.102:0/3824329576 shutdown_connections 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641ceb90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3824329576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e27070 0x557d641ce650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 -- 172.21.15.102:0/3824329576 >> 172.21.15.102:0/3824329576 conn(0x557d63e1b460 msgr2=0x557d641cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:28.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 -- 172.21.15.102:0/3824329576 shutdown_connections 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.985+0000 7f80ea38d740 1 -- 172.21.15.102:0/3824329576 wait complete. 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 -- start start 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 Processor -- start 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 0x557d641dbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d63f95700 con 0x557d63e27070 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557d640cf110 con 0x557d63dfe1b0 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557d641def90 con 0x557d63e06390 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80ea38d740 10 client.0 _ll_register_callbacks cb 0x557d640e8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80e23b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80e23b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52480/0 (socket says 172.21.15.102:52480) 2024-09-21T03:38:28.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80e23b6640 1 -- 172.21.15.102:0/2928715987 learned_addr learned my addr 172.21.15.102:0/2928715987 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 0x557d641dbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.986+0000 7f80e13b4640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 -- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 msgr2=0x557d641dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 -- 172.21.15.102:0/2928715987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 msgr2=0x557d641dbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 0x557d641dbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 -- 172.21.15.102:0/2928715987 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d640fcc40 con 0x557d63e27070 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 0x557d641dbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80e23b6640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80d4014970 tx=0x7f80d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b86be3b084b5ece1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4025070 con 0x557d63e27070 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d8007900 con 0x557d63e27070 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f80d4021600 con 0x557d63e27070 2024-09-21T03:38:28.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80d4021840 con 0x557d63e27070 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80ea38d740 10 client.16383 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.987+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557d641d6010 con 0x557d63e27070 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80d8007900 con 0x557d63e27070 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f80d4020070 con 0x557d63e27070 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 10 client.16383 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 20 client.16383 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63de59f0 0x557d641d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 4 client.16383 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d64146da0 con 0x557d63de59f0 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.988+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63de59f0 0x557d641d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.989+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63de59f0 0x557d641d6440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a866562e0bb12d39 server_cookie=f6f244855b1e7f1 in_seq=0 out_seq=0 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.989+0000 7f80c57fa640 10 client.16383 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.989+0000 7f80c57fa640 1 -- 172.21.15.102:0/2928715987 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d64146da0 con 0x557d63de59f0 2024-09-21T03:38:28.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.989+0000 7f80c57fa640 10 client.16383 handle_command_reply: tid=0 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.989+0000 7f80ea38d740 1 client.16383 shutdown 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 msgr2=0x557d641dc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f80d4014970 tx=0x7f80d40046c0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 shutdown_connections 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63de59f0 0x557d641d6440 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63e27070 0x557d641dc910 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80c57fa640 0 client.16383 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63e06390 0x557d641dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 --2- 172.21.15.102:0/2928715987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63dfe1b0 0x557d641dbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 >> 172.21.15.102:0/2928715987 conn(0x557d63e1b460 msgr2=0x557d641d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 shutdown_connections 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 1 -- 172.21.15.102:0/2928715987 wait complete. 2024-09-21T03:38:28.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:28.990+0000 7f80ea38d740 20 client.16383 trim_cache size 0 max 16384 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 Processor -- start 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 -- start start 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63de59f0 0x557d641ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d641d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1b00b0 con 0x557d63dfe1b0 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1ad920 con 0x557d63e06390 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80ea38d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1ab770 con 0x557d63de59f0 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80e13b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80e13b4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52488/0 (socket says 172.21.15.102:52488) 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.007+0000 7f80e13b4640 1 -- 172.21.15.102:0/3153603564 learned_addr learned my addr 172.21.15.102:0/3153603564 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:29.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e23b6640 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d641d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63de59f0 0x557d641ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 -- 172.21.15.102:0/3153603564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63de59f0 msgr2=0x557d641ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63de59f0 0x557d641ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 -- 172.21.15.102:0/3153603564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 msgr2=0x557d641d9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d641d9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 -- 172.21.15.102:0/3153603564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d641cce30 con 0x557d63dfe1b0 2024-09-21T03:38:29.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80e13b4640 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02a450 tx=0x7f80cc10ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0fb0fa221ad06e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80c77fe640 1 -- 172.21.15.102:0/3153603564 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc049040 con 0x557d63dfe1b0 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80c77fe640 1 -- 172.21.15.102:0/3153603564 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80cc0cd810 con 0x557d63dfe1b0 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.008+0000 7f80c77fe640 1 -- 172.21.15.102:0/3153603564 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc0d27e0 con 0x557d63dfe1b0 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- 172.21.15.102:0/3153603564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 msgr2=0x557d641cfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02a450 tx=0x7f80cc10ba10 comp rx=0 tx=0).stop 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- 172.21.15.102:0/3153603564 shutdown_connections 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63dfe1b0 0x557d641cfd90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d641d9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 --2- 172.21.15.102:0/3153603564 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63de59f0 0x557d641ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- 172.21.15.102:0/3153603564 >> 172.21.15.102:0/3153603564 conn(0x557d63e1b460 msgr2=0x557d641cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- 172.21.15.102:0/3153603564 shutdown_connections 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- 172.21.15.102:0/3153603564 wait complete. 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 -- start start 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.009+0000 7f80ea38d740 1 Processor -- start 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63dfe1b0 0x557d641e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d64259ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1abde0 con 0x557d63de59f0 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1ad250 con 0x557d63e06390 2024-09-21T03:38:29.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f80dc1ac4b0 con 0x557d63dfe1b0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80ea38d740 10 client.0 _ll_register_callbacks cb 0x7f80d4009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52502/0 (socket says 172.21.15.102:52502) 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 -- 172.21.15.102:0/1016083138 learned_addr learned my addr 172.21.15.102:0/1016083138 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e23b6640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d64259ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63dfe1b0 0x557d641e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 -- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63dfe1b0 msgr2=0x557d641e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63dfe1b0 0x557d641e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 -- 172.21.15.102:0/1016083138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 msgr2=0x557d64259ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d64259ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 -- 172.21.15.102:0/1016083138 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d641d0f70 con 0x557d63de59f0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e23b6640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d64259ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80e1bb5640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f80d800ce10 tx=0x7f80d8009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38fa1ee2765024b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:38:29.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.010+0000 7f80c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d802c070 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f80d8007af0 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80cc0cd810 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80d801a040 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557d6425b380 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80cc0cd810 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f80d802f020 con 0x557d63de59f0 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 20 client.16389 populate_metadata read hostname 'smithi102' 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63e27070 0x557d6425d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 4 client.16389 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.011+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557d64142850 con 0x557d63e27070 2024-09-21T03:38:29.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63e27070 0x557d6425d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80c57fa640 10 client.16389 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80e13b4640 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63e27070 0x557d6425d910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a14f29a025e80b server_cookie=9d6f4ed07783e6cd in_seq=0 out_seq=0 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80c57fa640 1 -- 172.21.15.102:0/1016083138 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x557d64142850 con 0x557d63e27070 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80c57fa640 10 client.16389 handle_command_reply: tid=0 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80ea38d740 1 client.16389 shutdown 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 msgr2=0x557d641e0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f80d800ce10 tx=0x7f80d8009800 comp rx=0 tx=0).stop 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.012+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 shutdown_connections 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557d63e06390 0x557d64259ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557d63dfe1b0 0x557d641e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557d63e27070 0x557d6425d910 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 --2- 172.21.15.102:0/1016083138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d63de59f0 0x557d641e0640 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 >> 172.21.15.102:0/1016083138 conn(0x557d63e1b460 msgr2=0x557d641da310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80c57fa640 0 client.16389 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:38:29.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 shutdown_connections 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 1 -- 172.21.15.102:0/1016083138 wait complete. 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80ea38d740 20 client.16389 trim_cache size 0 max 16384 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "d6f4a83e-9303-405b-9f1f-fe6c9139f926", 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.020 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.022 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.023 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:38:29.024 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:38:29.025 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:38:29.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 msgr2=0x7f80c80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:29.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 0x7f80c80b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009c40 tx=0x7f80d40090e0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 msgr2=0x7f80dc199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:38:29.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f80cc006010 tx=0x7f80cc004c00 comp rx=0 tx=0).stop 2024-09-21T03:38:29.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 shutdown_connections 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80c80b6680 0x7f80c80b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80dc105220 0x7f80dc199c50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80dc105b70 0x7f80dc19eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 --2- 172.21.15.102:0/1007989346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80dc103210 0x7f80dc1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 >> 172.21.15.102:0/1007989346 conn(0x7f80dc079ea0 msgr2=0x7f80dc106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 shutdown_connections 2024-09-21T03:38:29.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:38:29.013+0000 7f80e3e19640 1 -- 172.21.15.102:0/1007989346 wait complete. 2024-09-21T03:38:29.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:29 smithi102 ceph-mon[31392]: pgmap v471: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:29.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:29 smithi148 ceph-mon[34651]: pgmap v471: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:29.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:29 smithi121 ceph-mon[34316]: pgmap v471: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:29.840 INFO:tasks.cephfs.filesystem:scrub status for tag:d6f4a83e-9303-405b-9f1f-fe6c9139f926 - {'path': '/', 'tag': 'd6f4a83e-9303-405b-9f1f-fe6c9139f926', 'options': 'recursive,force'} 2024-09-21T03:38:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:31 smithi102 ceph-mon[31392]: pgmap v472: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:31 smithi148 ceph-mon[34651]: pgmap v472: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:31 smithi121 ceph-mon[34316]: pgmap v472: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:32 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:38:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:32 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:38:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:32 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:38:33.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:33 smithi102 ceph-mon[31392]: pgmap v473: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:33.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:33 smithi148 ceph-mon[34651]: pgmap v473: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:33.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:33 smithi121 ceph-mon[34316]: pgmap v473: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:34.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:34 smithi102 ceph-mon[31392]: pgmap v474: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:38:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:34 smithi148 ceph-mon[34651]: pgmap v474: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:38:34.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:34 smithi121 ceph-mon[34316]: pgmap v474: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:38:37.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:36 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:37.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:36 smithi102 ceph-mon[31392]: pgmap v475: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:37.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:36 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:37.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:36 smithi148 ceph-mon[34651]: pgmap v475: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:37.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:36 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:37.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:36 smithi121 ceph-mon[34316]: pgmap v475: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:39.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:39 smithi102 ceph-mon[31392]: pgmap v476: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:38:39.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:39 smithi148 ceph-mon[34651]: pgmap v476: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:38:39.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:39 smithi121 ceph-mon[34316]: pgmap v476: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:38:41.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:41 smithi102 ceph-mon[31392]: pgmap v477: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:38:41.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:41 smithi148 ceph-mon[34651]: pgmap v477: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:38:41.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:41 smithi121 ceph-mon[34316]: pgmap v477: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:38:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:43 smithi102 ceph-mon[31392]: pgmap v478: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:43.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:43 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:43 smithi148 ceph-mon[34651]: pgmap v478: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:43.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:43 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:43 smithi121 ceph-mon[34316]: pgmap v478: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:38:43.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:43 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:45.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:45 smithi102 ceph-mon[31392]: pgmap v479: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:45.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:45 smithi148 ceph-mon[34651]: pgmap v479: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:45 smithi121 ceph-mon[34316]: pgmap v479: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:46 smithi148 ceph-mon[34651]: pgmap v480: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:46 smithi121 ceph-mon[34316]: pgmap v480: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:46.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:46 smithi102 ceph-mon[31392]: pgmap v480: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:49.656 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:49 smithi102 ceph-mon[31392]: pgmap v481: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:49.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:49 smithi148 ceph-mon[34651]: pgmap v481: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:49.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:49 smithi121 ceph-mon[34316]: pgmap v481: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:51.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:51 smithi102 ceph-mon[31392]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:38:51.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:51 smithi148 ceph-mon[34651]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:38:51.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:51 smithi121 ceph-mon[34316]: pgmap v482: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:38:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:53 smithi102 ceph-mon[31392]: pgmap v483: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:38:53.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:53 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:53 smithi148 ceph-mon[34651]: pgmap v483: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:38:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:53 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:53 smithi121 ceph-mon[34316]: pgmap v483: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:38:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:53 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:38:54.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:54 smithi148 ceph-mon[34651]: pgmap v484: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:54.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:54 smithi121 ceph-mon[34316]: pgmap v484: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:54 smithi102 ceph-mon[31392]: pgmap v484: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:57.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:57 smithi102 ceph-mon[31392]: pgmap v485: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:57 smithi148 ceph-mon[34651]: pgmap v485: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:57.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:57 smithi121 ceph-mon[34316]: pgmap v485: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:38:59.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:38:59 smithi102 ceph-mon[31392]: pgmap v486: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:59.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:38:59 smithi148 ceph-mon[34651]: pgmap v486: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:59.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:38:59 smithi121 ceph-mon[34316]: pgmap v486: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:38:59.840 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:39:00.099 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:00.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- 172.21.15.102:0/1071372468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81181094a0 msgr2=0x7f81181098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 --2- 172.21.15.102:0/1071372468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81181094a0 0x7f81181098b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f810c009900 tx=0x7f810c02a410 comp rx=0 tx=0).stop 2024-09-21T03:39:00.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- 172.21.15.102:0/1071372468 shutdown_connections 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 --2- 172.21.15.102:0/1071372468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81181094a0 0x7f81181098b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 --2- 172.21.15.102:0/1071372468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 0x7f8118110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 --2- 172.21.15.102:0/1071372468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8118103b60 0x7f8118103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- 172.21.15.102:0/1071372468 >> 172.21.15.102:0/1071372468 conn(0x7f811807b850 msgr2=0x7f811807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- 172.21.15.102:0/1071372468 shutdown_connections 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- 172.21.15.102:0/1071372468 wait complete. 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 Processor -- start 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.599+0000 7f811e351640 1 -- start start 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 0x7f811819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 0x7f811819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8118113bd0 con 0x7f8118103b60 2024-09-21T03:39:00.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8118113a50 con 0x7f8118109df0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811e351640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8118113d50 con 0x7f81181094a0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35480/0 (socket says 172.21.15.102:35480) 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 -- 172.21.15.102:0/3403312063 learned_addr learned my addr 172.21.15.102:0/3403312063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 0x7f811819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f81177fe640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 0x7f811819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 -- 172.21.15.102:0/3403312063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 msgr2=0x7f811819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 0x7f811819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 -- 172.21.15.102:0/3403312063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 msgr2=0x7f811819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 0x7f811819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f8117fff640 1 -- 172.21.15.102:0/3403312063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81181a04b0 con 0x7f8118103b60 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.600+0000 7f81177fe640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 0x7f811819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f8117fff640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f810800c920 tx=0x7f810800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f81157fa640 1 -- 172.21.15.102:0/3403312063 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8108007c70 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81181a07a0 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f81157fa640 1 -- 172.21.15.102:0/3403312063 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8108007e10 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f81157fa640 1 -- 172.21.15.102:0/3403312063 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080188c0 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.601+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81181a6fc0 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.603+0000 7f81248c5740 1 Processor -- start 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.603+0000 7f81157fa640 1 -- 172.21.15.102:0/3403312063 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f8108018a60 con 0x7f8118103b60 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.603+0000 7f81248c5740 1 -- start start 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.603+0000 7f81248c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f46070 0x55f7212ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.603+0000 7f81248c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81248c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81248c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f721263e50 con 0x55f720f1d1b0 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81248c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f721253280 con 0x55f720f46070 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81248c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f721257090 con 0x55f720f25390 2024-09-21T03:39:00.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35494/0 (socket says 172.21.15.102:35494) 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 -- 172.21.15.102:0/3883115832 learned_addr learned my addr 172.21.15.102:0/3883115832 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f46070 0x55f7212ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 -- 172.21.15.102:0/3883115832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 msgr2=0x55f7212edcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 -- 172.21.15.102:0/3883115832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f46070 msgr2=0x55f7212ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f46070 0x55f7212ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 -- 172.21.15.102:0/3883115832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f720fb1650 con 0x55f720f1d1b0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81157fa640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 0x7f81000b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f8117fff640 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f81080e4f20 tx=0x7f81080edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397ee3458cfb00dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 0x7f81000b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f81157fa640 1 -- 172.21.15.102:0/3403312063 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f81080e7870 con 0x7f8118103b60 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f80fe7fc640 1 -- 172.21.15.102:0/3883115832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080a9d00 con 0x55f720f1d1b0 2024-09-21T03:39:00.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f80fe7fc640 1 -- 172.21.15.102:0/3883115832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81080ad1c0 con 0x55f720f1d1b0 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.604+0000 7f80fe7fc640 1 -- 172.21.15.102:0/3883115832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080ace20 con 0x55f720f1d1b0 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.605+0000 7f81248c5740 1 -- 172.21.15.102:0/3883115832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 msgr2=0x55f7212ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.605+0000 7f81248c5740 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f81080e4f20 tx=0x7f81080edcd0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 0x7f81000b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f8110009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 -- 172.21.15.102:0/3883115832 shutdown_connections 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f1d1b0 0x55f7212ed7b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212edcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 --2- 172.21.15.102:0/3883115832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f46070 0x55f7212ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 -- 172.21.15.102:0/3883115832 >> 172.21.15.102:0/3883115832 conn(0x55f720f3a460 msgr2=0x55f7212eb160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 -- 172.21.15.102:0/3883115832 shutdown_connections 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 -- 172.21.15.102:0/3883115832 wait complete. 2024-09-21T03:39:00.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.606+0000 7f81248c5740 1 -- start start 2024-09-21T03:39:00.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 Processor -- start 2024-09-21T03:39:00.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f1d1b0 0x55f7212f8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 0x55f7212f8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f7210b4700 con 0x55f720f46070 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f7211ee110 con 0x55f720f25390 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f7212fba50 con 0x55f720f1d1b0 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81248c5740 10 client.0 _ll_register_callbacks cb 0x55f721207990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f811c8ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f81177fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 0x55f7212f8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f811c8ee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35496/0 (socket says 172.21.15.102:35496) 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f811c8ee640 1 -- 172.21.15.102:0/197951937 learned_addr learned my addr 172.21.15.102:0/197951937 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.607+0000 7f8117fff640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f1d1b0 0x55f7212f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 -- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f1d1b0 msgr2=0x55f7212f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f1d1b0 0x55f7212f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 -- 172.21.15.102:0/197951937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 msgr2=0x55f721304d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 -- 172.21.15.102:0/197951937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f72121bc40 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f811c8ee640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81177fe640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 0x55f7212f8e70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f810c02a930 tx=0x7f810c0317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d2b1f083f5a1a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f80f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c03f070 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81080ad1c0 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f810c004450 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f810c035070 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81248c5740 10 client.25733 fetch_fsmap learned FSMap version 34 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.608+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f721307730 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81080ad1c0 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f810c004bc0 con 0x55f720f25390 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 10 client.25733 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 10 client.25733 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:00.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 20 client.25733 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f049f0 0x55f72130ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 4 client.25733 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f721265da0 con 0x55f720f049f0 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.609+0000 7f8117fff640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f049f0 0x55f72130ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.610+0000 7f80f77fe640 10 client.25733 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.610+0000 7f8117fff640 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f049f0 0x55f72130ac50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee96e03c2c5e875 server_cookie=ccd1a6887cd55f8a in_seq=0 out_seq=0 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.610+0000 7f80f77fe640 1 -- 172.21.15.102:0/197951937 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f721265da0 con 0x55f720f049f0 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.610+0000 7f80f77fe640 10 client.25733 handle_command_reply: tid=0 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 client.25733 shutdown 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 msgr2=0x55f7212f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 0x55f7212f8e70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f810c02a930 tx=0x7f810c0317c0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 shutdown_connections 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f049f0 0x55f72130ac50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f46070 0x55f721304d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f25390 0x55f7212f8e70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f80f77fe640 0 client.25733 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 --2- 172.21.15.102:0/197951937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f1d1b0 0x55f7212f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 >> 172.21.15.102:0/197951937 conn(0x55f720f3a460 msgr2=0x55f7212f0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 shutdown_connections 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 1 -- 172.21.15.102:0/197951937 wait complete. 2024-09-21T03:39:00.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.611+0000 7f81248c5740 20 client.25733 trim_cache size 0 max 16384 2024-09-21T03:39:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 Processor -- start 2024-09-21T03:39:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 -- start start 2024-09-21T03:39:00.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f721304c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81181b2130 con 0x55f720f049f0 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81181afa00 con 0x55f720f1d1b0 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.628+0000 7f81248c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81181ad850 con 0x55f720f25390 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35502/0 (socket says 172.21.15.102:35502) 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 -- 172.21.15.102:0/1763025299 learned_addr learned my addr 172.21.15.102:0/1763025299 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 -- 172.21.15.102:0/1763025299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 msgr2=0x55f7212fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f811c8ee640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f81177fe640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f721304c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 -- 172.21.15.102:0/1763025299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 msgr2=0x55f721304c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f721304c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 -- 172.21.15.102:0/1763025299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7212e6580 con 0x55f720f049f0 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f811c8ee640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f81177fe640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f721304c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f8117fff640 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f81080aa920 tx=0x7f810800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7569379b47e06621 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f80fdffb640 1 -- 172.21.15.102:0/1763025299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080ad000 con 0x55f720f049f0 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f80fdffb640 1 -- 172.21.15.102:0/1763025299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81080ad1c0 con 0x55f720f049f0 2024-09-21T03:39:00.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.629+0000 7f80fdffb640 1 -- 172.21.15.102:0/1763025299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080ad480 con 0x55f720f049f0 2024-09-21T03:39:00.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 -- 172.21.15.102:0/1763025299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 msgr2=0x55f7212eec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f81080aa920 tx=0x7f810800cf10 comp rx=0 tx=0).stop 2024-09-21T03:39:00.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 -- 172.21.15.102:0/1763025299 shutdown_connections 2024-09-21T03:39:00.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f721304c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 --2- 172.21.15.102:0/1763025299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7212eec60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 -- 172.21.15.102:0/1763025299 >> 172.21.15.102:0/1763025299 conn(0x55f720f3a460 msgr2=0x55f7212f9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 -- 172.21.15.102:0/1763025299 shutdown_connections 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.630+0000 7f81248c5740 1 -- 172.21.15.102:0/1763025299 wait complete. 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 -- start start 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 Processor -- start 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f7212fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81181adec0 con 0x55f720f049f0 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81181af330 con 0x55f720f1d1b0 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81181ae590 con 0x55f720f25390 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81248c5740 10 client.0 _ll_register_callbacks cb 0x7f810c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:00.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f8117fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35518/0 (socket says 172.21.15.102:35518) 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f8117fff640 1 -- 172.21.15.102:0/3339890822 learned_addr learned my addr 172.21.15.102:0/3339890822 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f81177fe640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f7212fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.631+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 -- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 msgr2=0x55f7212fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 -- 172.21.15.102:0/3339890822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 msgr2=0x55f7212fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f7212fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 -- 172.21.15.102:0/3339890822 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7212fd8a0 con 0x55f720f049f0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f811c8ee640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f8117fff640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f81080edb60 tx=0x7f81080ad000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f94d31ee93fd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:00.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81080a9550 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8108018d50 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81080ad1c0 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f81080b2190 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 10 client.16407 fetch_fsmap learned FSMap version 34 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f721375560 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f81080ad1c0 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 34) ==== 8350+0+0 (secure 0 0 0) 0x7f81080a9000 con 0x55f720f049f0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 10 client.16407 fetch_fsmap finished waiting for FSMap version 34 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.632+0000 7f81248c5740 20 client.16407 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f46070 0x55f721377810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f81248c5740 4 client.16407 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f721261850 con 0x55f720f46070 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f81177fe640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f46070 0x55f721377810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:00.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f80f77fe640 10 client.16407 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f81177fe640 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f46070 0x55f721377810 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc9c158a6427ad3 server_cookie=84ba28b820a840e0 in_seq=0 out_seq=0 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f80f77fe640 1 -- 172.21.15.102:0/3339890822 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x55f721261850 con 0x55f720f46070 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.633+0000 7f80f77fe640 10 client.16407 handle_command_reply: tid=0 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 client.16407 shutdown 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 msgr2=0x55f7213015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f81080edb60 tx=0x7f81080ad000 comp rx=0 tx=0).stop 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 shutdown_connections 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f720f25390 0x55f7212fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f720f1d1b0 0x55f7212fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f720f46070 0x55f721377810 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f80f77fe640 0 client.16407 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 --2- 172.21.15.102:0/3339890822 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f720f049f0 0x55f7213015e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 >> 172.21.15.102:0/3339890822 conn(0x55f720f3a460 msgr2=0x55f7212eea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 shutdown_connections 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 1 -- 172.21.15.102:0/3339890822 wait complete. 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f81248c5740 20 client.16407 trim_cache size 0 max 16384 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:39:00.642 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.643 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:00.646 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 msgr2=0x7f81000b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 0x7f81000b8bc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8110005fd0 tx=0x7f8110009600 comp rx=0 tx=0).stop 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 msgr2=0x7f811819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.634+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f810800c920 tx=0x7f810800cde0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 shutdown_connections 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f81000b66b0 0x7f81000b8bc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8118109df0 0x7f811819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81181094a0 0x7f811819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 --2- 172.21.15.102:0/3403312063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8118103b60 0x7f811819a600 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:00.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 >> 172.21.15.102:0/3403312063 conn(0x7f811807b850 msgr2=0x7f8118107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:00.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 shutdown_connections 2024-09-21T03:39:00.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:00.635+0000 7f811e351640 1 -- 172.21.15.102:0/3403312063 wait complete. 2024-09-21T03:39:01.425 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:39:01.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:01.693 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:01 smithi102 ceph-mon[31392]: pgmap v487: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:01.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:01 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:01 smithi148 ceph-mon[34651]: pgmap v487: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:01.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:01 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:01 smithi121 ceph-mon[34316]: pgmap v487: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:01.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:01 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 -- 172.21.15.102:0/1719214114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0104860 msgr2=0x7fe0a0104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1719214114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0104860 0x7fe0a0104c70 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe090009ca0 tx=0x7fe09002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 -- 172.21.15.102:0/1719214114 shutdown_connections 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1719214114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a010de10 0x7fe0a01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1719214114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a0105290 0x7fe0a010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1719214114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0104860 0x7fe0a0104c70 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 -- 172.21.15.102:0/1719214114 >> 172.21.15.102:0/1719214114 conn(0x7fe0a0079730 msgr2=0x7fe0a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:02.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 -- 172.21.15.102:0/1719214114 shutdown_connections 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.181+0000 7fe0a5083640 1 -- 172.21.15.102:0/1719214114 wait complete. 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 Processor -- start 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 -- start start 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a0104860 0x7fe0a019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a010de10 0x7fe0a019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0113bc0 con 0x7fe0a0105290 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0113a40 con 0x7fe0a010de10 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe0a5083640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a0113d40 con 0x7fe0a0104860 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe09e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe09e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35530/0 (socket says 172.21.15.102:35530) 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe09e59c640 1 -- 172.21.15.102:0/1026472609 learned_addr learned my addr 172.21.15.102:0/1026472609 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.182+0000 7fe09ed9d640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a0104860 0x7fe0a019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:02.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09f59e640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a010de10 0x7fe0a019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 -- 172.21.15.102:0/1026472609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a0104860 msgr2=0x7fe0a019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a0104860 0x7fe0a019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 -- 172.21.15.102:0/1026472609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a010de10 msgr2=0x7fe0a019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a010de10 0x7fe0a019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 -- 172.21.15.102:0/1026472609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a01a0400 con 0x7fe0a0105290 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe09e59c640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c8c0 tx=0x7fe09400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094007bb0 con 0x7fe0a0105290 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe094007d50 con 0x7fe0a0105290 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0940188c0 con 0x7fe0a0105290 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a01a06f0 con 0x7fe0a0105290 2024-09-21T03:39:02.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.183+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a01a6f10 con 0x7fe0a0105290 2024-09-21T03:39:02.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.184+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a0104c70 con 0x7fe0a0105290 2024-09-21T03:39:02.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.187+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe09400fb60 con 0x7fe0a0105290 2024-09-21T03:39:02.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.187+0000 7fe087fff640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 0x7fe0880b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:02.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.187+0000 7fe09ed9d640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 0x7fe0880b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:02.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.188+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe0940e79a0 con 0x7fe0a0105290 2024-09-21T03:39:02.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.188+0000 7fe09ed9d640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 0x7fe0880b8c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe090005e30 tx=0x7fe090009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:02.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.191+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe094014030 con 0x7fe0a0105290 2024-09-21T03:39:02.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.405+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0a019b680 con 0x7fe0a0105290 2024-09-21T03:39:02.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.406+0000 7fe087fff640 1 -- 172.21.15.102:0/1026472609 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11934 (secure 0 0 0) 0x7fe0940adff0 con 0x7fe0a0105290 2024-09-21T03:39:02.408 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:39:02.408 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":34,"btime":"2024-09-21T03:38:52:397802+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:38:51.620859+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24661,24659,24637]},"id":1}]} 2024-09-21T03:39:02.408 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 34 2024-09-21T03:39:02.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 msgr2=0x7fe0880b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:02.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 0x7fe0880b8c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe090005e30 tx=0x7fe090009360 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 msgr2=0x7fe0a019aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c8c0 tx=0x7fe09400cd80 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 shutdown_connections 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe0880b6730 0x7fe0880b8c40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a0105290 0x7fe0a019aaf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe0a010de10 0x7fe0a019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 --2- 172.21.15.102:0/1026472609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe0a0104860 0x7fe0a019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 >> 172.21.15.102:0/1026472609 conn(0x7fe0a0079730 msgr2=0x7fe0a0107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 shutdown_connections 2024-09-21T03:39:02.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:02.408+0000 7fe0a5083640 1 -- 172.21.15.102:0/1026472609 wait complete. 2024-09-21T03:39:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:02.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:39:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:39:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:39:02.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:39:02.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:39:03.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:39:03.341 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:03 smithi102 ceph-mon[31392]: pgmap v488: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:39:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:03 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1026472609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:03.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:03 smithi102 ceph-mon[31392]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:39:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:03 smithi148 ceph-mon[34651]: pgmap v488: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:39:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:03 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1026472609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:03 smithi148 ceph-mon[34651]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:39:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:03 smithi121 ceph-mon[34316]: pgmap v488: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:39:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:03 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1026472609' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:03.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:03 smithi121 ceph-mon[34316]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T03:39:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 -- 172.21.15.102:0/4132941049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 msgr2=0x7f68c010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/4132941049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c010d8b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009900 tx=0x7f68a802a410 comp rx=0 tx=0).stop 2024-09-21T03:39:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 -- 172.21.15.102:0/4132941049 shutdown_connections 2024-09-21T03:39:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/4132941049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c010d8b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/4132941049 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 0x7f68c0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/4132941049 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 0x7f68c0104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 -- 172.21.15.102:0/4132941049 >> 172.21.15.102:0/4132941049 conn(0x7f68c0079730 msgr2=0x7f68c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 -- 172.21.15.102:0/4132941049 shutdown_connections 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.841+0000 7f68c6b1a640 1 -- 172.21.15.102:0/4132941049 wait complete. 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 Processor -- start 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 -- start start 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 0x7f68c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 0x7f68c019fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0113b90 con 0x7f68c0105270 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0113a10 con 0x7f68c0104840 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c6b1a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0113d10 con 0x7f68c010ddf0 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35548/0 (socket says 172.21.15.102:35548) 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 -- 172.21.15.102:0/153704310 learned_addr learned my addr 172.21.15.102:0/153704310 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c48b6640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 0x7f68c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68c50b7640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 0x7f68c019fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 -- 172.21.15.102:0/153704310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 msgr2=0x7f68c019fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 0x7f68c019fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 -- 172.21.15.102:0/153704310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 msgr2=0x7f68c019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.842+0000 7f68bffff640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 0x7f68c019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68bffff640 1 -- 172.21.15.102:0/153704310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c01a0490 con 0x7f68c0105270 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68bffff640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68a8005940 tx=0x7f68a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68bdffb640 1 -- 172.21.15.102:0/153704310 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a803f030 con 0x7f68c0105270 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c01a0720 con 0x7f68c0105270 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68bdffb640 1 -- 172.21.15.102:0/153704310 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68a8031910 con 0x7f68c0105270 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68bdffb640 1 -- 172.21.15.102:0/153704310 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8035070 con 0x7f68c0105270 2024-09-21T03:39:03.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.843+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a0c00 con 0x7f68c0105270 2024-09-21T03:39:03.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 Processor -- start 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 -- start start 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bdffb640 1 -- 172.21.15.102:0/153704310 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f68a8042030 con 0x7f68c0105270 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae376070 0x55bcae71d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 0x55bcae71dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bcae693ea0 con 0x55bcae355390 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bcae6832d0 con 0x55bcae376070 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68cd08e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bcae6870e0 con 0x55bcae34d1b0 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35564/0 (socket says 172.21.15.102:35564) 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 -- 172.21.15.102:0/2410429889 learned_addr learned my addr 172.21.15.102:0/2410429889 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68c50b7640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae376070 0x55bcae71d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 0x55bcae71dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 -- 172.21.15.102:0/2410429889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 msgr2=0x55bcae71dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 0x55bcae71dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 -- 172.21.15.102:0/2410429889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae376070 msgr2=0x55bcae71d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae376070 0x55bcae71d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.846+0000 7f68bffff640 1 -- 172.21.15.102:0/2410429889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcae3e1650 con 0x55bcae355390 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 0x55bcae71dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68bdffb640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 0x7f68ac0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68bffff640 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f68a81051e0 tx=0x7f68a810be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c304093370c4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68c50b7640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 0x7f68ac0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68b6ffd640 1 -- 172.21.15.102:0/2410429889 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80ca070 con 0x55bcae355390 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68bdffb640 1 -- 172.21.15.102:0/153704310 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f68a8107b30 con 0x7f68c0105270 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68b6ffd640 1 -- 172.21.15.102:0/2410429889 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68a80cd530 con 0x55bcae355390 2024-09-21T03:39:03.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.847+0000 7f68b6ffd640 1 -- 172.21.15.102:0/2410429889 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80433c0 con 0x55bcae355390 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- 172.21.15.102:0/2410429889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 msgr2=0x55bcae71e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68c50b7640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 0x7f68ac0b8bc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ac10 tx=0x7f68b800a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f68a81051e0 tx=0x7f68a810be00 comp rx=0 tx=0).stop 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- 172.21.15.102:0/2410429889 shutdown_connections 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71e120 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae34d1b0 0x55bcae71dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2410429889 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae376070 0x55bcae71d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- 172.21.15.102:0/2410429889 >> 172.21.15.102:0/2410429889 conn(0x55bcae36a460 msgr2=0x55bcae71b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- 172.21.15.102:0/2410429889 shutdown_connections 2024-09-21T03:39:03.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- 172.21.15.102:0/2410429889 wait complete. 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.848+0000 7f68cd08e740 1 -- start start 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 Processor -- start 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae728d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae355390 0x55bcae7292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bcae4e4700 con 0x55bcae376070 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bcae61e160 con 0x55bcae34d1b0 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55bcae72bc40 con 0x55bcae355390 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68cd08e740 10 client.0 _ll_register_callbacks cb 0x55bcae6379e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35572/0 (socket says 172.21.15.102:35572) 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 -- 172.21.15.102:0/848626559 learned_addr learned my addr 172.21.15.102:0/848626559 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c48b6640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae728d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68bffff640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae355390 0x55bcae7292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 -- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae355390 msgr2=0x55bcae7292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae355390 0x55bcae7292b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.849+0000 7f68c50b7640 1 -- 172.21.15.102:0/848626559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 msgr2=0x55bcae728d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68c50b7640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae728d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68c50b7640 1 -- 172.21.15.102:0/848626559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcae64bc90 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68c48b6640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae728d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68c50b7640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f68b801c8d0 tx=0x7f68b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef1f0ab801b2bb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b802c060 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f68b8016030 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a80cd530 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f68b8030420 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68cd08e740 10 client.16425 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bcae737860 con 0x55bcae376070 2024-09-21T03:39:03.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68a80cd530 con 0x55bcae376070 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.850+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f68b800f5e0 con 0x55bcae376070 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 10 client.16425 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 10 client.16425 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 20 client.16425 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae3349f0 0x55bcae73ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 4 client.16425 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcae695df0 con 0x55bcae3349f0 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68c48b6640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae3349f0 0x55bcae73ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f689ffff640 10 client.16425 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.851+0000 7f68c48b6640 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae3349f0 0x55bcae73ad90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62545b7797324426 server_cookie=6da3489a3f5b8338 in_seq=0 out_seq=0 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f689ffff640 1 -- 172.21.15.102:0/848626559 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcae695df0 con 0x55bcae3349f0 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f689ffff640 10 client.16425 handle_command_reply: tid=0 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 client.16425 shutdown 2024-09-21T03:39:03.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 msgr2=0x55bcae734e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f68b801c8d0 tx=0x7f68b8004730 comp rx=0 tx=0).stop 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 shutdown_connections 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae3349f0 0x55bcae73ad90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f689ffff640 0 client.16425 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae376070 0x55bcae734e60 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae355390 0x55bcae7292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 --2- 172.21.15.102:0/848626559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae728d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.852+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 >> 172.21.15.102:0/848626559 conn(0x55bcae36a460 msgr2=0x55bcae720830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.853+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 shutdown_connections 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.853+0000 7f68cd08e740 1 -- 172.21.15.102:0/848626559 wait complete. 2024-09-21T03:39:03.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.853+0000 7f68cd08e740 20 client.16425 trim_cache size 0 max 16384 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 Processor -- start 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 -- start start 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae71ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae71abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01b21c0 con 0x55bcae355390 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01afa90 con 0x55bcae34d1b0 2024-09-21T03:39:03.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68cd08e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01ad8e0 con 0x55bcae3349f0 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68c50b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68c50b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35580/0 (socket says 172.21.15.102:35580) 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68c50b7640 1 -- 172.21.15.102:0/1628717668 learned_addr learned my addr 172.21.15.102:0/1628717668 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68c48b6640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae71ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68bffff640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae71abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.866+0000 7f68c50b7640 1 -- 172.21.15.102:0/1628717668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 msgr2=0x55bcae71ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68c50b7640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae71ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68c50b7640 1 -- 172.21.15.102:0/1628717668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 msgr2=0x55bcae71abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68c50b7640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae71abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68c50b7640 1 -- 172.21.15.102:0/1628717668 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcae71f990 con 0x55bcae355390 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68bffff640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae71abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68c50b7640 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f68b800a330 tx=0x7f68b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c605aa8e24004cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68b67fc640 1 -- 172.21.15.102:0/1628717668 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b800fc40 con 0x55bcae355390 2024-09-21T03:39:03.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68b67fc640 1 -- 172.21.15.102:0/1628717668 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68b800fde0 con 0x55bcae355390 2024-09-21T03:39:03.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.867+0000 7f68b67fc640 1 -- 172.21.15.102:0/1628717668 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8004a00 con 0x55bcae355390 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- 172.21.15.102:0/1628717668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 msgr2=0x55bcae71b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f68b800a330 tx=0x7f68b80046c0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- 172.21.15.102:0/1628717668 shutdown_connections 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae355390 0x55bcae71b100 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae34d1b0 0x55bcae71abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 --2- 172.21.15.102:0/1628717668 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae71ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- 172.21.15.102:0/1628717668 >> 172.21.15.102:0/1628717668 conn(0x55bcae36a460 msgr2=0x55bcae71e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- 172.21.15.102:0/1628717668 shutdown_connections 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- 172.21.15.102:0/1628717668 wait complete. 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 -- start start 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.868+0000 7f68cd08e740 1 Processor -- start 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae72cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae355390 0x55bcae7a4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01adf50 con 0x55bcae34d1b0 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01af3c0 con 0x55bcae355390 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01ae620 con 0x55bcae3349f0 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68cd08e740 10 client.0 _ll_register_callbacks cb 0x7f68b8005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35594/0 (socket says 172.21.15.102:35594) 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 -- 172.21.15.102:0/2193497213 learned_addr learned my addr 172.21.15.102:0/2193497213 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68c50b7640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae355390 0x55bcae7a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae72cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 -- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 msgr2=0x55bcae72cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae72cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 -- 172.21.15.102:0/2193497213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae355390 msgr2=0x55bcae7a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae355390 0x55bcae7a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 -- 172.21.15.102:0/2193497213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcae72dcd0 con 0x55bcae34d1b0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae72cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f68bffff640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f68a80f1040 tx=0x7f68a810bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f478cc37fb6f7d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.869+0000 7f689ffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8049040 con 0x55bcae34d1b0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f68a80d21c0 con 0x55bcae34d1b0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68b800fde0 con 0x55bcae34d1b0 2024-09-21T03:39:03.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f68a80303a0 con 0x55bcae34d1b0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 10 client.16431 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55bcae7a5bb0 con 0x55bcae34d1b0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f68b800fde0 con 0x55bcae34d1b0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f68a80f2070 con 0x55bcae34d1b0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 10 client.16431 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 20 client.16431 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae376070 0x55bcae7a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 4 client.16431 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.870+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bcae6918a0 con 0x55bcae376070 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae376070 0x55bcae7a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f689ffff640 10 client.16431 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68c48b6640 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae376070 0x55bcae7a81a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7579e06553108e96 server_cookie=983093385962df7c in_seq=0 out_seq=0 2024-09-21T03:39:03.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f689ffff640 1 -- 172.21.15.102:0/2193497213 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bcae6918a0 con 0x55bcae376070 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f689ffff640 10 client.16431 handle_command_reply: tid=0 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 client.16431 shutdown 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 msgr2=0x55bcae72d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f68a80f1040 tx=0x7f68a810bc70 comp rx=0 tx=0).stop 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 shutdown_connections 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55bcae376070 0x55bcae7a81a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bcae34d1b0 0x55bcae72d4e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bcae355390 0x55bcae7a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 --2- 172.21.15.102:0/2193497213 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55bcae3349f0 0x55bcae72cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 >> 172.21.15.102:0/2193497213 conn(0x55bcae36a460 msgr2=0x55bcae72a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.871+0000 7f689ffff640 0 client.16431 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 shutdown_connections 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68cd08e740 1 -- 172.21.15.102:0/2193497213 wait complete. 2024-09-21T03:39:03.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68cd08e740 20 client.16431 trim_cache size 0 max 16384 2024-09-21T03:39:03.879 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 msgr2=0x7f68ac0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 0x7f68ac0b8bc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f68b800ac10 tx=0x7f68b800a250 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 msgr2=0x7f68c019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f68a8005940 tx=0x7f68a80042f0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 shutdown_connections 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f68ac0b66b0 0x7f68ac0b8bc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f68c0105270 0x7f68c019ab80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f68c010ddf0 0x7f68c019fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 --2- 172.21.15.102:0/153704310 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c0104840 0x7f68c019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 >> 172.21.15.102:0/153704310 conn(0x7f68c0079730 msgr2=0x7f68c0100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 shutdown_connections 2024-09-21T03:39:03.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:03.872+0000 7f68c6b1a640 1 -- 172.21.15.102:0/153704310 wait complete. 2024-09-21T03:39:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:04 smithi102 ceph-mon[31392]: pgmap v489: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:39:04.545 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:39:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:04 smithi148 ceph-mon[34651]: pgmap v489: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:39:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:04 smithi121 ceph-mon[34316]: pgmap v489: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 20 op/s 2024-09-21T03:39:04.790 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 -- 172.21.15.102:0/3575975217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 msgr2=0x7fe63c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3575975217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c110630 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe634009900 tx=0x7fe63402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 -- 172.21.15.102:0/3575975217 shutdown_connections 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3575975217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c110630 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3575975217 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 0x7fe63c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3575975217 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 0x7fe63c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 -- 172.21.15.102:0/3575975217 >> 172.21.15.102:0/3575975217 conn(0x7fe63c07b910 msgr2=0x7fe63c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 -- 172.21.15.102:0/3575975217 shutdown_connections 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.310+0000 7fe640d4b640 1 -- 172.21.15.102:0/3575975217 wait complete. 2024-09-21T03:39:05.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 Processor -- start 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 -- start start 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 0x7fe63c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 0x7fe63c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113c60 con 0x7fe63c109e00 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113ae0 con 0x7fe63c1094b0 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe640d4b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113de0 con 0x7fe63c103bc0 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.311+0000 7fe63ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45276/0 (socket says 172.21.15.102:45276) 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 -- 172.21.15.102:0/3679716680 learned_addr learned my addr 172.21.15.102:0/3679716680 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 0x7fe63c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 -- 172.21.15.102:0/3679716680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 msgr2=0x7fe63c19a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63a59c640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 0x7fe63c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 0x7fe63c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 -- 172.21.15.102:0/3679716680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 msgr2=0x7fe63c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 0x7fe63c19abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 -- 172.21.15.102:0/3679716680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c1a0580 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe634005ab0 tx=0x7fe6340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe62b7fe640 1 -- 172.21.15.102:0/3679716680 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63403f030 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c1a0810 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe62b7fe640 1 -- 172.21.15.102:0/3679716680 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe634003cd0 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe62b7fe640 1 -- 172.21.15.102:0/3679716680 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634035070 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.312+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1a6fd0 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.315+0000 7fe6472bf740 1 Processor -- start 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.315+0000 7fe62b7fe640 1 -- 172.21.15.102:0/3679716680 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe634042030 con 0x7fe63c109e00 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 -- start start 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba6492c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba281390 0x5563ba649d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5563ba5bfea0 con 0x5563ba2791b0 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563ba5af2d0 con 0x5563ba281390 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe6472bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563ba5b30e0 con 0x5563ba2a2070 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45292/0 (socket says 172.21.15.102:45292) 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 -- 172.21.15.102:0/3828113861 learned_addr learned my addr 172.21.15.102:0/3828113861 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba281390 0x5563ba649d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba6492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 -- 172.21.15.102:0/3828113861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 msgr2=0x5563ba6492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba6492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 -- 172.21.15.102:0/3828113861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba281390 msgr2=0x5563ba649d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba281390 0x5563ba649d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe62b7fe640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 0x7fe6240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe63a59c640 1 -- 172.21.15.102:0/3828113861 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ba30d650 con 0x5563ba2791b0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.316+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba6492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe63a59c640 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe62c007e10 tx=0x7fe62c00c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73f5202bf48bb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 0x7fe6240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe62b7fe640 1 -- 172.21.15.102:0/3679716680 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe634107820 con 0x7fe63c109e00 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe628ff9640 1 -- 172.21.15.102:0/3828113861 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c015020 con 0x5563ba2791b0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe628ff9640 1 -- 172.21.15.102:0/3828113861 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe62c011b00 con 0x5563ba2791b0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.317+0000 7fe628ff9640 1 -- 172.21.15.102:0/3828113861 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c010b50 con 0x5563ba2791b0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- 172.21.15.102:0/3828113861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 msgr2=0x5563ba649800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe62c007e10 tx=0x7fe62c00c560 comp rx=0 tx=0).stop 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe639d9b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 0x7fe6240b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe630005d00 tx=0x7fe630015040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- 172.21.15.102:0/3828113861 shutdown_connections 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba2791b0 0x5563ba649800 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba281390 0x5563ba649d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 --2- 172.21.15.102:0/3828113861 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba6492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- 172.21.15.102:0/3828113861 >> 172.21.15.102:0/3828113861 conn(0x5563ba296460 msgr2=0x5563ba6471b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- 172.21.15.102:0/3828113861 shutdown_connections 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- 172.21.15.102:0/3828113861 wait complete. 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 -- start start 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.318+0000 7fe6472bf740 1 Processor -- start 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba654940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba6553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5563ba410700 con 0x5563ba281390 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563ba54a160 con 0x5563ba2a2070 2024-09-21T03:39:05.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563ba657aa0 con 0x5563ba2791b0 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe6472bf740 10 client.0 _ll_register_callbacks cb 0x5563ba5639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45308/0 (socket says 172.21.15.102:45308) 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 -- 172.21.15.102:0/2208727955 learned_addr learned my addr 172.21.15.102:0/2208727955 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba6553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe63a59c640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba654940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 -- 172.21.15.102:0/2208727955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 msgr2=0x5563ba654940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba654940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 -- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 msgr2=0x5563ba6553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba6553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe639d9b640 1 -- 172.21.15.102:0/2208727955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ba577c90 con 0x5563ba281390 2024-09-21T03:39:05.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.319+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba6553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:05.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.320+0000 7fe639d9b640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06aa20 tx=0x7fe630004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966b11ac4500c733 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.320+0000 7fe621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.320+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63001a070 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.320+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe630011a70 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.320+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe62c011b00 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe630011c70 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 10 client.16443 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5563ba6637b0 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe62c011b00 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe63000f040 con 0x5563ba281390 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 10 client.16443 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 10 client.16443 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 20 client.16443 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba2609f0 0x5563ba666d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 4 client.16443 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:05.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.321+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563ba5c1df0 con 0x5563ba2609f0 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.322+0000 7fe63a59c640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba2609f0 0x5563ba666d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.322+0000 7fe621ffb640 10 client.16443 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.322+0000 7fe63a59c640 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba2609f0 0x5563ba666d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8086d565a62eef38 server_cookie=b011a9b3eef4ebd3 in_seq=0 out_seq=0 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe621ffb640 1 -- 172.21.15.102:0/2208727955 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563ba5c1df0 con 0x5563ba2609f0 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe621ffb640 10 client.16443 handle_command_reply: tid=0 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 client.16443 shutdown 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 msgr2=0x5563ba654e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe63c06aa20 tx=0x7fe630004730 comp rx=0 tx=0).stop 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 shutdown_connections 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba2609f0 0x5563ba666d50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654e80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba6553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe621ffb640 0 client.16443 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:05.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 --2- 172.21.15.102:0/2208727955 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba654940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 >> 172.21.15.102:0/2208727955 conn(0x5563ba296460 msgr2=0x5563ba64c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 shutdown_connections 2024-09-21T03:39:05.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 1 -- 172.21.15.102:0/2208727955 wait complete. 2024-09-21T03:39:05.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.323+0000 7fe6472bf740 20 client.16443 trim_cache size 0 max 16384 2024-09-21T03:39:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.336+0000 7fe6472bf740 1 Processor -- start 2024-09-21T03:39:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.336+0000 7fe6472bf740 1 -- start start 2024-09-21T03:39:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2791b0 0x5563ba6546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba651b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1b22d0 con 0x5563ba281390 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1afba0 con 0x5563ba2791b0 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe6472bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1ad9f0 con 0x5563ba2a2070 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45324/0 (socket says 172.21.15.102:45324) 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 -- 172.21.15.102:0/1647749834 learned_addr learned my addr 172.21.15.102:0/1647749834 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba651b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe63a59c640 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2791b0 0x5563ba6546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 -- 172.21.15.102:0/1647749834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 msgr2=0x5563ba651b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba651b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 -- 172.21.15.102:0/1647749834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2791b0 msgr2=0x5563ba6546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2791b0 0x5563ba6546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.337+0000 7fe639d9b640 1 -- 172.21.15.102:0/1647749834 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563ba64f540 con 0x5563ba281390 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.338+0000 7fe639d9b640 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe63000e8a0 tx=0x7fe63000e390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a67d3cbc366004d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.338+0000 7fe623fff640 1 -- 172.21.15.102:0/1647749834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63001a070 con 0x5563ba281390 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.338+0000 7fe623fff640 1 -- 172.21.15.102:0/1647749834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe630011870 con 0x5563ba281390 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.338+0000 7fe623fff640 1 -- 172.21.15.102:0/1647749834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe63002f030 con 0x5563ba281390 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- 172.21.15.102:0/1647749834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 msgr2=0x5563ba654c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe63000e8a0 tx=0x7fe63000e390 comp rx=0 tx=0).stop 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- 172.21.15.102:0/1647749834 shutdown_connections 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba654c30 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2a2070 0x5563ba651b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- 172.21.15.102:0/1647749834 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2791b0 0x5563ba6546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- 172.21.15.102:0/1647749834 >> 172.21.15.102:0/1647749834 conn(0x5563ba296460 msgr2=0x5563ba6531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- 172.21.15.102:0/1647749834 shutdown_connections 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- 172.21.15.102:0/1647749834 wait complete. 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- start start 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 Processor -- start 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba65d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba658f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1ae060 con 0x5563ba281390 2024-09-21T03:39:05.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1af4d0 con 0x5563ba2a2070 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.339+0000 7fe6472bf740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c1ae730 con 0x5563ba2791b0 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe6472bf740 10 client.0 _ll_register_callbacks cb 0x7fe63000e770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45334/0 (socket says 172.21.15.102:45334) 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 -- 172.21.15.102:0/693186559 learned_addr learned my addr 172.21.15.102:0/693186559 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba658f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe63a59c640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba65d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 -- 172.21.15.102:0/693186559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 msgr2=0x5563ba65d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba65d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 -- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 msgr2=0x5563ba658f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba658f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 -- 172.21.15.102:0/693186559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563ba6596d0 con 0x5563ba281390 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe63a59c640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba65d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:05.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe63ad9d640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba658f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe639d9b640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe630011c30 tx=0x7fe630004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1a72a63c51bec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe630040070 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fe630011200 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe630011870 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe63004b050 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.340+0000 7fe6472bf740 10 client.16449 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5563ba6d16b0 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe630005520 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe63002aaf0 con 0x5563ba281390 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 10 client.16449 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 20 client.16449 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:05.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba235da0 0x5563ba6d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:05.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 4 client.16449 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:05.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fe630011870 con 0x5563ba235da0 2024-09-21T03:39:05.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.341+0000 7fe63a59c640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba235da0 0x5563ba6d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe63a59c640 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba235da0 0x5563ba6d3cd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d3ac84b0f7c857c7 server_cookie=43ebbc5fc38a9e5f in_seq=0 out_seq=0 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe621ffb640 10 client.16449 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe621ffb640 1 -- 172.21.15.102:0/693186559 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fe630011870 con 0x5563ba235da0 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe621ffb640 10 client.16449 handle_command_reply: tid=0 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 client.16449 shutdown 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 msgr2=0x5563ba6589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe630011c30 tx=0x7fe630004a20 comp rx=0 tx=0).stop 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 shutdown_connections 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5563ba235da0 0x5563ba6d3cd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563ba281390 0x5563ba6589e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563ba2a2070 0x5563ba658f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 --2- 172.21.15.102:0/693186559 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563ba2791b0 0x5563ba65d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 >> 172.21.15.102:0/693186559 conn(0x5563ba296460 msgr2=0x5563ba653100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe621ffb640 0 client.16449 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 shutdown_connections 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 1 -- 172.21.15.102:0/693186559 wait complete. 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.342+0000 7fe6472bf740 20 client.16449 trim_cache size 0 max 16384 2024-09-21T03:39:05.349 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 msgr2=0x7fe6240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 0x7fe6240b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe630005d00 tx=0x7fe630015040 comp rx=0 tx=0).stop 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 msgr2=0x7fe63c19fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe634005ab0 tx=0x7fe6340042f0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 shutdown_connections 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe6240b6680 0x7fe6240b8b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe63c109e00 0x7fe63c19fe50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe63c1094b0 0x7fe63c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 --2- 172.21.15.102:0/3679716680 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe63c103bc0 0x7fe63c19a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:05.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 >> 172.21.15.102:0/3679716680 conn(0x7fe63c07b910 msgr2=0x7fe63c107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:05.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 shutdown_connections 2024-09-21T03:39:05.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:05.343+0000 7fe640d4b640 1 -- 172.21.15.102:0/3679716680 wait complete. 2024-09-21T03:39:06.222 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:39:06.467 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 -- 172.21.15.102:0/714546946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 msgr2=0x7fcfc8103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 --2- 172.21.15.102:0/714546946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc8103680 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4009900 tx=0x7fcfc402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 -- 172.21.15.102:0/714546946 shutdown_connections 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 --2- 172.21.15.102:0/714546946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 0x7fcfc810f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 --2- 172.21.15.102:0/714546946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 0x7fcfc8105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 --2- 172.21.15.102:0/714546946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc8103680 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 -- 172.21.15.102:0/714546946 >> 172.21.15.102:0/714546946 conn(0x7fcfc8079ec0 msgr2=0x7fcfc807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.894+0000 7fcfd031b640 1 -- 172.21.15.102:0/714546946 shutdown_connections 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.895+0000 7fcfd031b640 1 -- 172.21.15.102:0/714546946 wait complete. 2024-09-21T03:39:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.895+0000 7fcfd031b640 1 Processor -- start 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.895+0000 7fcfd031b640 1 -- start start 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 0x7fcfc819ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 0x7fcfc81a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8113d50 con 0x7fcfc8103270 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8113bd0 con 0x7fcfc8105b90 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfd031b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc8113ed0 con 0x7fcfc8105240 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45358/0 (socket says 172.21.15.102:45358) 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 -- 172.21.15.102:0/1717458182 learned_addr learned my addr 172.21.15.102:0/1717458182 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 0x7fcfc81a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 0x7fcfc819ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 -- 172.21.15.102:0/1717458182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 msgr2=0x7fcfc819ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 0x7fcfc819ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 -- 172.21.15.102:0/1717458182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 msgr2=0x7fcfc81a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 0x7fcfc81a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.896+0000 7fcfce0b7640 1 -- 172.21.15.102:0/1717458182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfc81a2830 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4006010 tx=0x7fcfc4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfbf7fe640 1 -- 172.21.15.102:0/1717458182 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc403f070 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfc81a2ac0 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfbf7fe640 1 -- 172.21.15.102:0/1717458182 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc4003ac0 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfbf7fe640 1 -- 172.21.15.102:0/1717458182 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4035030 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.897+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfc81a9280 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.899+0000 7fcfd688f740 1 Processor -- start 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 -- start start 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfbf7fe640 1 -- 172.21.15.102:0/1717458182 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fcfc4042070 con 0x7fcfc8103270 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x55795438bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x55795438c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557954301ea0 con 0x557953fe4070 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5579542f12d0 con 0x557953fc3390 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfd688f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5579542f50e0 con 0x557953fbb1b0 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45366/0 (socket says 172.21.15.102:45366) 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfce8b8640 1 -- 172.21.15.102:0/772474154 learned_addr learned my addr 172.21.15.102:0/772474154 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x55795438bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.900+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x55795438c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 -- 172.21.15.102:0/772474154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 msgr2=0x55795438bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x55795438bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 -- 172.21.15.102:0/772474154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 msgr2=0x55795438c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x55795438c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 -- 172.21.15.102:0/772474154 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55795404f650 con 0x557953fe4070 2024-09-21T03:39:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfbf7fe640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 0x7fcfb40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000a430 tx=0x7fcfc0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44ea9bedf9c945a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 0x7fcfb40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfbcd9a640 1 -- 172.21.15.102:0/772474154 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0013790 con 0x557953fe4070 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfbcd9a640 1 -- 172.21.15.102:0/772474154 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc0019070 con 0x557953fe4070 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfbcd9a640 1 -- 172.21.15.102:0/772474154 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0014de0 con 0x557953fe4070 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.901+0000 7fcfbf7fe640 1 -- 172.21.15.102:0/1717458182 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcfc4108080 con 0x7fcfc8103270 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- 172.21.15.102:0/772474154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 msgr2=0x55795438b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfce0b7640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 0x7fcfb40b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4105870 tx=0x7fcfc410bbd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000a430 tx=0x7fcfc0009650 comp rx=0 tx=0).stop 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- 172.21.15.102:0/772474154 shutdown_connections 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x55795438c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x55795438bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 --2- 172.21.15.102:0/772474154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fe4070 0x55795438b6a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- 172.21.15.102:0/772474154 >> 172.21.15.102:0/772474154 conn(0x557953fd8460 msgr2=0x557954389590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- 172.21.15.102:0/772474154 shutdown_connections 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- 172.21.15.102:0/772474154 wait complete. 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.902+0000 7fcfd688f740 1 -- start start 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 Processor -- start 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x557954397260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x5579543a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557954152700 con 0x557953fbb1b0 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55795428c160 con 0x557953fc3390 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557954399e80 con 0x557953fe4070 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfd688f740 10 client.0 _ll_register_callbacks cb 0x5579542a59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45380/0 (socket says 172.21.15.102:45380) 2024-09-21T03:39:06.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 -- 172.21.15.102:0/3096738442 learned_addr learned my addr 172.21.15.102:0/3096738442 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x5579543a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x557954397260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 -- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 msgr2=0x5579543a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x5579543a3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 -- 172.21.15.102:0/3096738442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 msgr2=0x557954397260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x557954397260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 -- 172.21.15.102:0/3096738442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579542b9c90 con 0x557953fbb1b0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x557954397260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0014960 tx=0x7fcfc00149c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1dac7527d402caf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.903+0000 7fcfb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0026070 con 0x557953fbb1b0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcfc0013790 con 0x557953fbb1b0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc0019070 con 0x557953fbb1b0 2024-09-21T03:39:06.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcfc0013990 con 0x557953fbb1b0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 10 client.16461 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5579543a5b50 con 0x557953fbb1b0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc0019070 con 0x557953fbb1b0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcfc0021b00 con 0x557953fbb1b0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 10 client.16461 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 10 client.16461 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 20 client.16461 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953fa29f0 0x5579543a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 4 client.16461 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.904+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557954303df0 con 0x557953fa29f0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.905+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953fa29f0 0x5579543a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.905+0000 7fcfb1ffb640 10 client.16461 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:06.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.905+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953fa29f0 0x5579543a8f10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685a25084b037f98 server_cookie=1a40aae6ae25f85b in_seq=0 out_seq=0 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3096738442 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557954303df0 con 0x557953fa29f0 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfb1ffb640 10 client.16461 handle_command_reply: tid=0 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 client.16461 shutdown 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 msgr2=0x557954396d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0014960 tx=0x7fcfc00149c0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 shutdown_connections 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x5579543a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x557954397260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953fa29f0 0x5579543a8f10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3096738442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x557954396d20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfb1ffb640 0 client.16461 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 >> 172.21.15.102:0/3096738442 conn(0x557953fd8460 msgr2=0x55795438e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 shutdown_connections 2024-09-21T03:39:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 1 -- 172.21.15.102:0/3096738442 wait complete. 2024-09-21T03:39:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.906+0000 7fcfd688f740 20 client.16461 trim_cache size 0 max 16384 2024-09-21T03:39:06.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.919+0000 7fcfd688f740 1 Processor -- start 2024-09-21T03:39:06.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.919+0000 7fcfd688f740 1 -- start start 2024-09-21T03:39:06.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.919+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.919+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x5579543a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x557954393f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfd688f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b4480 con 0x557953fbb1b0 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfd688f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b1d50 con 0x557953fc3390 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfd688f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81afba0 con 0x557953fe4070 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45388/0 (socket says 172.21.15.102:45388) 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 -- 172.21.15.102:0/2875906184 learned_addr learned my addr 172.21.15.102:0/2875906184 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x5579543a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 -- 172.21.15.102:0/2875906184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 msgr2=0x557954393f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x557954393f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 -- 172.21.15.102:0/2875906184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 msgr2=0x5579543a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x5579543a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 -- 172.21.15.102:0/2875906184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579543af200 con 0x557953fbb1b0 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000ae00 tx=0x7fcfc0009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92b7c8b274fdbe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfb3fff640 1 -- 172.21.15.102:0/2875906184 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0026070 con 0x557953fbb1b0 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfb3fff640 1 -- 172.21.15.102:0/2875906184 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc0019040 con 0x557953fbb1b0 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.920+0000 7fcfb3fff640 1 -- 172.21.15.102:0/2875906184 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0020990 con 0x557953fbb1b0 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- 172.21.15.102:0/2875906184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 msgr2=0x5579543971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000ae00 tx=0x7fcfc0009890 comp rx=0 tx=0).stop 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- 172.21.15.102:0/2875906184 shutdown_connections 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fe4070 0x557954393f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fc3390 0x5579543a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 --2- 172.21.15.102:0/2875906184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fbb1b0 0x5579543971e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- 172.21.15.102:0/2875906184 >> 172.21.15.102:0/2875906184 conn(0x557953fd8460 msgr2=0x557954396ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- 172.21.15.102:0/2875906184 shutdown_connections 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- 172.21.15.102:0/2875906184 wait complete. 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.921+0000 7fcfd688f740 1 -- start start 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 Processor -- start 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x5579543a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fe4070 0x5579543aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b0210 con 0x557953fc3390 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b1680 con 0x557953fe4070 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcfc81b08e0 con 0x557953fbb1b0 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfd688f740 10 client.0 _ll_register_callbacks cb 0x7fcfb80093c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45392/0 (socket says 172.21.15.102:45392) 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 -- 172.21.15.102:0/3215196518 learned_addr learned my addr 172.21.15.102:0/3215196518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fe4070 0x5579543aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x5579543a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 -- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 msgr2=0x5579543a9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x5579543a9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 -- 172.21.15.102:0/3215196518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fe4070 msgr2=0x5579543aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fe4070 0x5579543aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 -- 172.21.15.102:0/3215196518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579544126c0 con 0x557953fc3390 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfcd8b6640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009ab0 tx=0x7fcfb8016800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25102fe37f2feb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.922+0000 7fcfb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80155d0 con 0x557953fc3390 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfc0019040 con 0x557953fc3390 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fcfb8015770 con 0x557953fc3390 2024-09-21T03:39:06.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcfb8015970 con 0x557953fc3390 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 10 client.16467 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5579544139a0 con 0x557953fc3390 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcfc0019040 con 0x557953fc3390 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcfb8025cc0 con 0x557953fc3390 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 10 client.16467 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 20 client.16467 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953f77da0 0x557954416140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 4 client.16467 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.923+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579542ff8a0 con 0x557953f77da0 2024-09-21T03:39:06.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953f77da0 0x557954416140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfce8b8640 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953f77da0 0x557954416140 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66fa820bf52f966 server_cookie=d14e5338153d1d5f in_seq=0 out_seq=0 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfb1ffb640 10 client.16467 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfb1ffb640 1 -- 172.21.15.102:0/3215196518 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579542ff8a0 con 0x557953f77da0 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfb1ffb640 10 client.16467 handle_command_reply: tid=0 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 client.16467 shutdown 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 msgr2=0x5579543aa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009ab0 tx=0x7fcfb8016800 comp rx=0 tx=0).stop 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 shutdown_connections 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x557953f77da0 0x557954416140 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557953fc3390 0x5579543aa500 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfb1ffb640 0 client.16467 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.924+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557953fe4070 0x5579543aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd688f740 1 --2- 172.21.15.102:0/3215196518 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x557953fbb1b0 0x5579543a9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 >> 172.21.15.102:0/3215196518 conn(0x557953fd8460 msgr2=0x5579543981d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 shutdown_connections 2024-09-21T03:39:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd688f740 1 -- 172.21.15.102:0/3215196518 wait complete. 2024-09-21T03:39:06.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd688f740 20 client.16467 trim_cache size 0 max 16384 2024-09-21T03:39:06.935 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 msgr2=0x7fcfb40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 0x7fcfb40b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4105870 tx=0x7fcfc410bbd0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 msgr2=0x7fcfc819c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4006010 tx=0x7fcfc4004430 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 shutdown_connections 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcfb40b6680 0x7fcfb40b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcfc8105b90 0x7fcfc81a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcfc8105240 0x7fcfc819ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 --2- 172.21.15.102:0/1717458182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcfc8103270 0x7fcfc819c8c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:06.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 >> 172.21.15.102:0/1717458182 conn(0x7fcfc8079ec0 msgr2=0x7fcfc81071a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 shutdown_connections 2024-09-21T03:39:06.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:06.925+0000 7fcfd031b640 1 -- 172.21.15.102:0/1717458182 wait complete. 2024-09-21T03:39:07.636 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:07 smithi102 ceph-mon[31392]: pgmap v490: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:07.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:07 smithi148 ceph-mon[34651]: pgmap v490: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:07.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:07 smithi121 ceph-mon[34316]: pgmap v490: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:08.664 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:39:08.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:39:08.923 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- 172.21.15.102:0/3384776508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc1094b0 msgr2=0x7ff3fc1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 --2- 172.21.15.102:0/3384776508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc1098c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009900 tx=0x7ff3e402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- 172.21.15.102:0/3384776508 shutdown_connections 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 --2- 172.21.15.102:0/3384776508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc1098c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 --2- 172.21.15.102:0/3384776508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc109e00 0x7ff3fc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 --2- 172.21.15.102:0/3384776508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 0x7ff3fc102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- 172.21.15.102:0/3384776508 >> 172.21.15.102:0/3384776508 conn(0x7ff3fc077c60 msgr2=0x7ff3fc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- 172.21.15.102:0/3384776508 shutdown_connections 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- 172.21.15.102:0/3384776508 wait complete. 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 Processor -- start 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.416+0000 7ff40149c640 1 -- start start 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 0x7ff3fc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc19ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc113be0 con 0x7ff3fc109e00 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc113a60 con 0x7ff3fc101f70 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc113d60 con 0x7ff3fc1094b0 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45410/0 (socket says 172.21.15.102:45410) 2024-09-21T03:39:09.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/3922308832 learned_addr learned my addr 172.21.15.102:0/3922308832 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3faffd640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 0x7ff3fc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc19ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/3922308832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc1094b0 msgr2=0x7ff3fc19ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc19ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/3922308832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 msgr2=0x7ff3fc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 0x7ff3fc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/3922308832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc1a0520 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400eb10 tx=0x7ff3f400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3f8ff9640 1 -- 172.21.15.102:0/3922308832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4004b20 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3f8ff9640 1 -- 172.21.15.102:0/3922308832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3f4004cc0 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3fc1a0810 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.417+0000 7ff3f8ff9640 1 -- 172.21.15.102:0/3922308832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4010720 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.418+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3fc1a6f70 con 0x7ff3fc109e00 2024-09-21T03:39:09.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.420+0000 7ff407a10740 1 Processor -- start 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.420+0000 7ff3f8ff9640 1 -- 172.21.15.102:0/3922308832 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ff3f40108e0 con 0x7ff3fc109e00 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 -- start start 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2abf9490 0x55cf2afc9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afc9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cf2af3fe60 con 0x55cf2ac22350 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf2af2f290 con 0x55cf2abf9490 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff407a10740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf2af330a0 con 0x55cf2ac01670 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45420/0 (socket says 172.21.15.102:45420) 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 -- 172.21.15.102:0/1954254447 learned_addr learned my addr 172.21.15.102:0/1954254447 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2abf9490 0x55cf2afc9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afc9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 -- 172.21.15.102:0/1954254447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 msgr2=0x55cf2afc9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afc9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 -- 172.21.15.102:0/1954254447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2abf9490 msgr2=0x55cf2afc9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2abf9490 0x55cf2afc9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.421+0000 7ff3f3fff640 1 -- 172.21.15.102:0/1954254447 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf2ac8d930 con 0x55cf2ac22350 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f8ff9640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 0x7ff3e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3faffd640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 0x7ff3e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f8ff9640 1 -- 172.21.15.102:0/3922308832 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ff3f40e7c40 con 0x7ff3fc109e00 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40314b0 tx=0x7ff3e4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532019eb7496e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3faffd640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 0x7ff3e80b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55cf2afc80b0 tx=0x7ff3ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f17fa640 1 -- 172.21.15.102:0/1954254447 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4044020 con 0x55cf2ac22350 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f17fa640 1 -- 172.21.15.102:0/1954254447 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3e4031710 con 0x55cf2ac22350 2024-09-21T03:39:09.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.422+0000 7ff3f17fa640 1 -- 172.21.15.102:0/1954254447 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4035040 con 0x55cf2ac22350 2024-09-21T03:39:09.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 -- 172.21.15.102:0/1954254447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 msgr2=0x55cf2afc9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40314b0 tx=0x7ff3e4000bc0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 -- 172.21.15.102:0/1954254447 shutdown_connections 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afc9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2abf9490 0x55cf2afc9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 --2- 172.21.15.102:0/1954254447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afc9430 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 -- 172.21.15.102:0/1954254447 >> 172.21.15.102:0/1954254447 conn(0x55cf2ac16740 msgr2=0x55cf2afc7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 -- 172.21.15.102:0/1954254447 shutdown_connections 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.423+0000 7ff407a10740 1 -- 172.21.15.102:0/1954254447 wait complete. 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 -- start start 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 Processor -- start 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afd56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac22350 0x55cf2afe0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cf2ad90890 con 0x55cf2abf9490 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55cf2aec9d40 con 0x55cf2ac22350 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55cf2afd7bb0 con 0x55cf2ac01670 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff407a10740 10 client.0 _ll_register_callbacks cb 0x55cf2af2dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff3faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff3faffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45422/0 (socket says 172.21.15.102:45422) 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.424+0000 7ff3faffd640 1 -- 172.21.15.102:0/1213974314 learned_addr learned my addr 172.21.15.102:0/1213974314 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afd56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac22350 0x55cf2afe0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 -- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 msgr2=0x55cf2afd56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afd56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 -- 172.21.15.102:0/1213974314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac22350 msgr2=0x55cf2afe0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac22350 0x55cf2afe0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 -- 172.21.15.102:0/1213974314 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf2afe1540 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0045f0 tx=0x7ff3ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679575616c46852e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec01f640 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ff3ec01f7e0 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e4031710 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff3ec01f9e0 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff407a10740 10 client.16479 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.425+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cf2afe3ed0 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3e4031710 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff3ec027070 con 0x55cf2abf9490 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 10 client.16479 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 10 client.16479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 20 client.16479 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:09.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abe0cd0 0x55cf2afe7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 4 client.16479 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf2af41db0 con 0x55cf2abe0cd0 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.426+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abe0cd0 0x55cf2afe7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.427+0000 7ff3e27fc640 10 client.16479 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.427+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abe0cd0 0x55cf2afe7480 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab2d7979c0510665 server_cookie=a13a1c2757395b6 in_seq=0 out_seq=0 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.427+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1213974314 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf2af41db0 con 0x55cf2abe0cd0 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.427+0000 7ff3e27fc640 10 client.16479 handle_command_reply: tid=0 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 client.16479 shutdown 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 msgr2=0x55cf2afd5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec0045f0 tx=0x7ff3ec004730 comp rx=0 tx=0).stop 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 shutdown_connections 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac22350 0x55cf2afe0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2ac01670 0x55cf2afd56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abe0cd0 0x55cf2afe7480 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 --2- 172.21.15.102:0/1213974314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2abf9490 0x55cf2afd5100 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff3e27fc640 0 client.16479 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:09.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 >> 172.21.15.102:0/1213974314 conn(0x55cf2ac16740 msgr2=0x55cf2afcc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 shutdown_connections 2024-09-21T03:39:09.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 1 -- 172.21.15.102:0/1213974314 wait complete. 2024-09-21T03:39:09.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.428+0000 7ff407a10740 20 client.16479 trim_cache size 0 max 16384 2024-09-21T03:39:09.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.445+0000 7ff407a10740 1 Processor -- start 2024-09-21T03:39:09.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.445+0000 7ff407a10740 1 -- start start 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afcc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afcca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1b2190 con 0x55cf2ac22350 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1afa60 con 0x55cf2ac01670 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff407a10740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1ad8b0 con 0x55cf2abf9490 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45430/0 (socket says 172.21.15.102:45430) 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/2480888628 learned_addr learned my addr 172.21.15.102:0/2480888628 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afcca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3faffd640 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afcc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/2480888628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 msgr2=0x55cf2afcc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afcc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/2480888628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 msgr2=0x55cf2afcca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afcca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/2480888628 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf2afc7860 con 0x55cf2ac22350 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.446+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40e5430 tx=0x7ff3f40a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8927e3c50fa237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.447+0000 7ff3f0ff9640 1 -- 172.21.15.102:0/2480888628 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40a91f0 con 0x55cf2ac22350 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.447+0000 7ff3f0ff9640 1 -- 172.21.15.102:0/2480888628 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3f40a9040 con 0x55cf2ac22350 2024-09-21T03:39:09.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.447+0000 7ff3f0ff9640 1 -- 172.21.15.102:0/2480888628 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40b74a0 con 0x55cf2ac22350 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.447+0000 7ff407a10740 1 -- 172.21.15.102:0/2480888628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 msgr2=0x55cf2afce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.447+0000 7ff407a10740 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40e5430 tx=0x7ff3f40a9920 comp rx=0 tx=0).stop 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- 172.21.15.102:0/2480888628 shutdown_connections 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2afce510 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afcca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- 172.21.15.102:0/2480888628 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afcc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- 172.21.15.102:0/2480888628 >> 172.21.15.102:0/2480888628 conn(0x55cf2ac16740 msgr2=0x55cf2afd3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- 172.21.15.102:0/2480888628 shutdown_connections 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- 172.21.15.102:0/2480888628 wait complete. 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- start start 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 Processor -- start 2024-09-21T03:39:09.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afd9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afd9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1adf20 con 0x55cf2ac22350 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1af390 con 0x55cf2ac01670 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.448+0000 7ff407a10740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff3fc1ae5f0 con 0x55cf2abf9490 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff407a10740 10 client.0 _ll_register_callbacks cb 0x7ff3ec009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45446/0 (socket says 172.21.15.102:45446) 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/1242798810 learned_addr learned my addr 172.21.15.102:0/1242798810 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afd9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afd9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 msgr2=0x55cf2afd9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afd9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/1242798810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 msgr2=0x55cf2afd9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afd9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 -- 172.21.15.102:0/1242798810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf2b051470 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3f3fff640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afd9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3fb7fe640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40aacf0 tx=0x7ff3f400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b73ddff5a19a0d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40c8060 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7ff3f40acce0 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3f40a9040 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff3f40a91f0 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff407a10740 10 client.16485 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.449+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55cf2b052710 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff3f40a9040 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff3f40e5ad0 con 0x55cf2ac22350 2024-09-21T03:39:09.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 10 client.16485 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 20 client.16485 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abb6080 0x55cf2b054da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 4 client.16485 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cf2af3d860 con 0x55cf2abb6080 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.450+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abb6080 0x55cf2b054da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.451+0000 7ff3faffd640 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abb6080 0x55cf2b054da0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71506d5a6936a823 server_cookie=45555147b34262e2 in_seq=0 out_seq=0 2024-09-21T03:39:09.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.451+0000 7ff3e27fc640 10 client.16485 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:09.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff3e27fc640 1 -- 172.21.15.102:0/1242798810 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cf2af3d860 con 0x55cf2abb6080 2024-09-21T03:39:09.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff3e27fc640 10 client.16485 handle_command_reply: tid=0 2024-09-21T03:39:09.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 client.16485 shutdown 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 msgr2=0x55cf2b050e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7ff3f40aacf0 tx=0x7ff3f400efd0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 shutdown_connections 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55cf2abb6080 0x55cf2b054da0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cf2ac22350 0x55cf2b050e80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55cf2ac01670 0x55cf2afd9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 --2- 172.21.15.102:0/1242798810 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55cf2abf9490 0x55cf2afd9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 >> 172.21.15.102:0/1242798810 conn(0x55cf2ac16740 msgr2=0x55cf2afca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.452+0000 7ff3e27fc640 0 client.16485 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 shutdown_connections 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff407a10740 1 -- 172.21.15.102:0/1242798810 wait complete. 2024-09-21T03:39:09.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff407a10740 20 client.16485 trim_cache size 0 max 16384 2024-09-21T03:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "96ddc4f7-d386-4de4-8d58-3aa987ae2db4", 2024-09-21T03:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:39:09.459 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 msgr2=0x7ff3e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 0x7ff3e80b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x55cf2afc80b0 tx=0x7ff3ec005f90 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 msgr2=0x7ff3fc19fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400eb10 tx=0x7ff3f400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 shutdown_connections 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff3e80b6680 0x7ff3e80b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3fc109e00 0x7ff3fc19fdf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff3fc1094b0 0x7ff3fc19ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 --2- 172.21.15.102:0/3922308832 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3fc101f70 0x7ff3fc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 >> 172.21.15.102:0/3922308832 conn(0x7ff3fc077c60 msgr2=0x7ff3fc1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 shutdown_connections 2024-09-21T03:39:09.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:09.453+0000 7ff40149c640 1 -- 172.21.15.102:0/3922308832 wait complete. 2024-09-21T03:39:09.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:09 smithi102 ceph-mon[31392]: pgmap v491: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:09 smithi148 ceph-mon[34651]: pgmap v491: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:09 smithi121 ceph-mon[34316]: pgmap v491: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:10.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:39:10.470 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:10 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:39:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:10 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:10 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:39:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:10 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:10 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:39:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:10 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:10 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:39:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:10 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:10 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:39:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:10 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:10 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:39:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:10 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:11.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 -- 172.21.15.102:0/2036505415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 msgr2=0x7f7270103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 --2- 172.21.15.102:0/2036505415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270103f70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7260009900 tx=0x7f726002a410 comp rx=0 tx=0).stop 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 -- 172.21.15.102:0/2036505415 shutdown_connections 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 --2- 172.21.15.102:0/2036505415 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7270109df0 0x7f7270110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 --2- 172.21.15.102:0/2036505415 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72701094a0 0x7f72701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 --2- 172.21.15.102:0/2036505415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270103f70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 -- 172.21.15.102:0/2036505415 >> 172.21.15.102:0/2036505415 conn(0x7f727007b850 msgr2=0x7f727007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 -- 172.21.15.102:0/2036505415 shutdown_connections 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.000+0000 7f7274c74640 1 -- 172.21.15.102:0/2036505415 wait complete. 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.001+0000 7f7274c74640 1 Processor -- start 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.001+0000 7f7274c74640 1 -- start start 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72701094a0 0x7f7270075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 0x7f7270076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7270113bd0 con 0x7f7270103b60 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7270113a50 con 0x7f72701094a0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f7274c74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7270113d50 con 0x7f7270109df0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45464/0 (socket says 172.21.15.102:45464) 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 -- 172.21.15.102:0/1592990948 learned_addr learned my addr 172.21.15.102:0/1592990948 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726dd9b640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72701094a0 0x7f7270075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726ed9d640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 0x7f7270076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 -- 172.21.15.102:0/1592990948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 msgr2=0x7f7270076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 0x7f7270076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 -- 172.21.15.102:0/1592990948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72701094a0 msgr2=0x7f7270075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72701094a0 0x7f7270075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 -- 172.21.15.102:0/1592990948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72701a8830 con 0x7f7270103b60 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726ed9d640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 0x7f7270076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.002+0000 7f726e59c640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7260006010 tx=0x7f7260004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.003+0000 7f725f7fe640 1 -- 172.21.15.102:0/1592990948 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726003f070 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.003+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72701a8ac0 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.003+0000 7f725f7fe640 1 -- 172.21.15.102:0/1592990948 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7260003ac0 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.003+0000 7f725f7fe640 1 -- 172.21.15.102:0/1592990948 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260035030 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.003+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72701a8fa0 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.005+0000 7f727b1e8740 1 Processor -- start 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.005+0000 7f727b1e8740 1 -- start start 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.005+0000 7f725f7fe640 1 -- 172.21.15.102:0/1592990948 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7260042070 con 0x7f7270103b60 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 0x56357999c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x56357999d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563579912e50 con 0x5635795cc1b0 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563579902280 con 0x5635795f5070 2024-09-21T03:39:11.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f727b1e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563579906090 con 0x5635795d4390 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45480/0 (socket says 172.21.15.102:45480) 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 -- 172.21.15.102:0/716135961 learned_addr learned my addr 172.21.15.102:0/716135961 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726ed9d640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 0x56357999c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726dd9b640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x56357999d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 -- 172.21.15.102:0/716135961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 msgr2=0x56357999d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x56357999d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 -- 172.21.15.102:0/716135961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 msgr2=0x56357999c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 0x56357999c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 -- 172.21.15.102:0/716135961 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563579660650 con 0x5635795cc1b0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726ed9d640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 0x56357999c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.006+0000 7f726e59c640 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7260105880 tx=0x7f72601104f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c9a07397674d37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f725f7fe640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 0x7f72580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f725cff9640 1 -- 172.21.15.102:0/716135961 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600ca660 con 0x5635795cc1b0 2024-09-21T03:39:11.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f726ed9d640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 0x7f72580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f725cff9640 1 -- 172.21.15.102:0/716135961 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7260115030 con 0x5635795cc1b0 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f725cff9640 1 -- 172.21.15.102:0/716135961 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600cd780 con 0x5635795cc1b0 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.007+0000 7f725f7fe640 1 -- 172.21.15.102:0/1592990948 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f72601081d0 con 0x7f7270103b60 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- 172.21.15.102:0/716135961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 msgr2=0x56357999cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f726ed9d640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 0x7f72580b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f72680085b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7260105880 tx=0x7f72601104f0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- 172.21.15.102:0/716135961 shutdown_connections 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x56357999cb90 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x56357999d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 --2- 172.21.15.102:0/716135961 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795f5070 0x56357999c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- 172.21.15.102:0/716135961 >> 172.21.15.102:0/716135961 conn(0x5635795e9460 msgr2=0x56357999a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- 172.21.15.102:0/716135961 shutdown_connections 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- 172.21.15.102:0/716135961 wait complete. 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 -- start start 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.008+0000 7f727b1e8740 1 Processor -- start 2024-09-21T03:39:11.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x5635799a81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563579763700 con 0x5635795f5070 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56357989d110 con 0x5635795cc1b0 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5635799aabf0 con 0x5635795d4390 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f727b1e8740 10 client.0 _ll_register_callbacks cb 0x5635798b6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45486/0 (socket says 172.21.15.102:45486) 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 -- 172.21.15.102:0/456930660 learned_addr learned my addr 172.21.15.102:0/456930660 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726e59c640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726dd9b640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x5635799a81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 -- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 msgr2=0x5635799a81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x5635799a81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 -- 172.21.15.102:0/456930660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 msgr2=0x5635799a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 -- 172.21.15.102:0/456930660 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635798cac40 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726dd9b640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x5635799a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f726ed9d640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f726800ee50 tx=0x7f7268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36be9107574d7e1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.009+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726801d620 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f726801d7c0 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7260115030 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f726800ee80 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 10 client.16497 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5635799b67f0 con 0x5635795f5070 2024-09-21T03:39:11.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7260115030 con 0x5635795f5070 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f726801aa90 con 0x5635795f5070 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 10 client.16497 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 20 client.16497 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5635795b39f0 0x5635799b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 4 client.16497 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:11.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.010+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563579914da0 con 0x5635795b39f0 2024-09-21T03:39:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.011+0000 7f726e59c640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5635795b39f0 0x5635799b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.011+0000 7f726e59c640 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5635795b39f0 0x5635799b9e00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d31d04dee03e2d server_cookie=f7dd43d7dfb0f4d2 in_seq=0 out_seq=0 2024-09-21T03:39:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.011+0000 7f7255ffb640 10 client.16497 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f7255ffb640 1 -- 172.21.15.102:0/456930660 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563579914da0 con 0x5635795b39f0 2024-09-21T03:39:11.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f7255ffb640 10 client.16497 handle_command_reply: tid=0 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 client.16497 shutdown 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 msgr2=0x5635799a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f726800ee50 tx=0x7f7268004a40 comp rx=0 tx=0).stop 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 shutdown_connections 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5635795b39f0 0x5635799b9e00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795f5070 0x5635799a8710 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795d4390 0x5635799a81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 --2- 172.21.15.102:0/456930660 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 >> 172.21.15.102:0/456930660 conn(0x5635795e9460 msgr2=0x56357999f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f7255ffb640 0 client.16497 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 shutdown_connections 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.012+0000 7f727b1e8740 1 -- 172.21.15.102:0/456930660 wait complete. 2024-09-21T03:39:11.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.013+0000 7f727b1e8740 20 client.16497 trim_cache size 0 max 16384 2024-09-21T03:39:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 Processor -- start 2024-09-21T03:39:11.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 -- start start 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b4350 con 0x5635795d4390 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b1c20 con 0x5635795cc1b0 2024-09-21T03:39:11.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f727b1e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72701afa70 con 0x5635795f5070 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45498/0 (socket says 172.21.15.102:45498) 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 -- 172.21.15.102:0/2693082256 learned_addr learned my addr 172.21.15.102:0/2693082256 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726e59c640 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726ed9d640 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 -- 172.21.15.102:0/2693082256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 msgr2=0x5635799a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 -- 172.21.15.102:0/2693082256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 msgr2=0x5635799a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.030+0000 7f726dd9b640 1 -- 172.21.15.102:0/2693082256 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635799a6bf0 con 0x5635795d4390 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.031+0000 7f726dd9b640 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f726400ac50 tx=0x7f7264012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94329389b820a773 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.031+0000 7f7257fff640 1 -- 172.21.15.102:0/2693082256 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7264020070 con 0x5635795d4390 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.031+0000 7f7257fff640 1 -- 172.21.15.102:0/2693082256 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f726400f8f0 con 0x5635795d4390 2024-09-21T03:39:11.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.031+0000 7f7257fff640 1 -- 172.21.15.102:0/2693082256 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726401b9b0 con 0x5635795d4390 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- 172.21.15.102:0/2693082256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 msgr2=0x5635799a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f726400ac50 tx=0x7f7264012820 comp rx=0 tx=0).stop 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- 172.21.15.102:0/2693082256 shutdown_connections 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795d4390 0x5635799a4e80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 --2- 172.21.15.102:0/2693082256 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795cc1b0 0x5635799a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- 172.21.15.102:0/2693082256 >> 172.21.15.102:0/2693082256 conn(0x5635795e9460 msgr2=0x5635799a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- 172.21.15.102:0/2693082256 shutdown_connections 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- 172.21.15.102:0/2693082256 wait complete. 2024-09-21T03:39:11.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 -- start start 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.032+0000 7f727b1e8740 1 Processor -- start 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795d4390 0x5635799ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b00e0 con 0x5635795cc1b0 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b1550 con 0x5635795d4390 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72701b07b0 con 0x5635795f5070 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 10 client.0 _ll_register_callbacks cb 0x7f72680088f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45512/0 (socket says 172.21.15.102:45512) 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 -- 172.21.15.102:0/1261255410 learned_addr learned my addr 172.21.15.102:0/1261255410 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726dd9b640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795d4390 0x5635799ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726ed9d640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 -- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 msgr2=0x5635799ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 -- 172.21.15.102:0/1261255410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795d4390 msgr2=0x5635799ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795d4390 0x5635799ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 -- 172.21.15.102:0/1261255410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563579a237c0 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f726e59c640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f72600cdb20 tx=0x7f726002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fded104db5e27726 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f7255ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260049040 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f726003b460 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.033+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f726400f8f0 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f72600cd960 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 10 client.16503 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563579a24a50 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f726400f8f0 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7260105b90 con 0x5635795cc1b0 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 10 client.16503 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:11.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 20 client.16503 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563579588da0 0x563579a271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 4 client.16503 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563579910850 con 0x563579588da0 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.034+0000 7f726dd9b640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563579588da0 0x563579a271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f7255ffb640 10 client.16503 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f726dd9b640 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563579588da0 0x563579a271b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c8d0912ac6b207f server_cookie=d2c778af006dd848 in_seq=0 out_seq=0 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f7255ffb640 1 -- 172.21.15.102:0/1261255410 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x563579910850 con 0x563579588da0 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f7255ffb640 10 client.16503 handle_command_reply: tid=0 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 client.16503 shutdown 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 msgr2=0x5635799abd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f72600cdb20 tx=0x7f726002a410 comp rx=0 tx=0).stop 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 shutdown_connections 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5635795f5070 0x5635799ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5635795d4390 0x5635799ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563579588da0 0x563579a271b0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 --2- 172.21.15.102:0/1261255410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5635795cc1b0 0x5635799abd40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f7255ffb640 0 client.16503 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 >> 172.21.15.102:0/1261255410 conn(0x5635795e9460 msgr2=0x56357999dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 shutdown_connections 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.035+0000 7f727b1e8740 1 -- 172.21.15.102:0/1261255410 wait complete. 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f727b1e8740 20 client.16503 trim_cache size 0 max 16384 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:39:11.042 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "96ddc4f7-d386-4de4-8d58-3aa987ae2db4", 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.043 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.044 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.046 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.047 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:11.048 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 msgr2=0x7f72580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 0x7f72580b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7268005fd0 tx=0x7f72680085b0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 msgr2=0x7f7270075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f7260006010 tx=0x7f7260004430 comp rx=0 tx=0).stop 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 shutdown_connections 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f72580b6680 0x7f72580b8b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7270109df0 0x7f7270076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72701094a0 0x7f7270075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 --2- 172.21.15.102:0/1592990948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7270103b60 0x7f7270075710 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 >> 172.21.15.102:0/1592990948 conn(0x7f727007b850 msgr2=0x7f7270107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 shutdown_connections 2024-09-21T03:39:11.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:11.036+0000 7f7274c74640 1 -- 172.21.15.102:0/1592990948 wait complete. 2024-09-21T03:39:11.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:11 smithi102 ceph-mon[31392]: pgmap v492: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:11.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:11 smithi148 ceph-mon[34651]: pgmap v492: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:11.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:11 smithi121 ceph-mon[34316]: pgmap v492: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T03:39:11.837 INFO:tasks.cephfs.filesystem:scrub status for tag:96ddc4f7-d386-4de4-8d58-3aa987ae2db4 - {'path': '/', 'tag': '96ddc4f7-d386-4de4-8d58-3aa987ae2db4', 'options': 'recursive,force'} 2024-09-21T03:39:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:12 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:39:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:12 smithi102 ceph-mon[31392]: pgmap v493: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:12 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:39:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:12 smithi148 ceph-mon[34651]: pgmap v493: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:12 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:39:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:12 smithi121 ceph-mon[34316]: pgmap v493: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T03:39:15.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:15 smithi102 ceph-mon[31392]: pgmap v494: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:39:15.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:15 smithi148 ceph-mon[34651]: pgmap v494: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:39:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:15 smithi121 ceph-mon[34316]: pgmap v494: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T03:39:17.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:17 smithi102 ceph-mon[31392]: pgmap v495: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:39:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:17 smithi148 ceph-mon[34651]: pgmap v495: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:39:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:17 smithi121 ceph-mon[34316]: pgmap v495: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-09-21T03:39:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:18 smithi148 ceph-mon[34651]: pgmap v496: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:39:18.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:18 smithi121 ceph-mon[34316]: pgmap v496: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:39:18.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:18 smithi102 ceph-mon[31392]: pgmap v496: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:39:21.656 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:21 smithi102 ceph-mon[31392]: pgmap v497: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:39:21.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:21 smithi148 ceph-mon[34651]: pgmap v497: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:39:21.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:21 smithi121 ceph-mon[34316]: pgmap v497: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:39:23.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:23 smithi102 ceph-mon[31392]: pgmap v498: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:39:23.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:23 smithi148 ceph-mon[34651]: pgmap v498: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:39:23.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:23 smithi121 ceph-mon[34316]: pgmap v498: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:39:24.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:24 smithi102 ceph-mon[31392]: pgmap v499: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s 2024-09-21T03:39:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:24 smithi148 ceph-mon[34651]: pgmap v499: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s 2024-09-21T03:39:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:24 smithi121 ceph-mon[34316]: pgmap v499: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 7 op/s 2024-09-21T03:39:27.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:27 smithi102 ceph-mon[31392]: pgmap v500: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:27 smithi148 ceph-mon[34651]: pgmap v500: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:27 smithi121 ceph-mon[34316]: pgmap v500: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:28 smithi148 ceph-mon[34651]: pgmap v501: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:28.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:28 smithi121 ceph-mon[34316]: pgmap v501: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:28 smithi102 ceph-mon[31392]: pgmap v501: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:31.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:31 smithi102 ceph-mon[31392]: pgmap v502: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:31.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:31 smithi148 ceph-mon[34651]: pgmap v502: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:31.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:31 smithi121 ceph-mon[34316]: pgmap v502: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:32 smithi102 ceph-mon[31392]: pgmap v503: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:32.743 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:32 smithi148 ceph-mon[34651]: pgmap v503: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:32 smithi121 ceph-mon[34316]: pgmap v503: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:35.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:35 smithi102 ceph-mon[31392]: pgmap v504: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:35 smithi148 ceph-mon[34651]: pgmap v504: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:35.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:35 smithi121 ceph-mon[34316]: pgmap v504: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:36.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:36 smithi102 ceph-mon[31392]: pgmap v505: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:36 smithi148 ceph-mon[34651]: pgmap v505: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:36 smithi121 ceph-mon[34316]: pgmap v505: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:38 smithi148 ceph-mon[34651]: pgmap v506: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:38 smithi121 ceph-mon[34316]: pgmap v506: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:38 smithi102 ceph-mon[31392]: pgmap v506: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:40 smithi148 ceph-mon[34651]: pgmap v507: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:40.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:40 smithi121 ceph-mon[34316]: pgmap v507: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:40 smithi102 ceph-mon[31392]: pgmap v507: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:41.838 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:39:42.110 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:42.522 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:42 smithi102 ceph-mon[31392]: pgmap v508: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:42.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 -- 172.21.15.102:0/80356529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 msgr2=0x7fbf4c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 --2- 172.21.15.102:0/80356529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c103f70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009900 tx=0x7fbf4802a410 comp rx=0 tx=0).stop 2024-09-21T03:39:42.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 -- 172.21.15.102:0/80356529 shutdown_connections 2024-09-21T03:39:42.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 --2- 172.21.15.102:0/80356529 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 --2- 172.21.15.102:0/80356529 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 0x7fbf4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 --2- 172.21.15.102:0/80356529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c103f70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 -- 172.21.15.102:0/80356529 >> 172.21.15.102:0/80356529 conn(0x7fbf4c07b850 msgr2=0x7fbf4c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 -- 172.21.15.102:0/80356529 shutdown_connections 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.615+0000 7fbf53586640 1 -- 172.21.15.102:0/80356529 wait complete. 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 Processor -- start 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 -- start start 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 0x7fbf4c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c113bf0 con 0x7fbf4c103b60 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c113a70 con 0x7fbf4c1094a0 2024-09-21T03:39:42.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf53586640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c113d70 con 0x7fbf4c109df0 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49156/0 (socket says 172.21.15.102:49156) 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.616+0000 7fbf51322640 1 -- 172.21.15.102:0/2593071303 learned_addr learned my addr 172.21.15.102:0/2593071303 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf50b21640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 0x7fbf4c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51b23640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 -- 172.21.15.102:0/2593071303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 msgr2=0x7fbf4c19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 -- 172.21.15.102:0/2593071303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 msgr2=0x7fbf4c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 0x7fbf4c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 -- 172.21.15.102:0/2593071303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c1a0570 con 0x7fbf4c103b60 2024-09-21T03:39:42.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51b23640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf51322640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005ab0 tx=0x7fbf480042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf427fc640 1 -- 172.21.15.102:0/2593071303 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4803f030 con 0x7fbf4c103b60 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c1a0800 con 0x7fbf4c103b60 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf427fc640 1 -- 172.21.15.102:0/2593071303 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf48003cd0 con 0x7fbf4c103b60 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf427fc640 1 -- 172.21.15.102:0/2593071303 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48035070 con 0x7fbf4c103b60 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.617+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c1a6fc0 con 0x7fbf4c103b60 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.620+0000 7fbf59afa740 1 Processor -- start 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.620+0000 7fbf59afa740 1 -- start start 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.620+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883db9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf59afa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561883d2fe50 con 0x5618839f1390 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf59afa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561883d1f280 con 0x561883a12070 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf59afa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561883d23090 con 0x5618839e91b0 2024-09-21T03:39:42.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf427fc640 1 -- 172.21.15.102:0/2593071303 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fbf48042030 con 0x7fbf4c103b60 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf51b23640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49168/0 (socket says 172.21.15.102:49168) 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf51b23640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:48652/0 (socket says 172.21.15.102:48652) 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 -- 172.21.15.102:0/1492625319 learned_addr learned my addr 172.21.15.102:0/1492625319 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf51322640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883db9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 -- 172.21.15.102:0/1492625319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 msgr2=0x561883db9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883db9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 -- 172.21.15.102:0/1492625319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 msgr2=0x561883db9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 -- 172.21.15.102:0/1492625319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561883a7d650 con 0x5618839f1390 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf51b23640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf51322640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883db9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:42.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.621+0000 7fbf50b21640 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00bc10 tx=0x7fbf3c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ebdbeca5baa462 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf377fe640 1 -- 172.21.15.102:0/1492625319 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c015070 con 0x5618839f1390 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf377fe640 1 -- 172.21.15.102:0/1492625319 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf3c01a930 con 0x5618839f1390 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf377fe640 1 -- 172.21.15.102:0/1492625319 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c011970 con 0x5618839f1390 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf427fc640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 0x7fbf380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf427fc640 1 -- 172.21.15.102:0/2593071303 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbf481079e0 con 0x7fbf4c103b60 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.622+0000 7fbf51b23640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 0x7fbf380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- 172.21.15.102:0/1492625319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 msgr2=0x561883dba0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf51b23640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 0x7fbf380b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005fd0 tx=0x7fbf44009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00bc10 tx=0x7fbf3c00f730 comp rx=0 tx=0).stop 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- 172.21.15.102:0/1492625319 shutdown_connections 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839f1390 0x561883dba0d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883db9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 --2- 172.21.15.102:0/1492625319 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883db9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- 172.21.15.102:0/1492625319 >> 172.21.15.102:0/1492625319 conn(0x561883a06460 msgr2=0x561883db7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- 172.21.15.102:0/1492625319 shutdown_connections 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- 172.21.15.102:0/1492625319 wait complete. 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 -- start start 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.623+0000 7fbf59afa740 1 Processor -- start 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839f1390 0x561883dc51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883dd1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561883b80700 con 0x5618839e91b0 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561883cba110 con 0x561883a12070 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561883dc7e30 con 0x5618839f1390 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf59afa740 10 client.0 _ll_register_callbacks cb 0x561883cd3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49180/0 (socket says 172.21.15.102:49180) 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 -- 172.21.15.102:0/3892621815 learned_addr learned my addr 172.21.15.102:0/3892621815 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:42.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51b23640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883dd1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839f1390 0x561883dc51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 -- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839f1390 msgr2=0x561883dc51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839f1390 0x561883dc51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 -- 172.21.15.102:0/3892621815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 msgr2=0x561883dd1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883dd1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 -- 172.21.15.102:0/3892621815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561883ce7c40 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf51322640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbf48006010 tx=0x7fbf4803b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f0e78e36214f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48049070 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.624+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbf480d6db0 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf3c01a930 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbf480c9e70 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 10 client.16515 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561883dd3ae0 con 0x5618839e91b0 2024-09-21T03:39:42.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf3c01a930 con 0x5618839e91b0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fbf4804c060 con 0x5618839e91b0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 10 client.16515 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 10 client.16515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 20 client.16515 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839d09f0 0x561883dd7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 4 client.16515 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561883d31da0 con 0x5618839d09f0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.625+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839d09f0 0x561883dd7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.626+0000 7fbf34ff9640 10 client.16515 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.626+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839d09f0 0x561883dd7050 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cb49b28b79b33f3 server_cookie=981e50e77c2c40ff in_seq=0 out_seq=0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.626+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3892621815 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561883d31da0 con 0x5618839d09f0 2024-09-21T03:39:42.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.626+0000 7fbf34ff9640 10 client.16515 handle_command_reply: tid=0 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 client.16515 shutdown 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 msgr2=0x561883dc4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbf48006010 tx=0x7fbf4803b690 comp rx=0 tx=0).stop 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 shutdown_connections 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561883a12070 0x561883dd1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839f1390 0x561883dc51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839d09f0 0x561883dd7050 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3892621815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dc4cb0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 >> 172.21.15.102:0/3892621815 conn(0x561883a06460 msgr2=0x561883dbc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf34ff9640 0 client.16515 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:42.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 shutdown_connections 2024-09-21T03:39:42.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 1 -- 172.21.15.102:0/3892621815 wait complete. 2024-09-21T03:39:42.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.627+0000 7fbf59afa740 20 client.16515 trim_cache size 0 max 16384 2024-09-21T03:39:42.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 Processor -- start 2024-09-21T03:39:42.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 -- start start 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883dc5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883db6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b21a0 con 0x561883a12070 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1afa70 con 0x5618839f1390 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf59afa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1ad8c0 con 0x5618839e91b0 2024-09-21T03:39:42.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49194/0 (socket says 172.21.15.102:49194) 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 -- 172.21.15.102:0/3616510082 learned_addr learned my addr 172.21.15.102:0/3616510082 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51322640 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883dc5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883db6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 -- 172.21.15.102:0/3616510082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 msgr2=0x561883dc5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883dc5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 -- 172.21.15.102:0/3616510082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 msgr2=0x561883db6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.645+0000 7fbf51b23640 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883db6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.646+0000 7fbf51b23640 1 -- 172.21.15.102:0/3616510082 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618839d0c20 con 0x561883a12070 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.646+0000 7fbf51b23640 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbf440128c0 tx=0x7fbf44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c4738c53ec5c25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.646+0000 7fbf36ffd640 1 -- 172.21.15.102:0/3616510082 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400f9a0 con 0x561883a12070 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.646+0000 7fbf36ffd640 1 -- 172.21.15.102:0/3616510082 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf44024070 con 0x561883a12070 2024-09-21T03:39:42.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.646+0000 7fbf36ffd640 1 -- 172.21.15.102:0/3616510082 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4401f430 con 0x561883a12070 2024-09-21T03:39:42.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- 172.21.15.102:0/3616510082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 msgr2=0x561883db70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbf440128c0 tx=0x7fbf44014000 comp rx=0 tx=0).stop 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- 172.21.15.102:0/3616510082 shutdown_connections 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561883a12070 0x561883db70b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883db6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3616510082 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5618839e91b0 0x561883dc5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- 172.21.15.102:0/3616510082 >> 172.21.15.102:0/3616510082 conn(0x561883a06460 msgr2=0x561883dc4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- 172.21.15.102:0/3616510082 shutdown_connections 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- 172.21.15.102:0/3616510082 wait complete. 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 -- start start 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.647+0000 7fbf59afa740 1 Processor -- start 2024-09-21T03:39:42.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883dc8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561883a12070 0x561883dc95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1adf30 con 0x5618839e91b0 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1af3a0 con 0x5618839f1390 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1ae600 con 0x561883a12070 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf59afa740 10 client.0 _ll_register_callbacks cb 0x7fbf480c9050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49202/0 (socket says 172.21.15.102:49202) 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 -- 172.21.15.102:0/3048433555 learned_addr learned my addr 172.21.15.102:0/3048433555 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883dc8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51b23640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561883a12070 0x561883dc95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 -- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561883a12070 msgr2=0x561883dc95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561883a12070 0x561883dc95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 -- 172.21.15.102:0/3048433555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 msgr2=0x561883dc8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883dc8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.648+0000 7fbf51322640 1 -- 172.21.15.102:0/3048433555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561883e40a10 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf51322640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005820 tx=0x7fbf4803be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f76e7db51073a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf34ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4807c020 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf44024070 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fbf480cca80 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbf48049070 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf59afa740 10 client.16521 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561883e40a10 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.649+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf44024070 con 0x5618839e91b0 2024-09-21T03:39:42.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fbf480cc4f0 con 0x5618839e91b0 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 10 client.16521 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 10 client.16521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 20 client.16521 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839a5da0 0x561883e43fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 4 client.16521 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561883d2d850 con 0x5618839a5da0 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.650+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839a5da0 0x561883e43fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf34ff9640 10 client.16521 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:42.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf50b21640 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839a5da0 0x561883e43fa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5429e415c40bf16 server_cookie=a54344ff31c3256b in_seq=0 out_seq=0 2024-09-21T03:39:42.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf34ff9640 1 -- 172.21.15.102:0/3048433555 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x561883d2d850 con 0x5618839a5da0 2024-09-21T03:39:42.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf34ff9640 10 client.16521 handle_command_reply: tid=0 2024-09-21T03:39:42.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 client.16521 shutdown 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 msgr2=0x561883dcda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005820 tx=0x7fbf4803be40 comp rx=0 tx=0).stop 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 shutdown_connections 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561883a12070 0x561883dc95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5618839f1390 0x561883dc8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5618839a5da0 0x561883e43fa0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 --2- 172.21.15.102:0/3048433555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5618839e91b0 0x561883dcda20 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf34ff9640 0 client.16521 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 >> 172.21.15.102:0/3048433555 conn(0x561883a06460 msgr2=0x561883dba680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 shutdown_connections 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 1 -- 172.21.15.102:0/3048433555 wait complete. 2024-09-21T03:39:42.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.651+0000 7fbf59afa740 20 client.16521 trim_cache size 0 max 16384 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.659 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.660 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:39:42.661 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:39:42.662 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.663 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:42.664 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:42.665 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 msgr2=0x7fbf380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 0x7fbf380b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbf44005fd0 tx=0x7fbf44009680 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 msgr2=0x7fbf4c19a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005ab0 tx=0x7fbf480042f0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 shutdown_connections 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf380b6680 0x7fbf380b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf4c109df0 0x7fbf4c19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf4c1094a0 0x7fbf4c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 --2- 172.21.15.102:0/2593071303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf4c103b60 0x7fbf4c19a600 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 >> 172.21.15.102:0/2593071303 conn(0x7fbf4c07b850 msgr2=0x7fbf4c1074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:42.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 shutdown_connections 2024-09-21T03:39:42.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:42.652+0000 7fbf53586640 1 -- 172.21.15.102:0/2593071303 wait complete. 2024-09-21T03:39:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:42 smithi148 ceph-mon[34651]: pgmap v508: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:42 smithi121 ceph-mon[34316]: pgmap v508: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:43.481 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:39:43.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:39:43.734 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:44.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 -- 172.21.15.102:0/3771704947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 msgr2=0x7fa4cc104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:44.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 --2- 172.21.15.102:0/3771704947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc104cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009900 tx=0x7fa4bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 -- 172.21.15.102:0/3771704947 shutdown_connections 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 --2- 172.21.15.102:0/3771704947 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 0x7fa4cc110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 --2- 172.21.15.102:0/3771704947 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 --2- 172.21.15.102:0/3771704947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc104cd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 -- 172.21.15.102:0/3771704947 >> 172.21.15.102:0/3771704947 conn(0x7fa4cc079760 msgr2=0x7fa4cc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 -- 172.21.15.102:0/3771704947 shutdown_connections 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.236+0000 7fa4d2995640 1 -- 172.21.15.102:0/3771704947 wait complete. 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 Processor -- start 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 -- start start 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:44.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 0x7fa4cc19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113bf0 con 0x7fa4cc1048c0 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113a70 con 0x7fa4cc1052a0 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4d2995640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc113d70 con 0x7fa4cc10de70 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.237+0000 7fa4cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35740/0 (socket says 172.21.15.102:35740) 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 -- 172.21.15.102:0/362718133 learned_addr learned my addr 172.21.15.102:0/362718133 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cb7fe640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4d0f32640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 0x7fa4cc19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 -- 172.21.15.102:0/362718133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 msgr2=0x7fa4cc19fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 0x7fa4cc19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 -- 172.21.15.102:0/362718133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 msgr2=0x7fa4cc19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 -- 172.21.15.102:0/362718133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc1a0590 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cb7fe640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4cbfff640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005940 tx=0x7fa4bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc03f030 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc1a0820 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa4bc0318f0 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc035070 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.238+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1a6fe0 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.239+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc06c130 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.242+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa4bc042030 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.242+0000 7fa4c97fa640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 0x7fa4b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.242+0000 7fa4cb7fe640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 0x7fa4b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.243+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa4bc108040 con 0x7fa4cc1048c0 2024-09-21T03:39:44.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.243+0000 7fa4cb7fe640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 0x7fa4b40b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc10fb50 tx=0x7fa4c0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:44.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.246+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4bc0ce580 con 0x7fa4cc1048c0 2024-09-21T03:39:44.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.464+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4cc104cd0 con 0x7fa4cc1048c0 2024-09-21T03:39:44.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.465+0000 7fa4c97fa640 1 -- 172.21.15.102:0/362718133 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7fa4bc0d2960 con 0x7fa4cc1048c0 2024-09-21T03:39:44.467 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:39:44.468 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:39:44.468 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 msgr2=0x7fa4b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 0x7fa4b40b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc10fb50 tx=0x7fa4c0005f90 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 msgr2=0x7fa4cc19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc005940 tx=0x7fa4bc0042f0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 shutdown_connections 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4b40b6680 0x7fa4b40b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4cc10de70 0x7fa4cc19fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4cc1052a0 0x7fa4cc19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 --2- 172.21.15.102:0/362718133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4cc1048c0 0x7fa4cc19a620 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 >> 172.21.15.102:0/362718133 conn(0x7fa4cc079760 msgr2=0x7fa4cc1079e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.467+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 shutdown_connections 2024-09-21T03:39:44.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:44.468+0000 7fa4d2995640 1 -- 172.21.15.102:0/362718133 wait complete. 2024-09-21T03:39:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:44 smithi148 ceph-mon[34651]: pgmap v509: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:44 smithi121 ceph-mon[34316]: pgmap v509: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:44.871 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:44 smithi102 ceph-mon[31392]: pgmap v509: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:45.228 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:39:45.478 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:45.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/362718133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:45.758 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/362718133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:45.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:45 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/362718133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:39:46.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 -- 172.21.15.102:0/2608772950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c105340 msgr2=0x7fa56c10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 --2- 172.21.15.102:0/2608772950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c105340 0x7fa56c10d890 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa554009900 tx=0x7fa55402a410 comp rx=0 tx=0).stop 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 -- 172.21.15.102:0/2608772950 shutdown_connections 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 --2- 172.21.15.102:0/2608772950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c105340 0x7fa56c10d890 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 --2- 172.21.15.102:0/2608772950 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 0x7fa56c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 --2- 172.21.15.102:0/2608772950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c1049f0 0x7fa56c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 -- 172.21.15.102:0/2608772950 >> 172.21.15.102:0/2608772950 conn(0x7fa56c0797e0 msgr2=0x7fa56c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 -- 172.21.15.102:0/2608772950 shutdown_connections 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.006+0000 7fa571acc640 1 -- 172.21.15.102:0/2608772950 wait complete. 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 Processor -- start 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 -- start start 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c105340 0x7fa56c19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 0x7fa56c1a2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113cd0 con 0x7fa56c1049f0 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113b50 con 0x7fa56c105340 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa571acc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113e50 con 0x7fa56c10de50 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35746/0 (socket says 172.21.15.102:35746) 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa56b7fe640 1 -- 172.21.15.102:0/1803806376 learned_addr learned my addr 172.21.15.102:0/1803806376 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa56affd640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c105340 0x7fa56c19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.007+0000 7fa56bfff640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 0x7fa56c1a2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 -- 172.21.15.102:0/1803806376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 msgr2=0x7fa56c1a2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 0x7fa56c1a2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 -- 172.21.15.102:0/1803806376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c105340 msgr2=0x7fa56c19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c105340 0x7fa56c19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 -- 172.21.15.102:0/1803806376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c1a28b0 con 0x7fa56c1049f0 2024-09-21T03:39:46.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b9c0 tx=0x7fa56400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa568ff9640 1 -- 172.21.15.102:0/1803806376 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564019070 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c1a2ba0 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa568ff9640 1 -- 172.21.15.102:0/1803806376 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa56400cba0 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa568ff9640 1 -- 172.21.15.102:0/1803806376 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564012620 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.008+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a9300 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 Processor -- start 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 -- start start 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa568ff9640 1 -- 172.21.15.102:0/1803806376 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa56401c070 con 0x7fa56c1049f0 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aaafbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aab0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56540aa25ea0 con 0x56540a708070 2024-09-21T03:39:46.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56540aa152d0 con 0x56540a6e7390 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa578040740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56540aa190e0 con 0x56540a6df1b0 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35756/0 (socket says 172.21.15.102:35756) 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 -- 172.21.15.102:0/1818600463 learned_addr learned my addr 172.21.15.102:0/1818600463 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aaafbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56affd640 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aab0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 -- 172.21.15.102:0/1818600463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 msgr2=0x56540aaafbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aaafbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 -- 172.21.15.102:0/1818600463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 msgr2=0x56540aab0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aab0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.011+0000 7fa56bfff640 1 -- 172.21.15.102:0/1818600463 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540a773650 con 0x56540a708070 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa56bfff640 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b7a0 tx=0x7fa55c00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fe954299fae014 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa568ff9640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 0x7fa5580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa561ffb640 1 -- 172.21.15.102:0/1818600463 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00d950 con 0x56540a708070 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa561ffb640 1 -- 172.21.15.102:0/1818600463 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa55c012420 con 0x56540a708070 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa561ffb640 1 -- 172.21.15.102:0/1818600463 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014630 con 0x56540a708070 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 0x7fa5580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.012+0000 7fa568ff9640 1 -- 172.21.15.102:0/1803806376 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa5640e6be0 con 0x7fa56c1049f0 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- 172.21.15.102:0/1818600463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 msgr2=0x56540aaaf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa56b7fe640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 0x7fa5580b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5640e43d0 tx=0x7fa5640ea730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00b7a0 tx=0x7fa55c00bc60 comp rx=0 tx=0).stop 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- 172.21.15.102:0/1818600463 shutdown_connections 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aab0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aaafbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 --2- 172.21.15.102:0/1818600463 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aaaf6a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- 172.21.15.102:0/1818600463 >> 172.21.15.102:0/1818600463 conn(0x56540a6fc460 msgr2=0x56540aaad590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- 172.21.15.102:0/1818600463 shutdown_connections 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- 172.21.15.102:0/1818600463 wait complete. 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 -- start start 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.013+0000 7fa578040740 1 Processor -- start 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aabb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a708070 0x56540aac7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56540a876700 con 0x56540a6df1b0 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56540a9b0160 con 0x56540a708070 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56540aabde80 con 0x56540a6e7390 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa578040740 10 client.0 _ll_register_callbacks cb 0x56540a9c99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35762/0 (socket says 172.21.15.102:35762) 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 -- 172.21.15.102:0/500574964 learned_addr learned my addr 172.21.15.102:0/500574964 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a708070 0x56540aac7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56affd640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aabb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 -- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 msgr2=0x56540aabb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aabb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 -- 172.21.15.102:0/500574964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a708070 msgr2=0x56540aac7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a708070 0x56540aac7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.014+0000 7fa56bfff640 1 -- 172.21.15.102:0/500574964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540a9ddc90 con 0x56540a6df1b0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa56bfff640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00f9f0 tx=0x7fa55c012e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff1b59d8bcecc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa54affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c027070 con 0x56540a6df1b0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa55c00fe60 con 0x56540a6df1b0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa55c012420 con 0x56540a6df1b0 2024-09-21T03:39:46.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa55c030050 con 0x56540a6df1b0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa578040740 10 client.16539 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56540aac9b50 con 0x56540a6df1b0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.015+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa55c012420 con 0x56540a6df1b0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa55c02a020 con 0x56540a6df1b0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 10 client.16539 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 10 client.16539 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 20 client.16539 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a6c69f0 0x56540aaccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 4 client.16539 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56540aa27df0 con 0x56540a6c69f0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.016+0000 7fa56affd640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a6c69f0 0x56540aaccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.017+0000 7fa54affd640 10 client.16539 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:46.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.017+0000 7fa56affd640 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a6c69f0 0x56540aaccfc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94877aa2c2ed4004 server_cookie=d6fbef391040be7c in_seq=0 out_seq=0 2024-09-21T03:39:46.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.017+0000 7fa54affd640 1 -- 172.21.15.102:0/500574964 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56540aa27df0 con 0x56540a6c69f0 2024-09-21T03:39:46.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.017+0000 7fa54affd640 10 client.16539 handle_command_reply: tid=0 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.017+0000 7fa578040740 1 client.16539 shutdown 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 msgr2=0x56540aabad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00f9f0 tx=0x7fa55c012e90 comp rx=0 tx=0).stop 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 shutdown_connections 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a6c69f0 0x56540aaccfc0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a708070 0x56540aac7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aabb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 --2- 172.21.15.102:0/500574964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a6df1b0 0x56540aabad20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 >> 172.21.15.102:0/500574964 conn(0x56540a6fc460 msgr2=0x56540aab2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa54affd640 0 client.16539 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 shutdown_connections 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 1 -- 172.21.15.102:0/500574964 wait complete. 2024-09-21T03:39:46.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.018+0000 7fa578040740 20 client.16539 trim_cache size 0 max 16384 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 Processor -- start 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 -- start start 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aab1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aabc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b4540 con 0x56540a708070 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b1e10 con 0x56540a6e7390 2024-09-21T03:39:46.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa578040740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1afc60 con 0x56540a6df1b0 2024-09-21T03:39:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35766/0 (socket says 172.21.15.102:35766) 2024-09-21T03:39:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa56bfff640 1 -- 172.21.15.102:0/955150305 learned_addr learned my addr 172.21.15.102:0/955150305 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa56bfff640 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aab1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.031+0000 7fa56affd640 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aabc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 -- 172.21.15.102:0/955150305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 msgr2=0x56540aab1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aab1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 -- 172.21.15.102:0/955150305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 msgr2=0x56540aabc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aabc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 -- 172.21.15.102:0/955150305 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56540a6c6c20 con 0x56540a708070 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa56bfff640 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d630 tx=0x7fa55c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19f9e8d864a0762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa5617fa640 1 -- 172.21.15.102:0/955150305 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c027040 con 0x56540a708070 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa5617fa640 1 -- 172.21.15.102:0/955150305 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa55c012bc0 con 0x56540a708070 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.032+0000 7fa5617fa640 1 -- 172.21.15.102:0/955150305 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c020a40 con 0x56540a708070 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- 172.21.15.102:0/955150305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 msgr2=0x56540aac70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00d630 tx=0x7fa55c000bc0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- 172.21.15.102:0/955150305 shutdown_connections 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aac70e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6e7390 0x56540aabc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 --2- 172.21.15.102:0/955150305 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6df1b0 0x56540aab1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- 172.21.15.102:0/955150305 >> 172.21.15.102:0/955150305 conn(0x56540a6fc460 msgr2=0x56540aabc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- 172.21.15.102:0/955150305 shutdown_connections 2024-09-21T03:39:46.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- 172.21.15.102:0/955150305 wait complete. 2024-09-21T03:39:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 -- start start 2024-09-21T03:39:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.033+0000 7fa578040740 1 Processor -- start 2024-09-21T03:39:46.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6df1b0 0x56540aad06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aacdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b02d0 con 0x56540a708070 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b1740 con 0x56540a6df1b0 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b09a0 con 0x56540a6e7390 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa578040740 10 client.0 _ll_register_callbacks cb 0x7fa5640ea600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35780/0 (socket says 172.21.15.102:35780) 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 -- 172.21.15.102:0/2954367872 learned_addr learned my addr 172.21.15.102:0/2954367872 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6df1b0 0x56540aad06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56affd640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aacdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 -- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 msgr2=0x56540aacdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aacdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 -- 172.21.15.102:0/2954367872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6df1b0 msgr2=0x56540aad06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6df1b0 0x56540aad06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 -- 172.21.15.102:0/2954367872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56540aace730 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa56bfff640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa55c006d00 tx=0x7fa55c00bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9feeb03160b82e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.034+0000 7fa54affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c027040 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fa55c00fe70 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa55c012bc0 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa55c00f300 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 10 client.16545 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56540ab37570 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa55c012bc0 con 0x56540a708070 2024-09-21T03:39:46.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa55c02a070 con 0x56540a708070 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 10 client.16545 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 10 client.16545 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 20 client.16545 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a69bda0 0x56540ab39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 4 client.16545 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.035+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56540aa238a0 con 0x56540a69bda0 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa56affd640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a69bda0 0x56540ab39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa54affd640 10 client.16545 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa56affd640 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a69bda0 0x56540ab39bc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=feea617e9fa80354 server_cookie=e80ee575b3bd34a2 in_seq=0 out_seq=0 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa54affd640 1 -- 172.21.15.102:0/2954367872 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56540aa238a0 con 0x56540a69bda0 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa54affd640 10 client.16545 handle_command_reply: tid=0 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa578040740 1 client.16545 shutdown 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 msgr2=0x56540aace0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.036+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa55c006d00 tx=0x7fa55c00bc60 comp rx=0 tx=0).stop 2024-09-21T03:39:46.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 shutdown_connections 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x56540a69bda0 0x56540ab39bc0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56540a708070 0x56540aace0c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56540a6e7390 0x56540aacdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 --2- 172.21.15.102:0/2954367872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56540a6df1b0 0x56540aad06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 >> 172.21.15.102:0/2954367872 conn(0x56540a6fc460 msgr2=0x56540aabc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa54affd640 0 client.16545 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 shutdown_connections 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 1 -- 172.21.15.102:0/2954367872 wait complete. 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa578040740 20 client.16545 trim_cache size 0 max 16384 2024-09-21T03:39:46.044 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 msgr2=0x7fa5580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 0x7fa5580b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa5640e43d0 tx=0x7fa5640ea730 comp rx=0 tx=0).stop 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 msgr2=0x7fa56c19c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b9c0 tx=0x7fa56400be80 comp rx=0 tx=0).stop 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 shutdown_connections 2024-09-21T03:39:46.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5580b6680 0x7fa5580b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa56c10de50 0x7fa56c1a2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa56c105340 0x7fa56c19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 --2- 172.21.15.102:0/1803806376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa56c1049f0 0x7fa56c19c940 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.037+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 >> 172.21.15.102:0/1803806376 conn(0x7fa56c0797e0 msgr2=0x7fa56c1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.038+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 shutdown_connections 2024-09-21T03:39:46.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:46.038+0000 7fa571acc640 1 -- 172.21.15.102:0/1803806376 wait complete. 2024-09-21T03:39:46.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:46 smithi102 ceph-mon[31392]: pgmap v510: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:46 smithi148 ceph-mon[34651]: pgmap v510: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:46 smithi121 ceph-mon[34316]: pgmap v510: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:39:46.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:39:47.053 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.532+0000 7fb8c82f8640 1 -- 172.21.15.102:0/938558886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0107be0 msgr2=0x7fb8c0107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.532+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/938558886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0107be0 0x7fb8c0107ff0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0009900 tx=0x7fb8b002a410 comp rx=0 tx=0).stop 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 -- 172.21.15.102:0/938558886 shutdown_connections 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/938558886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0107be0 0x7fb8c0107ff0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/938558886 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c0108530 0x7fb8c010ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/938558886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c01022a0 0x7fb8c01026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 -- 172.21.15.102:0/938558886 >> 172.21.15.102:0/938558886 conn(0x7fb8c0079ec0 msgr2=0x7fb8c007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 -- 172.21.15.102:0/938558886 shutdown_connections 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 -- 172.21.15.102:0/938558886 wait complete. 2024-09-21T03:39:47.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 Processor -- start 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.533+0000 7fb8c82f8640 1 -- start start 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c01022a0 0x7fb8c019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c0107be0 0x7fb8c019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0112bd0 con 0x7fb8c0108530 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0112a50 con 0x7fb8c0107be0 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c82f8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c0112d50 con 0x7fb8c01022a0 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35796/0 (socket says 172.21.15.102:35796) 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 -- 172.21.15.102:0/2026861246 learned_addr learned my addr 172.21.15.102:0/2026861246 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c5893640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c0107be0 0x7fb8c019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6094640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c01022a0 0x7fb8c019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 -- 172.21.15.102:0/2026861246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c01022a0 msgr2=0x7fb8c019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c01022a0 0x7fb8c019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 -- 172.21.15.102:0/2026861246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c0107be0 msgr2=0x7fb8c019abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c0107be0 0x7fb8c019abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 -- 172.21.15.102:0/2026861246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c01a05c0 con 0x7fb8c0108530 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.534+0000 7fb8c6895640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800b970 tx=0x7fb8b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.535+0000 7fb8b77fe640 1 -- 172.21.15.102:0/2026861246 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8019070 con 0x7fb8c0108530 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.535+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c01a08b0 con 0x7fb8c0108530 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.535+0000 7fb8b77fe640 1 -- 172.21.15.102:0/2026861246 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8b800cb40 con 0x7fb8c0108530 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.535+0000 7fb8b77fe640 1 -- 172.21.15.102:0/2026861246 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b8007650 con 0x7fb8c0108530 2024-09-21T03:39:47.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.535+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c01a7010 con 0x7fb8c0108530 2024-09-21T03:39:47.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.537+0000 7fb8ce86c740 1 Processor -- start 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.537+0000 7fb8b77fe640 1 -- 172.21.15.102:0/2026861246 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fb8b801c070 con 0x7fb8c0108530 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 -- start start 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571f51b0 0x55ad575c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571fd390 0x55ad575c6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad5753bea0 con 0x55ad5721e070 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ad5752b2d0 con 0x55ad571fd390 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad5752f0e0 con 0x55ad571f51b0 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35808/0 (socket says 172.21.15.102:35808) 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8c5893640 1 -- 172.21.15.102:0/709416495 learned_addr learned my addr 172.21.15.102:0/709416495 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:47.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8c6094640 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571f51b0 0x55ad575c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8b77fe640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 0x7fb8ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.538+0000 7fb8c5893640 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571fd390 0x55ad575c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 -- 172.21.15.102:0/709416495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571f51b0 msgr2=0x55ad575c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571f51b0 0x55ad575c5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 -- 172.21.15.102:0/709416495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571fd390 msgr2=0x55ad575c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571fd390 0x55ad575c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 -- 172.21.15.102:0/709416495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad57289650 con 0x55ad5721e070 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c6895640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 0x7fb8ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8b77fe640 1 -- 172.21.15.102:0/2026861246 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb8b80e6c10 con 0x7fb8c0108530 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8c5893640 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00314b0 tx=0x7fb8b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d770cbc87ee5eeef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8b4d9a640 1 -- 172.21.15.102:0/709416495 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0044020 con 0x55ad5721e070 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8b4d9a640 1 -- 172.21.15.102:0/709416495 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8b0031890 con 0x55ad5721e070 2024-09-21T03:39:47.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.539+0000 7fb8b4d9a640 1 -- 172.21.15.102:0/709416495 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035040 con 0x55ad5721e070 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 -- 172.21.15.102:0/709416495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 msgr2=0x55ad575c56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8c6895640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 0x7fb8ac0b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80a9d70 tx=0x7fb8b8094040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00314b0 tx=0x7fb8b0000bc0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 -- 172.21.15.102:0/709416495 shutdown_connections 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571fd390 0x55ad575c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571f51b0 0x55ad575c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/709416495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad5721e070 0x55ad575c56a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 -- 172.21.15.102:0/709416495 >> 172.21.15.102:0/709416495 conn(0x55ad57212460 msgr2=0x55ad575c3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 -- 172.21.15.102:0/709416495 shutdown_connections 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.540+0000 7fb8ce86c740 1 -- 172.21.15.102:0/709416495 wait complete. 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 -- start start 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 Processor -- start 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad5721e070 0x55ad575dd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad5738c700 con 0x55ad571f51b0 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ad574c6160 con 0x55ad5721e070 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ad575d3e20 con 0x55ad571fd390 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8ce86c740 10 client.0 _ll_register_callbacks cb 0x55ad574df9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:47.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35818/0 (socket says 172.21.15.102:35818) 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 -- 172.21.15.102:0/3787593233 learned_addr learned my addr 172.21.15.102:0/3787593233 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c6094640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 -- 172.21.15.102:0/3787593233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 msgr2=0x55ad575d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 -- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad5721e070 msgr2=0x55ad575dd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad5721e070 0x55ad575dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.541+0000 7fb8c5893640 1 -- 172.21.15.102:0/3787593233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad574f3c90 con 0x55ad571f51b0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8c5893640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005dc0 tx=0x7fb8b0005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da96da5261676f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0044050 con 0x55ad571f51b0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb8b003a800 con 0x55ad571f51b0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b0031890 con 0x55ad571f51b0 2024-09-21T03:39:47.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb8b0056050 con 0x55ad571f51b0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8ce86c740 10 client.16557 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ad575dfb20 con 0x55ad571f51b0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8b0031890 con 0x55ad571f51b0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.542+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb8b0048a50 con 0x55ad571f51b0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 10 client.16557 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 10 client.16557 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 20 client.16557 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad571dc9f0 0x55ad575e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 4 client.16557 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad5753ddf0 con 0x55ad571dc9f0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8c6094640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad571dc9f0 0x55ad575e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8a9ffb640 10 client.16557 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:47.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.543+0000 7fb8c6094640 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad571dc9f0 0x55ad575e2e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0d078d0ca18a1f9 server_cookie=5a3879b27a9ae83d in_seq=0 out_seq=0 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/3787593233 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad5753ddf0 con 0x55ad571dc9f0 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8a9ffb640 10 client.16557 handle_command_reply: tid=0 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 client.16557 shutdown 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 msgr2=0x55ad575d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005dc0 tx=0x7fb8b0005970 comp rx=0 tx=0).stop 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 shutdown_connections 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad571dc9f0 0x55ad575e2e80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad5721e070 0x55ad575dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/3787593233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571f51b0 0x55ad575d0d70 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8a9ffb640 0 client.16557 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.544+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 >> 172.21.15.102:0/3787593233 conn(0x55ad57212460 msgr2=0x55ad575c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.545+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 shutdown_connections 2024-09-21T03:39:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.545+0000 7fb8ce86c740 1 -- 172.21.15.102:0/3787593233 wait complete. 2024-09-21T03:39:47.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.545+0000 7fb8ce86c740 20 client.16557 trim_cache size 0 max 16384 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 Processor -- start 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 -- start start 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01b20e0 con 0x55ad571dc9f0 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01af9b0 con 0x55ad571f51b0 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01ad800 con 0x55ad571fd390 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35828/0 (socket says 172.21.15.102:35828) 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 -- 172.21.15.102:0/161077171 learned_addr learned my addr 172.21.15.102:0/161077171 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:47.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 -- 172.21.15.102:0/161077171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 msgr2=0x55ad575c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575c2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 -- 172.21.15.102:0/161077171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 msgr2=0x55ad575d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.558+0000 7fb8c5893640 1 -- 172.21.15.102:0/161077171 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad575c7df0 con 0x55ad571dc9f0 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8c5893640 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0031da0 tx=0x7fb8b0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa91920bcbe8a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8abfff640 1 -- 172.21.15.102:0/161077171 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0044040 con 0x55ad571dc9f0 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8abfff640 1 -- 172.21.15.102:0/161077171 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8b004d070 con 0x55ad571dc9f0 2024-09-21T03:39:47.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8abfff640 1 -- 172.21.15.102:0/161077171 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035040 con 0x55ad571dc9f0 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 -- 172.21.15.102:0/161077171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 msgr2=0x55ad575c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0031da0 tx=0x7fb8b0000bc0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 -- 172.21.15.102:0/161077171 shutdown_connections 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/161077171 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575c7090 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 -- 172.21.15.102:0/161077171 >> 172.21.15.102:0/161077171 conn(0x55ad57212460 msgr2=0x55ad575d2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.559+0000 7fb8ce86c740 1 -- 172.21.15.102:0/161077171 shutdown_connections 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 -- 172.21.15.102:0/161077171 wait complete. 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 -- start start 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 Processor -- start 2024-09-21T03:39:47.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01ade70 con 0x55ad571dc9f0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01af2e0 con 0x55ad571f51b0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c01ae540 con 0x55ad571fd390 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8ce86c740 10 client.0 _ll_register_callbacks cb 0x7fb8bc00b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.560+0000 7fb8c5893640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35844/0 (socket says 172.21.15.102:35844) 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 -- 172.21.15.102:0/4157773466 learned_addr learned my addr 172.21.15.102:0/4157773466 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c6094640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 -- 172.21.15.102:0/4157773466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 msgr2=0x55ad575e3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575e3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 -- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 msgr2=0x55ad575e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 -- 172.21.15.102:0/4157773466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad575e4350 con 0x55ad571dc9f0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c6094640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8c5893640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0040040 tx=0x7fb8b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1840233bd4bb040 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0035070 con 0x55ad571dc9f0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fb8b003dc80 con 0x55ad571dc9f0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8b004d070 con 0x55ad571dc9f0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb8b0044040 con 0x55ad571dc9f0 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8ce86c740 10 client.16563 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:47.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.561+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ad5764d2a0 con 0x55ad571dc9f0 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb8b004d070 con 0x55ad571dc9f0 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb8b0048580 con 0x55ad571dc9f0 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 10 client.16563 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 10 client.16563 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 20 client.16563 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad5721e070 0x55ad5764f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 4 client.16563 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad575398a0 con 0x55ad5721e070 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.562+0000 7fb8c6094640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad5721e070 0x55ad5764f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8c6094640 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad5721e070 0x55ad5764f9a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b178dacea4e9ae6c server_cookie=1fd7c1da1c913afa in_seq=0 out_seq=0 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8a9ffb640 10 client.16563 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8a9ffb640 1 -- 172.21.15.102:0/4157773466 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad575398a0 con 0x55ad5721e070 2024-09-21T03:39:47.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8a9ffb640 10 client.16563 handle_command_reply: tid=0 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 client.16563 shutdown 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 msgr2=0x55ad575e6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0040040 tx=0x7fb8b00046c0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 shutdown_connections 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ad5721e070 0x55ad5764f9a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ad571fd390 0x55ad575e3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ad571f51b0 0x55ad575e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8a9ffb640 0 client.16563 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 --2- 172.21.15.102:0/4157773466 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad571dc9f0 0x55ad575e6400 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 >> 172.21.15.102:0/4157773466 conn(0x55ad57212460 msgr2=0x55ad575d29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 shutdown_connections 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 1 -- 172.21.15.102:0/4157773466 wait complete. 2024-09-21T03:39:47.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.563+0000 7fb8ce86c740 20 client.16563 trim_cache size 0 max 16384 2024-09-21T03:39:47.571 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 msgr2=0x7fb8ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 0x7fb8ac0b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb8b80a9d70 tx=0x7fb8b8094040 comp rx=0 tx=0).stop 2024-09-21T03:39:47.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 msgr2=0x7fb8c019fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb8b800b970 tx=0x7fb8b800be30 comp rx=0 tx=0).stop 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 shutdown_connections 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb8ac0b6680 0x7fb8ac0b8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8c0108530 0x7fb8c019fe90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb8c0107be0 0x7fb8c019abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 --2- 172.21.15.102:0/2026861246 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb8c01022a0 0x7fb8c019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 >> 172.21.15.102:0/2026861246 conn(0x7fb8c0079ec0 msgr2=0x7fb8c010fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:47.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 shutdown_connections 2024-09-21T03:39:47.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:47.564+0000 7fb8c82f8640 1 -- 172.21.15.102:0/2026861246 wait complete. 2024-09-21T03:39:48.463 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:39:48.710 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:48 smithi148 ceph-mon[34651]: pgmap v511: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:48 smithi121 ceph-mon[34316]: pgmap v511: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:48.830 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:48 smithi102 ceph-mon[31392]: pgmap v511: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:39:49.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 -- 172.21.15.102:0/3478131252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 msgr2=0x7f8160102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 --2- 172.21.15.102:0/3478131252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f8160102e70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8150009ca0 tx=0x7f815002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 -- 172.21.15.102:0/3478131252 shutdown_connections 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 --2- 172.21.15.102:0/3478131252 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8160108cf0 0x7f816010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 --2- 172.21.15.102:0/3478131252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f81601083a0 0x7f81601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 --2- 172.21.15.102:0/3478131252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f8160102e70 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 -- 172.21.15.102:0/3478131252 >> 172.21.15.102:0/3478131252 conn(0x7f8160079730 msgr2=0x7f8160079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 -- 172.21.15.102:0/3478131252 shutdown_connections 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.193+0000 7f8165a43640 1 -- 172.21.15.102:0/3478131252 wait complete. 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 Processor -- start 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 -- start start 2024-09-21T03:39:49.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81601083a0 0x7f816019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160108cf0 0x7f816019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113ba0 con 0x7f8160102a60 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113a20 con 0x7f8160108cf0 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f8165a43640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8160113d20 con 0x7f81601083a0 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f815effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f815effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35872/0 (socket says 172.21.15.102:35872) 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.194+0000 7f815effd640 1 -- 172.21.15.102:0/2766744813 learned_addr learned my addr 172.21.15.102:0/2766744813 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815f7fe640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160108cf0 0x7f816019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815e7fc640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81601083a0 0x7f816019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 -- 172.21.15.102:0/2766744813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81601083a0 msgr2=0x7f816019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81601083a0 0x7f816019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 -- 172.21.15.102:0/2766744813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160108cf0 msgr2=0x7f816019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160108cf0 0x7f816019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 -- 172.21.15.102:0/2766744813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81601a03c0 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f815effd640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8150006010 tx=0x7f8150003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f8164a41640 1 -- 172.21.15.102:0/2766744813 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81500316d0 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81601a0650 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f8164a41640 1 -- 172.21.15.102:0/2766744813 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8150031870 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f8164a41640 1 -- 172.21.15.102:0/2766744813 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815002fc90 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.195+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81601a0b90 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 Processor -- start 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 -- start start 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f8164a41640 1 -- 172.21.15.102:0/2766744813 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f8150004040 con 0x7f8160102a60 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ddbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555e80553ea0 con 0x555e80215390 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555e805432d0 con 0x555e80236070 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f816bfb7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555e805470e0 con 0x555e8020d1b0 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f815e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f815e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35874/0 (socket says 172.21.15.102:35874) 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.198+0000 7f815e7fc640 1 -- 172.21.15.102:0/1642893629 learned_addr learned my addr 172.21.15.102:0/1642893629 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815effd640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ddbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 -- 172.21.15.102:0/1642893629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 msgr2=0x555e805ddbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ddbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 -- 172.21.15.102:0/1642893629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 msgr2=0x555e805dd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805dd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 -- 172.21.15.102:0/1642893629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e802a1650 con 0x555e80215390 2024-09-21T03:39:49.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815effd640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805dd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f814800bae0 tx=0x7f814800d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cab169bb60dd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f8164a41640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f8155ffb640 1 -- 172.21.15.102:0/1642893629 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148017420 con 0x555e80215390 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f815f7fe640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f8155ffb640 1 -- 172.21.15.102:0/1642893629 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8148017a90 con 0x555e80215390 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f8155ffb640 1 -- 172.21.15.102:0/1642893629 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814800faa0 con 0x555e80215390 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.199+0000 7f8164a41640 1 -- 172.21.15.102:0/2766744813 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8150108bd0 con 0x7f8160102a60 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 -- 172.21.15.102:0/1642893629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 msgr2=0x555e805de120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f815f7fe640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 0x7f814c0b8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8158005fd0 tx=0x7f815800b670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f814800bae0 tx=0x7f814800d340 comp rx=0 tx=0).stop 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 -- 172.21.15.102:0/1642893629 shutdown_connections 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805de120 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ddbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1642893629 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805dd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 -- 172.21.15.102:0/1642893629 >> 172.21.15.102:0/1642893629 conn(0x555e8022a460 msgr2=0x555e805db590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 -- 172.21.15.102:0/1642893629 shutdown_connections 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.200+0000 7f816bfb7740 1 -- 172.21.15.102:0/1642893629 wait complete. 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 -- start start 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 Processor -- start 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ed060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805edae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555e803a4700 con 0x555e80215390 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555e804de160 con 0x555e80236070 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x555e805f01e0 con 0x555e8020d1b0 2024-09-21T03:39:49.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f816bfb7740 10 client.0 _ll_register_callbacks cb 0x555e804f79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f815e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f815e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35886/0 (socket says 172.21.15.102:35886) 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f815e7fc640 1 -- 172.21.15.102:0/1253003312 learned_addr learned my addr 172.21.15.102:0/1253003312 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.201+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815effd640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ed060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 -- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 msgr2=0x555e805ed060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ed060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 -- 172.21.15.102:0/1253003312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 msgr2=0x555e805edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 -- 172.21.15.102:0/1253003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e8050bc90 con 0x555e80215390 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815effd640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8148019040 tx=0x7f8148017c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabaa9991ec1b1aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f813effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148027030 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f8148017630 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8148017a90 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8148031050 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f816bfb7740 10 client.16575 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555e805fbe80 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.202+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8148017a90 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f81480049f0 con 0x555e80215390 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 10 client.16575 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 10 client.16575 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 20 client.16575 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801f49f0 0x555e805ff2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 4 client.16575 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e80555df0 con 0x555e801f49f0 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f815effd640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801f49f0 0x555e805ff2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f815effd640 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801f49f0 0x555e805ff2f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8d9d3e18667c73 server_cookie=3a681ca3a8c0f29e in_seq=0 out_seq=0 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.203+0000 7f813effd640 10 client.16575 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f813effd640 1 -- 172.21.15.102:0/1253003312 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555e80555df0 con 0x555e801f49f0 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f813effd640 10 client.16575 handle_command_reply: tid=0 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 client.16575 shutdown 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 msgr2=0x555e805ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8148019040 tx=0x7f8148017c40 comp rx=0 tx=0).stop 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 shutdown_connections 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801f49f0 0x555e805ff2f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80215390 0x555e805ed5a0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80236070 0x555e805edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f813effd640 0 client.16575 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1253003312 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805ed060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 >> 172.21.15.102:0/1253003312 conn(0x555e8022a460 msgr2=0x555e805d9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.204+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 shutdown_connections 2024-09-21T03:39:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.205+0000 7f816bfb7740 1 -- 172.21.15.102:0/1253003312 wait complete. 2024-09-21T03:39:49.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.205+0000 7f816bfb7740 20 client.16575 trim_cache size 0 max 16384 2024-09-21T03:39:49.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 Processor -- start 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 -- start start 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e805ea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81601afed0 con 0x555e80236070 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81601ad7a0 con 0x555e80215390 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f816bfb7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81601ab5f0 con 0x555e8020d1b0 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35890/0 (socket says 172.21.15.102:35890) 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 -- 172.21.15.102:0/1167795208 learned_addr learned my addr 172.21.15.102:0/1167795208 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815e7fc640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e805ea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815effd640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 -- 172.21.15.102:0/1167795208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 msgr2=0x555e805dede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805dede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 -- 172.21.15.102:0/1167795208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 msgr2=0x555e805ea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e805ea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815f7fe640 1 -- 172.21.15.102:0/1167795208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e805f0260 con 0x555e80236070 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.218+0000 7f815effd640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.219+0000 7f815f7fe640 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f81580127a0 tx=0x7f8158014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844e4bac4f5d36f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.219+0000 7f81557fa640 1 -- 172.21.15.102:0/1167795208 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158012e60 con 0x555e80236070 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.219+0000 7f81557fa640 1 -- 172.21.15.102:0/1167795208 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8158005020 con 0x555e80236070 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.219+0000 7f81557fa640 1 -- 172.21.15.102:0/1167795208 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158004bd0 con 0x555e80236070 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- 172.21.15.102:0/1167795208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 msgr2=0x555e805ea790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f81580127a0 tx=0x7f8158014000 comp rx=0 tx=0).stop 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- 172.21.15.102:0/1167795208 shutdown_connections 2024-09-21T03:39:49.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e805ea790 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e805ea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 --2- 172.21.15.102:0/1167795208 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e805dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- 172.21.15.102:0/1167795208 >> 172.21.15.102:0/1167795208 conn(0x555e8022a460 msgr2=0x555e805de6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- 172.21.15.102:0/1167795208 shutdown_connections 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- 172.21.15.102:0/1167795208 wait complete. 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 -- start start 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.220+0000 7f816bfb7740 1 Processor -- start 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e80600680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e80600bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81601abc60 con 0x555e80236070 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f81601ad0d0 con 0x555e80215390 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f81601ac330 con 0x555e8020d1b0 2024-09-21T03:39:49.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f816bfb7740 10 client.0 _ll_register_callbacks cb 0x7f814800b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35900/0 (socket says 172.21.15.102:35900) 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815f7fe640 1 -- 172.21.15.102:0/283123995 learned_addr learned my addr 172.21.15.102:0/283123995 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e80600bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815effd640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e80600680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 -- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 msgr2=0x555e80600680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e80600680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 -- 172.21.15.102:0/283123995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 msgr2=0x555e80668a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 -- 172.21.15.102:0/283123995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e805de490 con 0x555e80215390 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815f7fe640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f815e7fc640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e80600bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f814800d8c0 tx=0x7f81480058c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0dddbda27a4dda0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:49.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.221+0000 7f813effd640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148027030 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f814800f9f0 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8158005020 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8148017630 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 10 client.25874 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555e80669df0 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8158005020 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8148005240 con 0x555e80215390 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 10 client.25874 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 10 client.25874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 20 client.25874 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801c9da0 0x555e8066c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 4 client.25874 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:39:49.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.222+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555e805518a0 con 0x555e801c9da0 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f815effd640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801c9da0 0x555e8066c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f813effd640 10 client.25874 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f815effd640 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801c9da0 0x555e8066c490 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ada015271b2489a server_cookie=bb94090b796e4d6c in_seq=0 out_seq=0 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f813effd640 1 -- 172.21.15.102:0/283123995 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555e805518a0 con 0x555e801c9da0 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f813effd640 10 client.25874 handle_command_reply: tid=0 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.223+0000 7f816bfb7740 1 client.25874 shutdown 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 msgr2=0x555e80600bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e80600bc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f814800d8c0 tx=0x7f81480058c0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 shutdown_connections 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x555e801c9da0 0x555e8066c490 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555e80236070 0x555e80668a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555e80215390 0x555e80600bc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 --2- 172.21.15.102:0/283123995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x555e8020d1b0 0x555e80600680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f813effd640 0 client.25874 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:49.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 >> 172.21.15.102:0/283123995 conn(0x555e8022a460 msgr2=0x555e805de6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 shutdown_connections 2024-09-21T03:39:49.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 1 -- 172.21.15.102:0/283123995 wait complete. 2024-09-21T03:39:49.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f816bfb7740 20 client.25874 trim_cache size 0 max 16384 2024-09-21T03:39:49.233 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 msgr2=0x7f814c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 0x7f814c0b8bc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8158005fd0 tx=0x7f815800b670 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 msgr2=0x7f816019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8150006010 tx=0x7f8150003f10 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.224+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 shutdown_connections 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f814c0b66b0 0x7f814c0b8bc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8160108cf0 0x7f816019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f81601083a0 0x7f816019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 --2- 172.21.15.102:0/2766744813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8160102a60 0x7f816019a510 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:49.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 >> 172.21.15.102:0/2766744813 conn(0x7f8160079730 msgr2=0x7f81601013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:49.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 shutdown_connections 2024-09-21T03:39:49.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:49.225+0000 7f8165a43640 1 -- 172.21.15.102:0/2766744813 wait complete. 2024-09-21T03:39:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:50 smithi148 ceph-mon[34651]: pgmap v512: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:50 smithi121 ceph-mon[34316]: pgmap v512: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:50.938 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:39:50.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:39:50.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:50 smithi102 ceph-mon[31392]: pgmap v512: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:39:51.199 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- 172.21.15.102:0/1408775222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac981094a0 msgr2=0x7fac981098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 --2- 172.21.15.102:0/1408775222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac981094a0 0x7fac981098b0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fac80009900 tx=0x7fac8002a410 comp rx=0 tx=0).stop 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- 172.21.15.102:0/1408775222 shutdown_connections 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 --2- 172.21.15.102:0/1408775222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac981094a0 0x7fac981098b0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 --2- 172.21.15.102:0/1408775222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac98109df0 0x7fac98110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 --2- 172.21.15.102:0/1408775222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98103b60 0x7fac98103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- 172.21.15.102:0/1408775222 >> 172.21.15.102:0/1408775222 conn(0x7fac9807b850 msgr2=0x7fac9807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- 172.21.15.102:0/1408775222 shutdown_connections 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- 172.21.15.102:0/1408775222 wait complete. 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 Processor -- start 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.706+0000 7fac9e45d640 1 -- start start 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac981094a0 0x7fac9819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98109df0 0x7fac9819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac98113bd0 con 0x7fac98103b60 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac98113a50 con 0x7fac98109df0 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9e45d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac98113d50 con 0x7fac981094a0 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35920/0 (socket says 172.21.15.102:35920) 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 -- 172.21.15.102:0/2117542424 learned_addr learned my addr 172.21.15.102:0/2117542424 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:51.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac8ffff640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac981094a0 0x7fac9819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98109df0 0x7fac9819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 -- 172.21.15.102:0/2117542424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac981094a0 msgr2=0x7fac9819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac981094a0 0x7fac9819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 -- 172.21.15.102:0/2117542424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98109df0 msgr2=0x7fac9819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98109df0 0x7fac9819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 -- 172.21.15.102:0/2117542424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac981a04d0 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac97fff640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fac8800e9f0 tx=0x7fac8800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.707+0000 7fac95ffb640 1 -- 172.21.15.102:0/2117542424 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8800cd80 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.708+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac981a07c0 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.708+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac981a6f20 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.708+0000 7fac95ffb640 1 -- 172.21.15.102:0/2117542424 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac88010900 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.708+0000 7fac95ffb640 1 -- 172.21.15.102:0/2117542424 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac88026060 con 0x7fac98103b60 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.710+0000 7faca49d1740 1 Processor -- start 2024-09-21T03:39:51.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.710+0000 7faca49d1740 1 -- start start 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.710+0000 7fac95ffb640 1 -- 172.21.15.102:0/2117542424 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fac88018950 con 0x7fac98103b60 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0375430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0375eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561ca02ebe60 con 0x561c9ffa5490 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ca02db290 con 0x561c9ffad670 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7faca49d1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561ca02df0a0 con 0x561c9ffce350 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35936/0 (socket says 172.21.15.102:35936) 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 -- 172.21.15.102:0/3926578265 learned_addr learned my addr 172.21.15.102:0/3926578265 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0375430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac8ffff640 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0375eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 -- 172.21.15.102:0/3926578265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 msgr2=0x561ca0375430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0375430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 -- 172.21.15.102:0/3926578265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 msgr2=0x561ca0375eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0375eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 -- 172.21.15.102:0/3926578265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ca0039930 con 0x561c9ffa5490 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac97fff640 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fac880e4fd0 tx=0x7fac880ef690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78380b02edd77b6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac95ffb640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 0x7fac840b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.711+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 0x7fac840b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.712+0000 7fac8e7fc640 1 -- 172.21.15.102:0/3926578265 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac880f6070 con 0x561c9ffa5490 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.712+0000 7fac95ffb640 1 -- 172.21.15.102:0/2117542424 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fac880e7920 con 0x7fac98103b60 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.712+0000 7fac8e7fc640 1 -- 172.21.15.102:0/3926578265 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac88018420 con 0x561c9ffa5490 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.712+0000 7fac8e7fc640 1 -- 172.21.15.102:0/3926578265 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac880a9600 con 0x561c9ffa5490 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- 172.21.15.102:0/3926578265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 msgr2=0x561ca0375970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 0x7fac840b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac90005fd0 tx=0x7fac90009740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fac880e4fd0 tx=0x7fac880ef690 comp rx=0 tx=0).stop 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- 172.21.15.102:0/3926578265 shutdown_connections 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffa5490 0x561ca0375970 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0375eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 --2- 172.21.15.102:0/3926578265 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0375430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- 172.21.15.102:0/3926578265 >> 172.21.15.102:0/3926578265 conn(0x561c9ffc2740 msgr2=0x561ca0373320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- 172.21.15.102:0/3926578265 shutdown_connections 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- 172.21.15.102:0/3926578265 wait complete. 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 -- start start 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.713+0000 7faca49d1740 1 Processor -- start 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca0385310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0391330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561ca013c890 con 0x561c9ffad670 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561ca0275d40 con 0x561c9ffa5490 2024-09-21T03:39:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561ca0387f70 con 0x561c9ffce350 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 10 client.0 _ll_register_callbacks cb 0x561ca02d9c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35948/0 (socket says 172.21.15.102:35948) 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 -- 172.21.15.102:0/2157140851 learned_addr learned my addr 172.21.15.102:0/2157140851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0391330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac97fff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca0385310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 -- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 msgr2=0x561ca0391330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0391330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 -- 172.21.15.102:0/2157140851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 msgr2=0x561ca0385310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca0385310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 -- 172.21.15.102:0/2157140851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ca0391870 con 0x561c9ffad670 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac8ffff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fac800314b0 tx=0x7fac80031eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952873dd50fe3b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac777fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80035040 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac88018420 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.714+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fac80004050 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fac80004250 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 10 client.16593 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ca0394150 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac88018420 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fac80004b30 con 0x561c9ffad670 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 10 client.16593 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 10 client.16593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 20 client.16593 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff8ccd0 0x561ca0397640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 4 client.16593 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ca02eddb0 con 0x561c9ff8ccd0 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.715+0000 7fac97fff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff8ccd0 0x561ca0397640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.716+0000 7fac777fe640 10 client.16593 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.716+0000 7fac97fff640 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff8ccd0 0x561ca0397640 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=868665ff290d4e3e server_cookie=e62c9e1b5dd1017 in_seq=0 out_seq=0 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.716+0000 7fac777fe640 1 -- 172.21.15.102:0/2157140851 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ca02eddb0 con 0x561c9ff8ccd0 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.716+0000 7fac777fe640 10 client.16593 handle_command_reply: tid=0 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.716+0000 7faca49d1740 1 client.16593 shutdown 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 msgr2=0x561ca0385850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fac800314b0 tx=0x7fac80031eb0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 shutdown_connections 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff8ccd0 0x561ca0397640 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca0385850 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0391330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 --2- 172.21.15.102:0/2157140851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca0385310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 >> 172.21.15.102:0/2157140851 conn(0x561c9ffc2740 msgr2=0x561ca0371850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7fac777fe640 0 client.16593 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 shutdown_connections 2024-09-21T03:39:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 1 -- 172.21.15.102:0/2157140851 wait complete. 2024-09-21T03:39:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.717+0000 7faca49d1740 20 client.16593 trim_cache size 0 max 16384 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 Processor -- start 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 -- start start 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 0x561ca0383990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0383ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac78011170 con 0x561c9ffce350 2024-09-21T03:39:51.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800ea40 con 0x561c9ffad670 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7faca49d1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800c890 con 0x561c9ffa5490 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7fac9c9fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7fac9c9fa640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35960/0 (socket says 172.21.15.102:35960) 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7fac9c9fa640 1 -- 172.21.15.102:0/2590490699 learned_addr learned my addr 172.21.15.102:0/2590490699 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.735+0000 7fac8ffff640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0383ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac97fff640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 0x561ca0383990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 -- 172.21.15.102:0/2590490699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 msgr2=0x561ca0383990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 0x561ca0383990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 -- 172.21.15.102:0/2590490699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 msgr2=0x561ca0383ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0383ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 -- 172.21.15.102:0/2590490699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ca03863d0 con 0x561c9ffce350 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac97fff640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 0x561ca0383990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:51.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fac9001e7d0 tx=0x7fac90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651a162812e28f83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac8dffb640 1 -- 172.21.15.102:0/2590490699 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9002d070 con 0x561c9ffce350 2024-09-21T03:39:51.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac8dffb640 1 -- 172.21.15.102:0/2590490699 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac9001fdf0 con 0x561c9ffce350 2024-09-21T03:39:51.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.736+0000 7fac8dffb640 1 -- 172.21.15.102:0/2590490699 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90028d50 con 0x561c9ffce350 2024-09-21T03:39:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- 172.21.15.102:0/2590490699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 msgr2=0x561ca0371850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fac9001e7d0 tx=0x7fac90015000 comp rx=0 tx=0).stop 2024-09-21T03:39:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- 172.21.15.102:0/2590490699 shutdown_connections 2024-09-21T03:39:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffce350 0x561ca0371850 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffad670 0x561ca0383ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 --2- 172.21.15.102:0/2590490699 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffa5490 0x561ca0383990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- 172.21.15.102:0/2590490699 >> 172.21.15.102:0/2590490699 conn(0x561c9ffc2740 msgr2=0x561ca0380250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- 172.21.15.102:0/2590490699 shutdown_connections 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- 172.21.15.102:0/2590490699 wait complete. 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.737+0000 7faca49d1740 1 -- start start 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 Processor -- start 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca038d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0388250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800cf00 con 0x561c9ffad670 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800e370 con 0x561c9ffa5490 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac7800d5d0 con 0x561c9ffce350 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7faca49d1740 10 client.0 _ll_register_callbacks cb 0x7fac80009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:51.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35976/0 (socket says 172.21.15.102:35976) 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 -- 172.21.15.102:0/464477653 learned_addr learned my addr 172.21.15.102:0/464477653 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac9c9fa640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0388250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac97fff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca038d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 -- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 msgr2=0x561ca0388250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0388250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 -- 172.21.15.102:0/464477653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 msgr2=0x561ca038d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca038d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.738+0000 7fac8ffff640 1 -- 172.21.15.102:0/464477653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ca038dd20 con 0x561c9ffad670 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac8ffff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fac800314b0 tx=0x7fac80005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee36f7f17cc806cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80035030 con 0x561c9ffad670 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7fac800043f0 con 0x561c9ffad670 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac9001fdf0 con 0x561c9ffad670 2024-09-21T03:39:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fac80052040 con 0x561c9ffad670 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 10 client.16599 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ca0402240 con 0x561c9ffad670 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac9001fdf0 con 0x561c9ffad670 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fac80004fb0 con 0x561c9ffad670 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 10 client.16599 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 20 client.16599 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff62080 0x561ca0404a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 4 client.16599 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.739+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561ca02e9860 con 0x561c9ff62080 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.740+0000 7fac97fff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff62080 0x561ca0404a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.740+0000 7fac97fff640 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff62080 0x561ca0404a00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93616d7bf5327c90 server_cookie=6ccdb4a236e6d4ad in_seq=0 out_seq=0 2024-09-21T03:39:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.740+0000 7fac777fe640 10 client.16599 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7fac777fe640 1 -- 172.21.15.102:0/464477653 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561ca02e9860 con 0x561c9ff62080 2024-09-21T03:39:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7fac777fe640 10 client.16599 handle_command_reply: tid=0 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 client.16599 shutdown 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 msgr2=0x561ca038d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fac800314b0 tx=0x7fac80005de0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 shutdown_connections 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561c9ff62080 0x561ca0404a00 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561c9ffad670 0x561ca038d7e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561c9ffce350 0x561ca0388250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 --2- 172.21.15.102:0/464477653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561c9ffa5490 0x561ca038d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 >> 172.21.15.102:0/464477653 conn(0x561c9ffc2740 msgr2=0x561ca0380250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7fac777fe640 0 client.16599 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 shutdown_connections 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 1 -- 172.21.15.102:0/464477653 wait complete. 2024-09-21T03:39:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.742+0000 7faca49d1740 20 client.16599 trim_cache size 0 max 16384 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "9ca14f81-6c0b-49ab-b3ca-445b25a75aea", 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 msgr2=0x7fac840b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 0x7fac840b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fac90005fd0 tx=0x7fac90009740 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 msgr2=0x7fac9819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fac8800e9f0 tx=0x7fac8800eeb0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 shutdown_connections 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac840b6680 0x7fac840b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac98109df0 0x7fac9819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac981094a0 0x7fac9819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 --2- 172.21.15.102:0/2117542424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac98103b60 0x7fac9819a560 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 >> 172.21.15.102:0/2117542424 conn(0x7fac9807b850 msgr2=0x7fac98105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 shutdown_connections 2024-09-21T03:39:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:51.743+0000 7fac9e45d640 1 -- 172.21.15.102:0/2117542424 wait complete. 2024-09-21T03:39:52.461 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:39:52.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:52 smithi102 ceph-mon[31392]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:52 smithi148 ceph-mon[34651]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:52.748 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:39:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:52 smithi121 ceph-mon[34316]: pgmap v513: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 -- 172.21.15.102:0/4130521567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc103bb0 msgr2=0x7f6bdc103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 --2- 172.21.15.102:0/4130521567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc103fc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009900 tx=0x7f6bcc02a410 comp rx=0 tx=0).stop 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 -- 172.21.15.102:0/4130521567 shutdown_connections 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 --2- 172.21.15.102:0/4130521567 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 --2- 172.21.15.102:0/4130521567 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 --2- 172.21.15.102:0/4130521567 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc103fc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 -- 172.21.15.102:0/4130521567 >> 172.21.15.102:0/4130521567 conn(0x7f6bdc0ff600 msgr2=0x7f6bdc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 -- 172.21.15.102:0/4130521567 shutdown_connections 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.255+0000 7f6be23f0640 1 -- 172.21.15.102:0/4130521567 wait complete. 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 Processor -- start 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 -- start start 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc113c80 con 0x7f6bdc1094f0 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc113b00 con 0x7f6bdc109e40 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be23f0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc113e00 con 0x7f6bdc103bb0 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35988/0 (socket says 172.21.15.102:35988) 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/2416715424 learned_addr learned my addr 172.21.15.102:0/2416715424 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.256+0000 7f6be098d640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/2416715424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 msgr2=0x7f6bdc19a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc19a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/2416715424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 msgr2=0x7f6bdc19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/2416715424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc1a04e0 con 0x7f6bdc1094f0 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6be098d640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bd97fa640 1 -- 172.21.15.102:0/2416715424 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0011830 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc1a07d0 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bd97fa640 1 -- 172.21.15.102:0/2416715424 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6bd0016070 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6bd97fa640 1 -- 172.21.15.102:0/2416715424 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000f2e0 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.257+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bdc1a6ff0 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.259+0000 7f6bd97fa640 1 -- 172.21.15.102:0/2416715424 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f6bd00119d0 con 0x7f6bdc1094f0 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 Processor -- start 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 -- start start 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 0x5591d86d57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86d5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5591d864be50 con 0x5591d832e070 2024-09-21T03:39:53.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5591d863b280 con 0x5591d830d390 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be8964740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591d863f090 con 0x5591d83051b0 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35996/0 (socket says 172.21.15.102:35996) 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 -- 172.21.15.102:0/1964117138 learned_addr learned my addr 172.21.15.102:0/1964117138 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 0x5591d86d57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6bd97fa640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 0x7f6bc40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 -- 172.21.15.102:0/1964117138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 msgr2=0x5591d86d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 0x5591d86d57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 -- 172.21.15.102:0/1964117138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 msgr2=0x5591d86d5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.260+0000 7f6be098d640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86d5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6be098d640 1 -- 172.21.15.102:0/1964117138 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d8399650 con 0x5591d832e070 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 0x5591d86d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6be098d640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 0x7f6bc40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6bd97fa640 1 -- 172.21.15.102:0/2416715424 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6bd00e6e10 con 0x7f6bdc1094f0 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6be098d640 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400d340 tx=0x7f6bd400d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3b1e911fbebbed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6bc27fc640 1 -- 172.21.15.102:0/1964117138 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd401a920 con 0x5591d832e070 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6bc27fc640 1 -- 172.21.15.102:0/1964117138 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6bd4019410 con 0x5591d832e070 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.261+0000 7f6bc27fc640 1 -- 172.21.15.102:0/1964117138 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd400f610 con 0x5591d832e070 2024-09-21T03:39:53.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- 172.21.15.102:0/1964117138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 msgr2=0x5591d86d5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be098d640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 0x7f6bc40b8bc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6bd401e000 tx=0x7f6bd401f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400d340 tx=0x7f6bd400d800 comp rx=0 tx=0).stop 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- 172.21.15.102:0/1964117138 shutdown_connections 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86d5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d83051b0 0x5591d86d57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 --2- 172.21.15.102:0/1964117138 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d832e070 0x5591d86d5270 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- 172.21.15.102:0/1964117138 >> 172.21.15.102:0/1964117138 conn(0x5591d8322460 msgr2=0x5591d86d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- 172.21.15.102:0/1964117138 shutdown_connections 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- 172.21.15.102:0/1964117138 wait complete. 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.262+0000 7f6be8964740 1 -- start start 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 Processor -- start 2024-09-21T03:39:53.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d830d390 0x5591d86e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 0x5591d86ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5591d849c700 con 0x5591d83051b0 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5591d85d6110 con 0x5591d832e070 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5591d86e3a50 con 0x5591d830d390 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be8964740 10 client.0 _ll_register_callbacks cb 0x5591d85ef990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36010/0 (socket says 172.21.15.102:36010) 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 -- 172.21.15.102:0/1236130243 learned_addr learned my addr 172.21.15.102:0/1236130243 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d830d390 0x5591d86e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be098d640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 0x5591d86ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 -- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d830d390 msgr2=0x5591d86e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d830d390 0x5591d86e0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 -- 172.21.15.102:0/1236130243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 msgr2=0x5591d86ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 0x5591d86ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6bdbfff640 1 -- 172.21.15.102:0/1236130243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d8603c40 con 0x5591d83051b0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.263+0000 7f6be098d640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 0x5591d86ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009900 tx=0x7f6bcc0317a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95fc9bf39f06d42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc035070 con 0x5591d83051b0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6bcc004240 con 0x5591d83051b0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd4019410 con 0x5591d83051b0 2024-09-21T03:39:53.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6bcc004440 con 0x5591d83051b0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 10 client.16611 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5591d86ef730 con 0x5591d83051b0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6bd4019410 con 0x5591d83051b0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6bcc0035f0 con 0x5591d83051b0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 10 client.16611 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 20 client.16611 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82ec9f0 0x5591d86f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 4 client.16611 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.264+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591d864dda0 con 0x5591d82ec9f0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.265+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82ec9f0 0x5591d86f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.265+0000 7f6bbb7fe640 10 client.16611 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.265+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82ec9f0 0x5591d86f2b90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75bf1286cfb8310c server_cookie=938a8ded0cafb064 in_seq=0 out_seq=0 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/1236130243 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5591d864dda0 con 0x5591d82ec9f0 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6bbb7fe640 10 client.16611 handle_command_reply: tid=0 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 client.16611 shutdown 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 msgr2=0x5591d86e0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009900 tx=0x7f6bcc0317a0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 shutdown_connections 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d832e070 0x5591d86ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d830d390 0x5591d86e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82ec9f0 0x5591d86f2b90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 --2- 172.21.15.102:0/1236130243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e0930 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 >> 172.21.15.102:0/1236130243 conn(0x5591d8322460 msgr2=0x5591d86d8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6bbb7fe640 0 client.16611 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 shutdown_connections 2024-09-21T03:39:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 1 -- 172.21.15.102:0/1236130243 wait complete. 2024-09-21T03:39:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.266+0000 7f6be8964740 20 client.16611 trim_cache size 0 max 16384 2024-09-21T03:39:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 Processor -- start 2024-09-21T03:39:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 -- start start 2024-09-21T03:39:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 0x5591d86df820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1b21b0 con 0x5591d830d390 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1afa80 con 0x5591d83051b0 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be8964740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1ad8d0 con 0x5591d832e070 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36016/0 (socket says 172.21.15.102:36016) 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/4254136117 learned_addr learned my addr 172.21.15.102:0/4254136117 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6be098d640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 0x5591d86df820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/4254136117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 msgr2=0x5591d86d2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86d2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/4254136117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 msgr2=0x5591d86df820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 0x5591d86df820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.284+0000 7f6bdb7fe640 1 -- 172.21.15.102:0/4254136117 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591d86e3070 con 0x5591d830d390 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.285+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 0x5591d86df820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.285+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00e45b0 tx=0x7f6bd00e9320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c610acaa493042cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.285+0000 7f6bc1ffb640 1 -- 172.21.15.102:0/4254136117 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00ac5a0 con 0x5591d830d390 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.285+0000 7f6bc1ffb640 1 -- 172.21.15.102:0/4254136117 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6bd0010eb0 con 0x5591d830d390 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.285+0000 7f6bc1ffb640 1 -- 172.21.15.102:0/4254136117 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00a83c0 con 0x5591d830d390 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- 172.21.15.102:0/4254136117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 msgr2=0x5591d86e2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00e45b0 tx=0x7f6bd00e9320 comp rx=0 tx=0).stop 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- 172.21.15.102:0/4254136117 shutdown_connections 2024-09-21T03:39:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d830d390 0x5591d86e2560 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86d2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 --2- 172.21.15.102:0/4254136117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d83051b0 0x5591d86df820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- 172.21.15.102:0/4254136117 >> 172.21.15.102:0/4254136117 conn(0x5591d8322460 msgr2=0x5591d86e1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- 172.21.15.102:0/4254136117 shutdown_connections 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- 172.21.15.102:0/4254136117 wait complete. 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 -- start start 2024-09-21T03:39:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.286+0000 7f6be8964740 1 Processor -- start 2024-09-21T03:39:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86e5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1adf40 con 0x5591d83051b0 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1af3b0 con 0x5591d830d390 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc1ae610 con 0x5591d832e070 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 10 client.0 _ll_register_callbacks cb 0x7f6bcc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36020/0 (socket says 172.21.15.102:36020) 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 -- 172.21.15.102:0/2175900743 learned_addr learned my addr 172.21.15.102:0/2175900743 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be098d640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 -- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 msgr2=0x5591d86e5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86e5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 -- 172.21.15.102:0/2175900743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 msgr2=0x5591d86e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 -- 172.21.15.102:0/2175900743 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591d86e5820 con 0x5591d83051b0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be098d640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bdbfff640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02a450 tx=0x7f6bcc031900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5645eeccbb4ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bcc035070 con 0x5591d83051b0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8542+0+0 (secure 0 0 0) 0x7f6bcc0049a0 con 0x5591d83051b0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.287+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5591d8649850 con 0x5591d83051b0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6bcc05d050 con 0x5591d83051b0 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 10 client.16617 fetch_fsmap learned FSMap version 35 2024-09-21T03:39:53.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5591d875d6c0 con 0x5591d83051b0 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x5591d8649850 con 0x5591d83051b0 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6bcc044c00 con 0x5591d83051b0 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 10 client.16617 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 20 client.16617 populate_metadata read hostname 'smithi102' 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82c1da0 0x5591d875feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 4 client.16617 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5591d8646c80 con 0x5591d82c1da0 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.288+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82c1da0 0x5591d875feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6bbb7fe640 10 client.16617 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:53.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6bdb7fe640 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82c1da0 0x5591d875feb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee9ad22c327c623 server_cookie=3e3708a32554ece1 in_seq=0 out_seq=0 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6bbb7fe640 1 -- 172.21.15.102:0/2175900743 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x5591d8646c80 con 0x5591d82c1da0 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6bbb7fe640 10 client.16617 handle_command_reply: tid=0 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 client.16617 shutdown 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 msgr2=0x5591d86e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc02a450 tx=0x7f6bcc031900 comp rx=0 tx=0).stop 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 shutdown_connections 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5591d832e070 0x5591d86e5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5591d830d390 0x5591d86e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5591d82c1da0 0x5591d875feb0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 --2- 172.21.15.102:0/2175900743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591d83051b0 0x5591d86e95b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.289+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 >> 172.21.15.102:0/2175900743 conn(0x5591d8322460 msgr2=0x5591d86d62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6bbb7fe640 0 client.16617 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 shutdown_connections 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be8964740 1 -- 172.21.15.102:0/2175900743 wait complete. 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be8964740 20 client.16617 trim_cache size 0 max 16384 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:39:53.299 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "9ca14f81-6c0b-49ab-b3ca-445b25a75aea", 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.300 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:39:53.301 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.302 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:39:53.303 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.304 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:39:53.305 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.306 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:39:53.307 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:39:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 msgr2=0x7f6bc40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 0x7f6bc40b8bc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6bd401e000 tx=0x7f6bd401f000 comp rx=0 tx=0).stop 2024-09-21T03:39:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 msgr2=0x7f6bdc19abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:39:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0006fd0 tx=0x7f6bd000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 shutdown_connections 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6bc40b66b0 0x7f6bc40b8bc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6bdc1094f0 0x7f6bdc19abd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6bdc109e40 0x7f6bdc19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 --2- 172.21.15.102:0/2416715424 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6bdc103bb0 0x7f6bdc19a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 >> 172.21.15.102:0/2416715424 conn(0x7f6bdc0ff600 msgr2=0x7f6bdc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.290+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 shutdown_connections 2024-09-21T03:39:53.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:39:53.291+0000 7f6be23f0640 1 -- 172.21.15.102:0/2416715424 wait complete. 2024-09-21T03:39:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:53 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:39:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:53 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:53 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:39:53.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:53 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:53 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:39:53.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:53 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:53 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:39:53.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:53 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.928 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:53 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:39:53.929 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:53 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.929 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:53 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:39:53.929 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:53 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:39:53.956 INFO:tasks.cephfs.filesystem:scrub status for tag:9ca14f81-6c0b-49ab-b3ca-445b25a75aea - {'path': '/', 'tag': '9ca14f81-6c0b-49ab-b3ca-445b25a75aea', 'options': 'recursive,force'} 2024-09-21T03:39:54.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:54 smithi148 ceph-mon[34651]: pgmap v514: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:54.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:54 smithi121 ceph-mon[34316]: pgmap v514: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:54 smithi102 ceph-mon[31392]: pgmap v514: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:39:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:56 smithi148 ceph-mon[34651]: pgmap v515: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:39:56.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:56 smithi121 ceph-mon[34316]: pgmap v515: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:39:56.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:56 smithi102 ceph-mon[31392]: pgmap v515: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:39:57.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:57 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:39:57.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:57 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:39:57.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:57 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:39:58.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:39:58 smithi148 ceph-mon[34651]: pgmap v516: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:39:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:39:58 smithi121 ceph-mon[34316]: pgmap v516: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:39:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:39:58 smithi102 ceph-mon[31392]: pgmap v516: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:40:00.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:00 smithi102 ceph-mon[31392]: overall HEALTH_OK 2024-09-21T03:40:00.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:00 smithi148 ceph-mon[34651]: overall HEALTH_OK 2024-09-21T03:40:00.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:00 smithi121 ceph-mon[34316]: overall HEALTH_OK 2024-09-21T03:40:01.376 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:01 smithi102 ceph-mon[31392]: pgmap v517: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:01.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:01 smithi148 ceph-mon[34651]: pgmap v517: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:01.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:01 smithi121 ceph-mon[34316]: pgmap v517: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:02.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:02.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:02.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:02.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:02.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:02.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:02.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:40:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:02.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: Unable to set osd_memory_target on smithi102 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:40:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:03 smithi102 ceph-mon[31392]: pgmap v518: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: Unable to set osd_memory_target on smithi102 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:40:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:03 smithi148 ceph-mon[34651]: pgmap v518: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:40:03.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi102 to 176.0M 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: Unable to set osd_memory_target on smithi102 to 184577433: error parsing value: Value '184577433' is below minimum 939524096 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:40:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:03 smithi121 ceph-mon[34316]: pgmap v518: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:40:04.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:04 smithi148 ceph-mon[34651]: pgmap v519: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:04.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:04 smithi121 ceph-mon[34316]: pgmap v519: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:04 smithi102 ceph-mon[31392]: pgmap v519: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:06 smithi148 ceph-mon[34651]: pgmap v520: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:06.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:06 smithi121 ceph-mon[34316]: pgmap v520: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:06.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:06 smithi102 ceph-mon[31392]: pgmap v520: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:40:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:08 smithi148 ceph-mon[34651]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:40:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:08 smithi148 ceph-mon[34651]: pgmap v522: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:08 smithi121 ceph-mon[34316]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:40:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:08 smithi121 ceph-mon[34316]: pgmap v522: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:08 smithi102 ceph-mon[31392]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T03:40:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:08 smithi102 ceph-mon[31392]: pgmap v522: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:10 smithi148 ceph-mon[34651]: pgmap v523: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:10 smithi121 ceph-mon[34316]: pgmap v523: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:10.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:10 smithi102 ceph-mon[31392]: pgmap v523: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:40:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:12 smithi148 ceph-mon[34651]: pgmap v524: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:40:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:12 smithi121 ceph-mon[34316]: pgmap v524: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:40:12.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:12 smithi102 ceph-mon[31392]: pgmap v524: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:40:14.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:14 smithi148 ceph-mon[34651]: pgmap v525: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-09-21T03:40:14.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:14 smithi121 ceph-mon[34316]: pgmap v525: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-09-21T03:40:14.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:14 smithi102 ceph-mon[31392]: pgmap v525: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-09-21T03:40:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:16 smithi148 ceph-mon[34651]: pgmap v526: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:40:16.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:16 smithi121 ceph-mon[34316]: pgmap v526: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:40:16.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:16 smithi102 ceph-mon[31392]: pgmap v526: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:40:18.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:17 smithi102 ceph-mon[31392]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:40:18.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:17 smithi148 ceph-mon[34651]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:40:18.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:17 smithi121 ceph-mon[34316]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T03:40:19.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:18 smithi102 ceph-mon[31392]: pgmap v528: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:19.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:18 smithi148 ceph-mon[34651]: pgmap v528: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:19.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:18 smithi121 ceph-mon[34316]: pgmap v528: 97 pgs: 97 active+clean; 270 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:20.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:20 smithi148 ceph-mon[34651]: pgmap v529: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:20 smithi121 ceph-mon[34316]: pgmap v529: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:20.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:20 smithi102 ceph-mon[31392]: pgmap v529: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:22 smithi148 ceph-mon[34651]: pgmap v530: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:22.755 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:22 smithi102 ceph-mon[31392]: pgmap v530: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:22 smithi121 ceph-mon[34316]: pgmap v530: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:40:23.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:40:24.215 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:24.657 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:24 smithi102 ceph-mon[31392]: pgmap v531: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:24 smithi148 ceph-mon[34651]: pgmap v531: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:24.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 -- 172.21.15.102:0/3540349447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c8104860 msgr2=0x7f01c8104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 --2- 172.21.15.102:0/3540349447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c8104860 0x7f01c8104c70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f01b8009900 tx=0x7f01b802a410 comp rx=0 tx=0).stop 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 -- 172.21.15.102:0/3540349447 shutdown_connections 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 --2- 172.21.15.102:0/3540349447 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c810de10 0x7f01c81102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 --2- 172.21.15.102:0/3540349447 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8105290 0x7f01c810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 --2- 172.21.15.102:0/3540349447 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c8104860 0x7f01c8104c70 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 -- 172.21.15.102:0/3540349447 >> 172.21.15.102:0/3540349447 conn(0x7f01c8079730 msgr2=0x7f01c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 -- 172.21.15.102:0/3540349447 shutdown_connections 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.749+0000 7f01cce42640 1 -- 172.21.15.102:0/3540349447 wait complete. 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 Processor -- start 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 -- start start 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8104860 0x7f01c819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 0x7f01c819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8113bc0 con 0x7f01c810de10 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8113a40 con 0x7f01c8105290 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01cce42640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8113d40 con 0x7f01c8104860 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01c5d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 0x7f01c819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01c6d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44608/0 (socket says 172.21.15.102:44608) 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01c6d9d640 1 -- 172.21.15.102:0/1204784338 learned_addr learned my addr 172.21.15.102:0/1204784338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.750+0000 7f01c659c640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8104860 0x7f01c819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 -- 172.21.15.102:0/1204784338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8104860 msgr2=0x7f01c819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8104860 0x7f01c819a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 -- 172.21.15.102:0/1204784338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 msgr2=0x7f01c819ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 0x7f01c819ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 -- 172.21.15.102:0/1204784338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c81a0520 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 0x7f01c819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01c6d9d640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f01c000eaa0 tx=0x7f01c000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01b77fe640 1 -- 172.21.15.102:0/1204784338 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c000cdb0 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81a0810 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01b77fe640 1 -- 172.21.15.102:0/1204784338 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01c0005020 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01b77fe640 1 -- 172.21.15.102:0/1204784338 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c00116d0 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.751+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81a6f70 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.754+0000 7f01d33b6740 1 Processor -- start 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.755+0000 7f01b77fe640 1 -- 172.21.15.102:0/1204784338 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f01c00051d0 con 0x7f01c810de10 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.755+0000 7f01d33b6740 1 -- start start 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5563c8653e50 con 0x5563c8336070 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563c8643280 con 0x5563c830d1b0 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01d33b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563c8647090 con 0x5563c8315390 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44624/0 (socket says 172.21.15.102:44624) 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 -- 172.21.15.102:0/3871067794 learned_addr learned my addr 172.21.15.102:0/3871067794 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c659c640 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01b77fe640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 0x7f01b00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 -- 172.21.15.102:0/3871067794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 msgr2=0x5563c86ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 -- 172.21.15.102:0/3871067794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 msgr2=0x5563c86dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 -- 172.21.15.102:0/3871067794 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c83a1650 con 0x5563c8336070 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c6d9d640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 0x7f01b00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01b77fe640 1 -- 172.21.15.102:0/1204784338 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f01c00e78c0 con 0x7f01c810de10 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.756+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f01bc012b60 tx=0x7f01bc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b1435a86b56f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.757+0000 7f01b4ff9640 1 -- 172.21.15.102:0/3871067794 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc0120d0 con 0x5563c8336070 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.757+0000 7f01b4ff9640 1 -- 172.21.15.102:0/3871067794 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01bc00ebe0 con 0x5563c8336070 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.757+0000 7f01b4ff9640 1 -- 172.21.15.102:0/3871067794 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc005440 con 0x5563c8336070 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- 172.21.15.102:0/3871067794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 msgr2=0x5563c86dd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01c6d9d640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 0x7f01b00b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f01c00e5080 tx=0x7f01c00054c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f01bc012b60 tx=0x7f01bc00bf90 comp rx=0 tx=0).stop 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- 172.21.15.102:0/3871067794 shutdown_connections 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3871067794 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8336070 0x5563c86dd270 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- 172.21.15.102:0/3871067794 >> 172.21.15.102:0/3871067794 conn(0x5563c832a460 msgr2=0x5563c86db160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- 172.21.15.102:0/3871067794 shutdown_connections 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- 172.21.15.102:0/3871067794 wait complete. 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 -- start start 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.758+0000 7f01d33b6740 1 Processor -- start 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86e8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8336070 0x5563c86e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5563c84a4700 con 0x5563c8315390 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5563c85de110 con 0x5563c830d1b0 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5563c86eb9f0 con 0x5563c8336070 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01d33b6740 10 client.0 _ll_register_callbacks cb 0x5563c85f7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44632/0 (socket says 172.21.15.102:44632) 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 -- 172.21.15.102:0/3606363653 learned_addr learned my addr 172.21.15.102:0/3606363653 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8336070 0x5563c86e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 -- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8336070 msgr2=0x5563c86e92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8336070 0x5563c86e92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 -- 172.21.15.102:0/3606363653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 msgr2=0x5563c86e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86e8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 -- 172.21.15.102:0/3606363653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c860bc40 con 0x5563c8315390 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01c659c640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f01b802a930 tx=0x7f01b8031f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ba9131003cd2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.759+0000 7f01adffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8035040 con 0x5563c8315390 2024-09-21T03:40:24.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f01b8004250 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01bc00ebe0 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f01b8004450 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 10 client.16629 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5563c86f75f0 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01bc00ebe0 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f01b8004c00 con 0x5563c8315390 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 10 client.16629 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 20 client.16629 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82f49f0 0x5563c86fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 4 client.16629 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.760+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563c8655da0 con 0x5563c82f49f0 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.761+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82f49f0 0x5563c86fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.761+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82f49f0 0x5563c86fab20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be43cb1fb0a585e server_cookie=430ee69b825186d5 in_seq=0 out_seq=0 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.761+0000 7f01adffb640 10 client.16629 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01adffb640 1 -- 172.21.15.102:0/3606363653 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563c8655da0 con 0x5563c82f49f0 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01adffb640 10 client.16629 handle_command_reply: tid=0 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 client.16629 shutdown 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 msgr2=0x5563c86e8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f01b802a930 tx=0x7f01b8031f40 comp rx=0 tx=0).stop 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 shutdown_connections 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82f49f0 0x5563c86fab20 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86e8db0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8336070 0x5563c86e92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3606363653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c830d1b0 0x5563c86e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01adffb640 0 client.16629 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:24.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 >> 172.21.15.102:0/3606363653 conn(0x5563c832a460 msgr2=0x5563c86e0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 shutdown_connections 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 1 -- 172.21.15.102:0/3606363653 wait complete. 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.762+0000 7f01d33b6740 20 client.16629 trim_cache size 0 max 16384 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.779+0000 7f01d33b6740 1 Processor -- start 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.779+0000 7f01d33b6740 1 -- start start 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81b21a0 con 0x5563c830d1b0 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81afa70 con 0x5563c8336070 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01d33b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81ad8e0 con 0x5563c8315390 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44642/0 (socket says 172.21.15.102:44642) 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 -- 172.21.15.102:0/1381781554 learned_addr learned my addr 172.21.15.102:0/1381781554 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:24.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c659c640 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 -- 172.21.15.102:0/1381781554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 msgr2=0x5563c86e5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86e5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 -- 172.21.15.102:0/1381781554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 msgr2=0x5563c86e5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 -- 172.21.15.102:0/1381781554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563c86de070 con 0x5563c830d1b0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0122e0 tx=0x7f01bc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c4b7b1f2dd3c8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01affff640 1 -- 172.21.15.102:0/1381781554 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00ebb0 con 0x5563c830d1b0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01affff640 1 -- 172.21.15.102:0/1381781554 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01bc02f070 con 0x5563c830d1b0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.780+0000 7f01affff640 1 -- 172.21.15.102:0/1381781554 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc004a80 con 0x5563c830d1b0 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 -- 172.21.15.102:0/1381781554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 msgr2=0x5563c86ea4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0122e0 tx=0x7f01bc00bf90 comp rx=0 tx=0).stop 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 -- 172.21.15.102:0/1381781554 shutdown_connections 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86e5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c8315390 0x5563c86e5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 --2- 172.21.15.102:0/1381781554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c830d1b0 0x5563c86ea4a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 -- 172.21.15.102:0/1381781554 >> 172.21.15.102:0/1381781554 conn(0x5563c832a460 msgr2=0x5563c86e9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 -- 172.21.15.102:0/1381781554 shutdown_connections 2024-09-21T03:40:24.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.781+0000 7f01d33b6740 1 -- 172.21.15.102:0/1381781554 wait complete. 2024-09-21T03:40:24.795 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:24 smithi121 ceph-mon[34316]: pgmap v531: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:24.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 -- start start 2024-09-21T03:40:24.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 Processor -- start 2024-09-21T03:40:24.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 0x5563c86ecb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81adf30 con 0x5563c8315390 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81af3a0 con 0x5563c8336070 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81ae600 con 0x5563c830d1b0 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01d33b6740 10 client.0 _ll_register_callbacks cb 0x7f01b8005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01c659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44656/0 (socket says 172.21.15.102:44656) 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.782+0000 7f01c659c640 1 -- 172.21.15.102:0/3821858982 learned_addr learned my addr 172.21.15.102:0/3821858982 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 0x5563c86ecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 -- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 msgr2=0x5563c86ecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 0x5563c86ecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 -- 172.21.15.102:0/3821858982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 msgr2=0x5563c86ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:24.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 -- 172.21.15.102:0/3821858982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563c87644e0 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 0x5563c86ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01c659c640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006010 tx=0x7f01b8004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4711e810b52a129 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01adffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8035070 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f01b8003e50 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01bc02f070 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f01b8031b40 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01d33b6740 10 client.16635 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.783+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5563c87656b0 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f01bc02f070 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f01b805d450 con 0x5563c8315390 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 10 client.16635 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:24.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 20 client.16635 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82c9da0 0x5563c8767e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 4 client.16635 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5563c8651850 con 0x5563c82c9da0 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.784+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82c9da0 0x5563c8767e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01adffb640 10 client.16635 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01c5d9b640 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82c9da0 0x5563c8767e00 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef380bad5430f02b server_cookie=f7d5344bbd67d252 in_seq=0 out_seq=0 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01adffb640 1 -- 172.21.15.102:0/3821858982 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x5563c8651850 con 0x5563c82c9da0 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01adffb640 10 client.16635 handle_command_reply: tid=0 2024-09-21T03:40:24.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 client.16635 shutdown 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 msgr2=0x5563c86ed0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006010 tx=0x7f01b8004a30 comp rx=0 tx=0).stop 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 shutdown_connections 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5563c82c9da0 0x5563c8767e00 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5563c8315390 0x5563c86ed0a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01adffb640 0 client.16635 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5563c8336070 0x5563c86ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 --2- 172.21.15.102:0/3821858982 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5563c830d1b0 0x5563c86ecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 >> 172.21.15.102:0/3821858982 conn(0x5563c832a460 msgr2=0x5563c86dea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 shutdown_connections 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 1 -- 172.21.15.102:0/3821858982 wait complete. 2024-09-21T03:40:24.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.785+0000 7f01d33b6740 20 client.16635 trim_cache size 0 max 16384 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.804 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.806 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:40:24.809 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 msgr2=0x7f01b00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 0x7f01b00b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f01c00e5080 tx=0x7f01c00054c0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 msgr2=0x7f01c819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f01c000eaa0 tx=0x7f01c000ef60 comp rx=0 tx=0).stop 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 shutdown_connections 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f01b00b6700 0x7f01b00b8c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f01c810de10 0x7f01c819fdf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f01c8105290 0x7f01c819ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 --2- 172.21.15.102:0/1204784338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f01c8104860 0x7f01c819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:24.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 >> 172.21.15.102:0/1204784338 conn(0x7f01c8079730 msgr2=0x7f01c81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:24.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 shutdown_connections 2024-09-21T03:40:24.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:24.786+0000 7f01cce42640 1 -- 172.21.15.102:0/1204784338 wait complete. 2024-09-21T03:40:25.628 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:40:25.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:40:25.880 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:26.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 -- 172.21.15.102:0/532616621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 msgr2=0x7fa988103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 --2- 172.21.15.102:0/532616621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa988103f70 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa984009900 tx=0x7fa98402a410 comp rx=0 tx=0).stop 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 -- 172.21.15.102:0/532616621 shutdown_connections 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 --2- 172.21.15.102:0/532616621 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa988110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 --2- 172.21.15.102:0/532616621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa9881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 --2- 172.21.15.102:0/532616621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa988103f70 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 -- 172.21.15.102:0/532616621 >> 172.21.15.102:0/532616621 conn(0x7fa98807b850 msgr2=0x7fa98807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 -- 172.21.15.102:0/532616621 shutdown_connections 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.365+0000 7fa990343640 1 -- 172.21.15.102:0/532616621 wait complete. 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 Processor -- start 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 -- start start 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa98819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:26.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa98819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa988113bf0 con 0x7fa988103b60 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa988113a70 con 0x7fa9881094a0 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa990343640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa988113d70 con 0x7fa988109df0 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa98e0df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa98e0df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44678/0 (socket says 172.21.15.102:44678) 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.366+0000 7fa98e0df640 1 -- 172.21.15.102:0/2160205904 learned_addr learned my addr 172.21.15.102:0/2160205904 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e8e0640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa98819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98d8de640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa98819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 -- 172.21.15.102:0/2160205904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 msgr2=0x7fa98819fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa98819fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 -- 172.21.15.102:0/2160205904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 msgr2=0x7fa98819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa98819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 -- 172.21.15.102:0/2160205904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9881a0570 con 0x7fa988103b60 2024-09-21T03:40:26.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98d8de640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa98819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e8e0640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa98819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa98e0df640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa984005ab0 tx=0x7fa9840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98403f030 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa984003cd0 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9881a0800 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984035070 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.367+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9881a6fc0 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.368+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa988104de0 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.369+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa984042030 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.370+0000 7fa97f7fe640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 0x7fa9740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.370+0000 7fa98d8de640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 0x7fa9740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.370+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa984108320 con 0x7fa988103b60 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.371+0000 7fa98d8de640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 0x7fa9740b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa988106460 tx=0x7fa978005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:26.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.374+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9840ce830 con 0x7fa988103b60 2024-09-21T03:40:26.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.594+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa988103f70 con 0x7fa988103b60 2024-09-21T03:40:26.597 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:26 smithi102 ceph-mon[31392]: pgmap v532: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:26.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.595+0000 7fa97f7fe640 1 -- 172.21.15.102:0/2160205904 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7fa9840d2c10 con 0x7fa988103b60 2024-09-21T03:40:26.598 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:40:26.598 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:40:26.598 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 msgr2=0x7fa9740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 0x7fa9740b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa988106460 tx=0x7fa978005d30 comp rx=0 tx=0).stop 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 msgr2=0x7fa98819a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa984005ab0 tx=0x7fa9840042f0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 shutdown_connections 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa9740b6680 0x7fa9740b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa988109df0 0x7fa98819fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa9881094a0 0x7fa98819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 --2- 172.21.15.102:0/2160205904 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa988103b60 0x7fa98819a600 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:26.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 >> 172.21.15.102:0/2160205904 conn(0x7fa98807b850 msgr2=0x7fa9881074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:26.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 shutdown_connections 2024-09-21T03:40:26.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:26.598+0000 7fa990343640 1 -- 172.21.15.102:0/2160205904 wait complete. 2024-09-21T03:40:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:26 smithi148 ceph-mon[34651]: pgmap v532: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:26.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:26 smithi121 ceph-mon[34316]: pgmap v532: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s 2024-09-21T03:40:27.302 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:40:27.551 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:27.670 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:27 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2160205904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:27 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2160205904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:27 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2160205904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:40:28.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 -- 172.21.15.102:0/810476161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 msgr2=0x7fbf2c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 --2- 172.21.15.102:0/810476161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c103f70 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c009ca0 tx=0x7fbf1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 -- 172.21.15.102:0/810476161 shutdown_connections 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 --2- 172.21.15.102:0/810476161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c109df0 0x7fbf2c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 --2- 172.21.15.102:0/810476161 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 --2- 172.21.15.102:0/810476161 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c103f70 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 -- 172.21.15.102:0/810476161 >> 172.21.15.102:0/810476161 conn(0x7fbf2c07b850 msgr2=0x7fbf2c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 -- 172.21.15.102:0/810476161 shutdown_connections 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.067+0000 7fbf33a14640 1 -- 172.21.15.102:0/810476161 wait complete. 2024-09-21T03:40:28.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 Processor -- start 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 -- start start 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c109df0 0x7fbf2c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c113bf0 con 0x7fbf2c103b60 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c113a70 con 0x7fbf2c1094a0 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf33a14640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c113d70 con 0x7fbf2c109df0 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.068+0000 7fbf317b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44702/0 (socket says 172.21.15.102:44702) 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 -- 172.21.15.102:0/397980506 learned_addr learned my addr 172.21.15.102:0/397980506 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c109df0 0x7fbf2c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf30faf640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 -- 172.21.15.102:0/397980506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c109df0 msgr2=0x7fbf2c19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c109df0 0x7fbf2c19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 -- 172.21.15.102:0/397980506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 msgr2=0x7fbf2c19ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c19ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 -- 172.21.15.102:0/397980506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2c1a0550 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf30faf640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf317b0640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c02ade0 tx=0x7fbf1c003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf2a7fc640 1 -- 172.21.15.102:0/397980506 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c031890 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf2c1a07e0 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf2a7fc640 1 -- 172.21.15.102:0/397980506 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf1c004510 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf2a7fc640 1 -- 172.21.15.102:0/397980506 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c02fda0 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.069+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf2c1a6fa0 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.072+0000 7fbf39f88740 1 Processor -- start 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.072+0000 7fbf2a7fc640 1 -- 172.21.15.102:0/397980506 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fbf1c0046c0 con 0x7fbf2c103b60 2024-09-21T03:40:28.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.072+0000 7fbf39f88740 1 -- start start 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.072+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56b51b0 0x5576c5a85800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a85d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf39f88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5576c59fbea0 con 0x5576c56de070 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf39f88740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576c59eb2d0 con 0x5576c56b51b0 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf39f88740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576c59ef0e0 con 0x5576c56bd390 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44712/0 (socket says 172.21.15.102:44712) 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2674401568 learned_addr learned my addr 172.21.15.102:0/2674401568 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf30faf640 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a85d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf317b0640 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56b51b0 0x5576c5a85800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2674401568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 msgr2=0x5576c5a85d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a85d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2674401568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56b51b0 msgr2=0x5576c5a85800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56b51b0 0x5576c5a85800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2674401568 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c5749650 con 0x5576c56de070 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf2a7fc640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 0x7fbf140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400cb40 tx=0x7fbf2400e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f25400790c47a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf317b0640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 0x7fbf140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.073+0000 7fbf137fe640 1 -- 172.21.15.102:0/2674401568 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24004020 con 0x5576c56de070 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf137fe640 1 -- 172.21.15.102:0/2674401568 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf240041c0 con 0x5576c56de070 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf137fe640 1 -- 172.21.15.102:0/2674401568 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24010650 con 0x5576c56de070 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf2a7fc640 1 -- 172.21.15.102:0/397980506 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fbf1c108d60 con 0x7fbf2c103b60 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf39f88740 1 -- 172.21.15.102:0/2674401568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 msgr2=0x5576c5a852c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf317b0640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 0x7fbf140b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c106520 tx=0x7fbf1c093040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.074+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbf2400cb40 tx=0x7fbf2400e350 comp rx=0 tx=0).stop 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- 172.21.15.102:0/2674401568 shutdown_connections 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a85d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56b51b0 0x5576c5a85800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2674401568 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a852c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- 172.21.15.102:0/2674401568 >> 172.21.15.102:0/2674401568 conn(0x5576c56d2460 msgr2=0x5576c5a831b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- 172.21.15.102:0/2674401568 shutdown_connections 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- 172.21.15.102:0/2674401568 wait complete. 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- start start 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 Processor -- start 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a95280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5a95800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5576c584c700 con 0x5576c56b51b0 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.075+0000 7fbf39f88740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576c5986160 con 0x5576c56de070 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf39f88740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576c5a97e00 con 0x5576c56bd390 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf39f88740 10 client.0 _ll_register_callbacks cb 0x5576c599f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44726/0 (socket says 172.21.15.102:44726) 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 -- 172.21.15.102:0/1407444264 learned_addr learned my addr 172.21.15.102:0/1407444264 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf30faf640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a95280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 -- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 msgr2=0x5576c5a95280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a95280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 -- 172.21.15.102:0/1407444264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 msgr2=0x5576c5a95800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5a95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 -- 172.21.15.102:0/1407444264 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c59b3c90 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006010 tx=0x7fbf2400c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35c136eb692d461 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24005040 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fbf240051e0 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf240041c0 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbf240053e0 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf39f88740 10 client.16653 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.076+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5576c5aa3b10 con 0x5576c56b51b0 2024-09-21T03:40:28.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf240041c0 con 0x5576c56b51b0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fbf2402d020 con 0x5576c56b51b0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 10 client.16653 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 10 client.16653 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 20 client.16653 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c569c9f0 0x5576c5aa6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 4 client.16653 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576c59fddf0 con 0x5576c569c9f0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.077+0000 7fbf30faf640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c569c9f0 0x5576c5aa6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf30faf640 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c569c9f0 0x5576c5aa6f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce5c88750099c8d server_cookie=51c881c23e5d6436 in_seq=0 out_seq=0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf10ff9640 10 client.16653 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf10ff9640 1 -- 172.21.15.102:0/1407444264 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576c59fddf0 con 0x5576c569c9f0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf10ff9640 10 client.16653 handle_command_reply: tid=0 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf39f88740 1 client.16653 shutdown 2024-09-21T03:40:28.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 msgr2=0x5576c5a94d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbf24006010 tx=0x7fbf2400c650 comp rx=0 tx=0).stop 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.078+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 shutdown_connections 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c569c9f0 0x5576c5aa6f20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5a95800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5a95280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf10ff9640 0 client.16653 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 --2- 172.21.15.102:0/1407444264 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5a94d40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 >> 172.21.15.102:0/1407444264 conn(0x5576c56d2460 msgr2=0x5576c5a86cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 shutdown_connections 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 1 -- 172.21.15.102:0/1407444264 wait complete. 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.079+0000 7fbf39f88740 20 client.16653 trim_cache size 0 max 16384 2024-09-21T03:40:28.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.092+0000 7fbf39f88740 1 Processor -- start 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.092+0000 7fbf39f88740 1 -- start start 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56b51b0 0x5576c5a96970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56bd390 0x5576c5a91f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1b0090 con 0x5576c56de070 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1ad960 con 0x5576c56bd390 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf39f88740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1ab7d0 con 0x5576c56b51b0 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44742/0 (socket says 172.21.15.102:44742) 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 -- 172.21.15.102:0/3754665172 learned_addr learned my addr 172.21.15.102:0/3754665172 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf30faf640 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56bd390 0x5576c5a91f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 -- 172.21.15.102:0/3754665172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56b51b0 msgr2=0x5576c5a96970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56b51b0 0x5576c5a96970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 -- 172.21.15.102:0/3754665172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56bd390 msgr2=0x5576c5a91f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56bd390 0x5576c5a91f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 -- 172.21.15.102:0/3754665172 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576c5a7de90 con 0x5576c56de070 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbf24027630 tx=0x7fbf2400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a7164ed8bd8f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.093+0000 7fbf12ffd640 1 -- 172.21.15.102:0/3754665172 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240040c0 con 0x5576c56de070 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf12ffd640 1 -- 172.21.15.102:0/3754665172 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf24022070 con 0x5576c56de070 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf12ffd640 1 -- 172.21.15.102:0/3754665172 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf240048e0 con 0x5576c56de070 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 -- 172.21.15.102:0/3754665172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 msgr2=0x5576c5a92470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbf24027630 tx=0x7fbf2400c890 comp rx=0 tx=0).stop 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 -- 172.21.15.102:0/3754665172 shutdown_connections 2024-09-21T03:40:28.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56de070 0x5576c5a92470 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56bd390 0x5576c5a91f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 --2- 172.21.15.102:0/3754665172 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56b51b0 0x5576c5a96970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 -- 172.21.15.102:0/3754665172 >> 172.21.15.102:0/3754665172 conn(0x5576c56d2460 msgr2=0x5576c5a96260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 -- 172.21.15.102:0/3754665172 shutdown_connections 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.094+0000 7fbf39f88740 1 -- 172.21.15.102:0/3754665172 wait complete. 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 -- start start 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 Processor -- start 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5b05bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5b106b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1abe20 con 0x5576c56b51b0 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1ad290 con 0x5576c56de070 2024-09-21T03:40:28.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fbf2c1ac4f0 con 0x5576c56bd390 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf39f88740 10 client.0 _ll_register_callbacks cb 0x7fbf24014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf31fb1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44754/0 (socket says 172.21.15.102:44754) 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.095+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2149864270 learned_addr learned my addr 172.21.15.102:0/2149864270 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf30faf640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5b05bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 msgr2=0x5576c5b05bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5b05bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2149864270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 msgr2=0x5576c5b106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5b106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 -- 172.21.15.102:0/2149864270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576c5b10bf0 con 0x5576c56b51b0 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf30faf640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5b05bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:28.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf31fb1640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005e90 tx=0x7fbf240042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682c09c5a5bc96b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24003b70 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fbf24003d10 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf24022070 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbf24004680 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf39f88740 10 client.16659 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5576c5b11d80 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.096+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fbf24022070 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fbf24037020 con 0x5576c56b51b0 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 10 client.16659 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 10 client.16659 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 20 client.16659 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:28.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c5671da0 0x5576c5b14430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 4 client.16659 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5576c59f98a0 con 0x5576c5671da0 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf30faf640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c5671da0 0x5576c5b14430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf30faf640 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c5671da0 0x5576c5b14430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74793399b072783c server_cookie=1f60a1f584d014f3 in_seq=0 out_seq=0 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.097+0000 7fbf10ff9640 10 client.16659 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf10ff9640 1 -- 172.21.15.102:0/2149864270 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5576c59f98a0 con 0x5576c5671da0 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf10ff9640 10 client.16659 handle_command_reply: tid=0 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 client.16659 shutdown 2024-09-21T03:40:28.118 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 msgr2=0x5576c5b05630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fbf24005e90 tx=0x7fbf240042f0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 shutdown_connections 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5576c5671da0 0x5576c5b14430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576c56de070 0x5576c5b106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf10ff9640 0 client.16659 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576c56bd390 0x5576c5b05bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 --2- 172.21.15.102:0/2149864270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576c56b51b0 0x5576c5b05630 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 >> 172.21.15.102:0/2149864270 conn(0x5576c56d2460 msgr2=0x5576c5aa0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 shutdown_connections 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 1 -- 172.21.15.102:0/2149864270 wait complete. 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf39f88740 20 client.16659 trim_cache size 0 max 16384 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 msgr2=0x7fbf140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 0x7fbf140b8b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c106520 tx=0x7fbf1c093040 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 msgr2=0x7fbf2c19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c02ade0 tx=0x7fbf1c003f80 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 shutdown_connections 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.098+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fbf140b6680 0x7fbf140b8b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fbf2c109df0 0x7fbf2c19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbf2c1094a0 0x7fbf2c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 --2- 172.21.15.102:0/397980506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbf2c103b60 0x7fbf2c19a5e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:28.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 >> 172.21.15.102:0/397980506 conn(0x7fbf2c07b850 msgr2=0x7fbf2c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:28.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 shutdown_connections 2024-09-21T03:40:28.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:28.099+0000 7fbf33a14640 1 -- 172.21.15.102:0/397980506 wait complete. 2024-09-21T03:40:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:28 smithi148 ceph-mon[34651]: pgmap v533: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:28.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:28 smithi121 ceph-mon[34316]: pgmap v533: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:28.791 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:28 smithi102 ceph-mon[31392]: pgmap v533: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:28.821 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:40:29.067 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.591+0000 7f421c3a9640 1 -- 172.21.15.102:0/1126267684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109eb0 msgr2=0x7f42141106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.591+0000 7f421c3a9640 1 --2- 172.21.15.102:0/1126267684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109eb0 0x7f42141106e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f420c009ca0 tx=0x7f420c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 -- 172.21.15.102:0/1126267684 shutdown_connections 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 --2- 172.21.15.102:0/1126267684 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109eb0 0x7f42141106e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 --2- 172.21.15.102:0/1126267684 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214109560 0x7f4214109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 --2- 172.21.15.102:0/1126267684 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214102080 0x7f4214102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 -- 172.21.15.102:0/1126267684 >> 172.21.15.102:0/1126267684 conn(0x7f4214079ec0 msgr2=0x7f421407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 -- 172.21.15.102:0/1126267684 shutdown_connections 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 -- 172.21.15.102:0/1126267684 wait complete. 2024-09-21T03:40:29.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 Processor -- start 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.592+0000 7f421c3a9640 1 -- start start 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102080 0x7f421419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214109eb0 0x7f421419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4214113cb0 con 0x7f4214109560 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4214113b30 con 0x7f4214109eb0 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421c3a9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4214113e30 con 0x7f4214102080 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44776/0 (socket says 172.21.15.102:44776) 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 -- 172.21.15.102:0/3202045328 learned_addr learned my addr 172.21.15.102:0/3202045328 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421a145640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102080 0x7f421419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f421a946640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214109eb0 0x7f421419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 -- 172.21.15.102:0/3202045328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102080 msgr2=0x7f421419a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102080 0x7f421419a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 -- 172.21.15.102:0/3202045328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214109eb0 msgr2=0x7f421419fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214109eb0 0x7f421419fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 -- 172.21.15.102:0/3202045328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42141a0590 con 0x7f4214109560 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.593+0000 7f4219944640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f420400d750 tx=0x7f420400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.594+0000 7f420b7fe640 1 -- 172.21.15.102:0/3202045328 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204017070 con 0x7f4214109560 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.594+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42141a0880 con 0x7f4214109560 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.594+0000 7f420b7fe640 1 -- 172.21.15.102:0/3202045328 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f42040054f0 con 0x7f4214109560 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.594+0000 7f420b7fe640 1 -- 172.21.15.102:0/3202045328 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204004d90 con 0x7f4214109560 2024-09-21T03:40:29.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.594+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42141a6fe0 con 0x7f4214109560 2024-09-21T03:40:29.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.596+0000 7f422291d740 1 Processor -- start 2024-09-21T03:40:29.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 -- start start 2024-09-21T03:40:29.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f420b7fe640 1 -- 172.21.15.102:0/3202045328 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f4204004f30 con 0x7f4214109560 2024-09-21T03:40:29.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef192fc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef192fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef192fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ef19272ea0 con 0x55ef18f2c1b0 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ef192622d0 con 0x55ef18f34390 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f422291d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ef192660e0 con 0x55ef18f55070 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef192fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef192fc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44790/0 (socket says 172.21.15.102:44790) 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a145640 1 -- 172.21.15.102:0/3230989435 learned_addr learned my addr 172.21.15.102:0/3230989435 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef192fc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f4219944640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef192fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 -- 172.21.15.102:0/3230989435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 msgr2=0x55ef192fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef192fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 -- 172.21.15.102:0/3230989435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 msgr2=0x55ef192fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef192fc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f421a946640 1 -- 172.21.15.102:0/3230989435 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef18fc0650 con 0x55ef18f55070 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.597+0000 7f4219944640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef192fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f420b7fe640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 0x7f42000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f421a946640 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef192fc2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f420c005e30 tx=0x7f420c0098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14fd4069a956072 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f421a145640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 0x7f42000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f420b7fe640 1 -- 172.21.15.102:0/3202045328 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f42040e7080 con 0x7f4214109560 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f4208d9a640 1 -- 172.21.15.102:0/3230989435 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c031e00 con 0x55ef18f55070 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f4208d9a640 1 -- 172.21.15.102:0/3230989435 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c036030 con 0x55ef18f55070 2024-09-21T03:40:29.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.598+0000 7f4208d9a640 1 -- 172.21.15.102:0/3230989435 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c0042a0 con 0x55ef18f55070 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- 172.21.15.102:0/3230989435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 msgr2=0x55ef192fc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef192fc2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f420c005e30 tx=0x7f420c0098b0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f421a145640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 0x7f42000b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55ef192faf40 tx=0x7f421000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- 172.21.15.102:0/3230989435 shutdown_connections 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef192fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef192fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 --2- 172.21.15.102:0/3230989435 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef192fc2c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- 172.21.15.102:0/3230989435 >> 172.21.15.102:0/3230989435 conn(0x55ef18f49460 msgr2=0x55ef192fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- 172.21.15.102:0/3230989435 shutdown_connections 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- 172.21.15.102:0/3230989435 wait complete. 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.599+0000 7f422291d740 1 -- start start 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 Processor -- start 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef19317f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ef190c3700 con 0x55ef18f34390 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ef191fd160 con 0x55ef18f2c1b0 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ef1930ec20 con 0x55ef18f55070 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44794/0 (socket says 172.21.15.102:44794) 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 -- 172.21.15.102:0/3715715422 learned_addr learned my addr 172.21.15.102:0/3715715422 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:29.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f422291d740 10 client.0 _ll_register_callbacks cb 0x55ef192169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f421a946640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef19317f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f421a145640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 -- 172.21.15.102:0/3715715422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 msgr2=0x55ef19317f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef19317f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 -- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 msgr2=0x55ef1930bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.600+0000 7f4219944640 1 -- 172.21.15.102:0/3715715422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef1922ac90 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f4219944640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4204009610 tx=0x7f42040ea9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6064af5962d6e5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4204020070 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f42040a91b0 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420c036030 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f42040ac890 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 10 client.16671 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ef1931a990 con 0x55ef18f34390 2024-09-21T03:40:29.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c036030 con 0x55ef18f34390 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f42040940f0 con 0x55ef18f34390 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 10 client.16671 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 10 client.16671 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 20 client.16671 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18f139f0 0x55ef1931deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 4 client.16671 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.601+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef19274df0 con 0x55ef18f139f0 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.602+0000 7f421a145640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18f139f0 0x55ef1931deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.602+0000 7f41fdffb640 10 client.16671 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.602+0000 7f421a145640 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18f139f0 0x55ef1931deb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3289ea8b2f16ee1 server_cookie=bfbef978a6dfd9da in_seq=0 out_seq=0 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f41fdffb640 1 -- 172.21.15.102:0/3715715422 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ef19274df0 con 0x55ef18f139f0 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f41fdffb640 10 client.16671 handle_command_reply: tid=0 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 client.16671 shutdown 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 msgr2=0x55ef1930c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f4204009610 tx=0x7f42040ea9b0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 shutdown_connections 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18f139f0 0x55ef1931deb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f34390 0x55ef1930c320 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef19317f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 --2- 172.21.15.102:0/3715715422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f41fdffb640 0 client.16671 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 >> 172.21.15.102:0/3715715422 conn(0x55ef18f49460 msgr2=0x55ef192fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 shutdown_connections 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 1 -- 172.21.15.102:0/3715715422 wait complete. 2024-09-21T03:40:29.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.603+0000 7f422291d740 20 client.16671 trim_cache size 0 max 16384 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 Processor -- start 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 -- start start 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f34390 0x55ef19308fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42141afe70 con 0x55ef18f55070 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ad740 con 0x55ef18f2c1b0 2024-09-21T03:40:29.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.616+0000 7f422291d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ab5b0 con 0x55ef18f34390 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44806/0 (socket says 172.21.15.102:44806) 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 -- 172.21.15.102:0/673677033 learned_addr learned my addr 172.21.15.102:0/673677033 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a145640 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f4219944640 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f34390 0x55ef19308fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 -- 172.21.15.102:0/673677033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f34390 msgr2=0x55ef19308fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f34390 0x55ef19308fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 -- 172.21.15.102:0/673677033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 msgr2=0x55ef1930c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 -- 172.21.15.102:0/673677033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef18f13c20 con 0x55ef18f55070 2024-09-21T03:40:29.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f421a946640 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f420c005e30 tx=0x7f420c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53c6db58f9f022e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f41fffff640 1 -- 172.21.15.102:0/673677033 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c054020 con 0x55ef18f55070 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f41fffff640 1 -- 172.21.15.102:0/673677033 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c036040 con 0x55ef18f55070 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.617+0000 7f41fffff640 1 -- 172.21.15.102:0/673677033 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420c04a040 con 0x55ef18f55070 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 -- 172.21.15.102:0/673677033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 msgr2=0x55ef19309510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f420c005e30 tx=0x7f420c009bd0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 -- 172.21.15.102:0/673677033 shutdown_connections 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f55070 0x55ef19309510 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f34390 0x55ef19308fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 --2- 172.21.15.102:0/673677033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f2c1b0 0x55ef1930c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 -- 172.21.15.102:0/673677033 >> 172.21.15.102:0/673677033 conn(0x55ef18f49460 msgr2=0x55ef1930bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 -- 172.21.15.102:0/673677033 shutdown_connections 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.618+0000 7f422291d740 1 -- 172.21.15.102:0/673677033 wait complete. 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 -- start start 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 Processor -- start 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef193104a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef193109e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42141abc00 con 0x55ef18f2c1b0 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ad070 con 0x55ef18f34390 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f42141ac2d0 con 0x55ef18f55070 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f422291d740 10 client.0 _ll_register_callbacks cb 0x7f420400d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44814/0 (socket says 172.21.15.102:44814) 2024-09-21T03:40:29.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 -- 172.21.15.102:0/3117640278 learned_addr learned my addr 172.21.15.102:0/3117640278 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a946640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef193109e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f4219944640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef193104a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 -- 172.21.15.102:0/3117640278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 msgr2=0x55ef193109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef193109e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 -- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 msgr2=0x55ef193104a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef193104a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.619+0000 7f421a145640 1 -- 172.21.15.102:0/3117640278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef19387920 con 0x55ef18f2c1b0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f421a145640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f421000bfd0 tx=0x7f4210004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba80cba9d17cd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421002e040 con 0x55ef18f2c1b0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f4210004020 con 0x55ef18f2c1b0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f420c036040 con 0x55ef18f2c1b0 2024-09-21T03:40:29.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f421003a050 con 0x55ef18f2c1b0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 10 client.16677 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ef19388c30 con 0x55ef18f2c1b0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f420c036040 con 0x55ef18f2c1b0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f421001c540 con 0x55ef18f2c1b0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 10 client.16677 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 10 client.16677 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 20 client.16677 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18ee8da0 0x55ef1938b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 4 client.16677 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.620+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef192708a0 con 0x55ef18ee8da0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f4219944640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18ee8da0 0x55ef1938b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:29.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f41fdffb640 10 client.16677 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f4219944640 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18ee8da0 0x55ef1938b420 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce68742b9da73b49 server_cookie=8dfc1e968e8a3830 in_seq=0 out_seq=0 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f41fdffb640 1 -- 172.21.15.102:0/3117640278 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef192708a0 con 0x55ef18ee8da0 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f41fdffb640 10 client.16677 handle_command_reply: tid=0 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 client.16677 shutdown 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 msgr2=0x55ef1930ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f421000bfd0 tx=0x7f4210004730 comp rx=0 tx=0).stop 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 shutdown_connections 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55ef18ee8da0 0x55ef1938b420 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ef18f55070 0x55ef193109e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ef18f34390 0x55ef193104a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 --2- 172.21.15.102:0/3117640278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ef18f2c1b0 0x55ef1930ff60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 >> 172.21.15.102:0/3117640278 conn(0x55ef18f49460 msgr2=0x55ef1930d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f41fdffb640 0 client.16677 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.621+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 shutdown_connections 2024-09-21T03:40:29.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f422291d740 1 -- 172.21.15.102:0/3117640278 wait complete. 2024-09-21T03:40:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f422291d740 20 client.16677 trim_cache size 0 max 16384 2024-09-21T03:40:29.629 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:40:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 msgr2=0x7f42000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 0x7f42000b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55ef192faf40 tx=0x7f421000b410 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 msgr2=0x7f421419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f420400d750 tx=0x7f420400dc10 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 shutdown_connections 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f42000b6680 0x7f42000b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4214109560 0x7f421419abc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4214109eb0 0x7f421419fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 --2- 172.21.15.102:0/3202045328 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4214102080 0x7f421419a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 >> 172.21.15.102:0/3202045328 conn(0x7f4214079ec0 msgr2=0x7f4214107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 shutdown_connections 2024-09-21T03:40:29.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:29.622+0000 7f421c3a9640 1 -- 172.21.15.102:0/3202045328 wait complete. 2024-09-21T03:40:30.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:40:30.699 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:30.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:30 smithi102 ceph-mon[31392]: pgmap v534: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:30 smithi148 ceph-mon[34651]: pgmap v534: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:30.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:30 smithi121 ceph-mon[34316]: pgmap v534: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 -- 172.21.15.102:0/3427035131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a4105b10 msgr2=0x7fa5a410f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 --2- 172.21.15.102:0/3427035131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a4105b10 0x7fa5a410f580 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009ca0 tx=0x7fa59c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 -- 172.21.15.102:0/3427035131 shutdown_connections 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 --2- 172.21.15.102:0/3427035131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a4105b10 0x7fa5a410f580 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 --2- 172.21.15.102:0/3427035131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41051c0 0x7fa5a41055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 --2- 172.21.15.102:0/3427035131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a41031b0 0x7fa5a41035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 -- 172.21.15.102:0/3427035131 >> 172.21.15.102:0/3427035131 conn(0x7fa5a4079f90 msgr2=0x7fa5a407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 -- 172.21.15.102:0/3427035131 shutdown_connections 2024-09-21T03:40:31.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.204+0000 7fa5abc26640 1 -- 172.21.15.102:0/3427035131 wait complete. 2024-09-21T03:40:31.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 Processor -- start 2024-09-21T03:40:31.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 -- start start 2024-09-21T03:40:31.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 0x7fa5a41994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4105b10 0x7fa5a419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4112b30 con 0x7fa5a41051c0 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41129b0 con 0x7fa5a41031b0 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.205+0000 7fa5abc26640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a4112cb0 con 0x7fa5a4105b10 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44838/0 (socket says 172.21.15.102:44838) 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 -- 172.21.15.102:0/2814345214 learned_addr learned my addr 172.21.15.102:0/2814345214 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 0x7fa5a41994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 -- 172.21.15.102:0/2814345214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4105b10 msgr2=0x7fa5a419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4105b10 0x7fa5a419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 -- 172.21.15.102:0/2814345214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 msgr2=0x7fa5a41994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 0x7fa5a41994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 -- 172.21.15.102:0/2814345214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a419f430 con 0x7fa5a41051c0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 0x7fa5a41994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c970 tx=0x7fa59800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa596ffd640 1 -- 172.21.15.102:0/2814345214 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa598007bb0 con 0x7fa5a41051c0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa596ffd640 1 -- 172.21.15.102:0/2814345214 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa598007d50 con 0x7fa5a41051c0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a419f720 con 0x7fa5a41051c0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa596ffd640 1 -- 172.21.15.102:0/2814345214 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59800f450 con 0x7fa5a41051c0 2024-09-21T03:40:31.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.206+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a41a5e80 con 0x7fa5a41051c0 2024-09-21T03:40:31.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa596ffd640 1 -- 172.21.15.102:0/2814345214 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa5980046c0 con 0x7fa5a41051c0 2024-09-21T03:40:31.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 Processor -- start 2024-09-21T03:40:31.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 -- start start 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47ed070 0x55f0d4b946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4b95120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f0d4b0aea0 con 0x55f0d47c41b0 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f0d4afa2d0 con 0x55f0d47ed070 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.209+0000 7fa5b219a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0d4afe0e0 con 0x55f0d47cc390 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44850/0 (socket says 172.21.15.102:44850) 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 -- 172.21.15.102:0/1862423050 learned_addr learned my addr 172.21.15.102:0/1862423050 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47ed070 0x55f0d4b946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa596ffd640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 0x7fa5900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4b95120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 -- 172.21.15.102:0/1862423050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 msgr2=0x55f0d4b95120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4b95120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 -- 172.21.15.102:0/1862423050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47ed070 msgr2=0x55f0d4b946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47ed070 0x55f0d4b946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 -- 172.21.15.102:0/1862423050 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d4858650 con 0x55f0d47c41b0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4b95120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 0x7fa5900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa596ffd640 1 -- 172.21.15.102:0/2814345214 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa5980e73f0 con 0x7fa5a41051c0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000bd40 tx=0x7fa5a000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa53b02a0f8b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.210+0000 7fa58ffff640 1 -- 172.21.15.102:0/1862423050 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0015070 con 0x55f0d47c41b0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa58ffff640 1 -- 172.21.15.102:0/1862423050 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5a000be30 con 0x55f0d47c41b0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa58ffff640 1 -- 172.21.15.102:0/1862423050 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0011a30 con 0x55f0d47c41b0 2024-09-21T03:40:31.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 -- 172.21.15.102:0/1862423050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 msgr2=0x55f0d4b94be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 0x7fa5900b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009a60 tx=0x7fa59c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000bd40 tx=0x7fa5a000f730 comp rx=0 tx=0).stop 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 -- 172.21.15.102:0/1862423050 shutdown_connections 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47c41b0 0x55f0d4b94be0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4b95120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 --2- 172.21.15.102:0/1862423050 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47ed070 0x55f0d4b946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.211+0000 7fa5b219a740 1 -- 172.21.15.102:0/1862423050 >> 172.21.15.102:0/1862423050 conn(0x55f0d47e1460 msgr2=0x55f0d4b92590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 -- 172.21.15.102:0/1862423050 shutdown_connections 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 -- 172.21.15.102:0/1862423050 wait complete. 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 -- start start 2024-09-21T03:40:31.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 Processor -- start 2024-09-21T03:40:31.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.212+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4ba2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f0d495b700 con 0x55f0d47ed070 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f0d4a95160 con 0x55f0d47cc390 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f0d4ba4fe0 con 0x55f0d47c41b0 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 10 client.0 _ll_register_callbacks cb 0x55f0d4aae9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44862/0 (socket says 172.21.15.102:44862) 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/3155661136 learned_addr learned my addr 172.21.15.102:0/3155661136 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4ba2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 msgr2=0x55f0d4ba1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/3155661136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 msgr2=0x55f0d4ba2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4ba2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/3155661136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d4ac2c90 con 0x55f0d47ed070 2024-09-21T03:40:31.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4ba2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa59c003e20 tx=0x7fa59c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f583b0fd5df60a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa58d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c04e060 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa59c0045c0 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.213+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5a000be30 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa59c0047c0 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 10 client.16689 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f0d4bb0c70 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa5a000be30 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa59c030860 con 0x55f0d47ed070 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 10 client.16689 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:31.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 20 client.16689 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d47ab9f0 0x55f0d4bb41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 4 client.16689 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0d4b0cdf0 con 0x55f0d47ab9f0 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.214+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d47ab9f0 0x55f0d4bb41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.215+0000 7fa58d7fa640 10 client.16689 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.215+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d47ab9f0 0x55f0d4bb41d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43b4af3e07e8adf8 server_cookie=446623cd09d98d04 in_seq=0 out_seq=0 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa58d7fa640 1 -- 172.21.15.102:0/3155661136 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0d4b0cdf0 con 0x55f0d47ab9f0 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa58d7fa640 10 client.16689 handle_command_reply: tid=0 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 client.16689 shutdown 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 msgr2=0x55f0d4bae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa59c003e20 tx=0x7fa59c0095c0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 shutdown_connections 2024-09-21T03:40:31.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d47ab9f0 0x55f0d4bb41d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4bae340 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4ba2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 --2- 172.21.15.102:0/3155661136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa58d7fa640 0 client.16689 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 >> 172.21.15.102:0/3155661136 conn(0x55f0d47e1460 msgr2=0x55f0d4b96090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 shutdown_connections 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 1 -- 172.21.15.102:0/3155661136 wait complete. 2024-09-21T03:40:31.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.216+0000 7fa5b219a740 20 client.16689 trim_cache size 0 max 16384 2024-09-21T03:40:31.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 Processor -- start 2024-09-21T03:40:31.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 -- start start 2024-09-21T03:40:31.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4bae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41b00f0 con 0x55f0d47ed070 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ad9c0 con 0x55f0d47cc390 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5b219a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ab830 con 0x55f0d47c41b0 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44878/0 (socket says 172.21.15.102:44878) 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/201790508 learned_addr learned my addr 172.21.15.102:0/201790508 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.229+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4bae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/201790508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 msgr2=0x55f0d4ba2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/201790508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 msgr2=0x55f0d4bae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4bae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/201790508 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0d4b92e80 con 0x55f0d47ed070 2024-09-21T03:40:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa59c030c50 tx=0x7fa59c005c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2de5225b85099c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa58f7fe640 1 -- 172.21.15.102:0/201790508 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c04e070 con 0x55f0d47ed070 2024-09-21T03:40:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa58f7fe640 1 -- 172.21.15.102:0/201790508 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa59c036040 con 0x55f0d47ed070 2024-09-21T03:40:31.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.230+0000 7fa58f7fe640 1 -- 172.21.15.102:0/201790508 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c02fa80 con 0x55f0d47ed070 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- 172.21.15.102:0/201790508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 msgr2=0x55f0d4b91eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa59c030c50 tx=0x7fa59c005c30 comp rx=0 tx=0).stop 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- 172.21.15.102:0/201790508 shutdown_connections 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4b91eb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47cc390 0x55f0d4bae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 --2- 172.21.15.102:0/201790508 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- 172.21.15.102:0/201790508 >> 172.21.15.102:0/201790508 conn(0x55f0d47e1460 msgr2=0x55f0d4ba1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- 172.21.15.102:0/201790508 shutdown_connections 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- 172.21.15.102:0/201790508 wait complete. 2024-09-21T03:40:31.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 -- start start 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.231+0000 7fa5b219a740 1 Processor -- start 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4ba7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41abe80 con 0x55f0d47ed070 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ad2f0 con 0x55f0d47c41b0 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a41ac550 con 0x55f0d47cc390 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5b219a740 10 client.0 _ll_register_callbacks cb 0x7fa59c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44890/0 (socket says 172.21.15.102:44890) 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/2699786825 learned_addr learned my addr 172.21.15.102:0/2699786825 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4ba7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 msgr2=0x55f0d4ba7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4ba7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/2699786825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 msgr2=0x55f0d4ba6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5aa1c3640 1 -- 172.21.15.102:0/2699786825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0d4c1e1f0 con 0x55f0d47ed070 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5a91c1640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4ba7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.232+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5aa1c3640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031cc0 tx=0x7fa59c0039b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed6bc66cc7c92a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa59c05f060 con 0x55f0d47ed070 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa59c0309d0 con 0x55f0d47ed070 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa59c036040 con 0x55f0d47ed070 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa59c04e070 con 0x55f0d47ed070 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 10 client.16695 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:31.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f0d4c1f470 con 0x55f0d47ed070 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa59c036040 con 0x55f0d47ed070 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa59c0499b0 con 0x55f0d47ed070 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 10 client.16695 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 20 client.16695 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d4780da0 0x55f0d4c21990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 4 client.16695 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.233+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0d4b088a0 con 0x55f0d4780da0 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d4780da0 0x55f0d4c21990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa58d7fa640 10 client.16695 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa5a99c2640 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d4780da0 0x55f0d4c21990 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5a07d0f00901c1 server_cookie=c74b2fb09526776f in_seq=0 out_seq=0 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa58d7fa640 1 -- 172.21.15.102:0/2699786825 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0d4b088a0 con 0x55f0d4780da0 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa58d7fa640 10 client.16695 handle_command_reply: tid=0 2024-09-21T03:40:31.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.234+0000 7fa5b219a740 1 client.16695 shutdown 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 msgr2=0x55f0d4c1db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fa59c031cc0 tx=0x7fa59c0039b0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 shutdown_connections 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f0d4780da0 0x55f0d4c21990 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f0d47ed070 0x55f0d4c1db80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f0d47cc390 0x55f0d4ba7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa58d7fa640 0 client.16695 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 --2- 172.21.15.102:0/2699786825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f0d47c41b0 0x55f0d4ba6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 >> 172.21.15.102:0/2699786825 conn(0x55f0d47e1460 msgr2=0x55f0d4b91e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 shutdown_connections 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 1 -- 172.21.15.102:0/2699786825 wait complete. 2024-09-21T03:40:31.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5b219a740 20 client.16695 trim_cache size 0 max 16384 2024-09-21T03:40:31.243 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 msgr2=0x7fa5900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 0x7fa5900b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009a60 tx=0x7fa59c005fd0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 msgr2=0x7fa5a4199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fa59800c970 tx=0x7fa59800ce30 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.235+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 shutdown_connections 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa5900b6700 0x7fa5900b8c10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa5a41051c0 0x7fa5a4199a60 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa5a4105b10 0x7fa5a419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 --2- 172.21.15.102:0/2814345214 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa5a41031b0 0x7fa5a41994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 >> 172.21.15.102:0/2814345214 conn(0x7fa5a4079f90 msgr2=0x7fa5a4106490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 shutdown_connections 2024-09-21T03:40:31.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:31.236+0000 7fa5abc26640 1 -- 172.21.15.102:0/2814345214 wait complete. 2024-09-21T03:40:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:32 smithi148 ceph-mon[34651]: pgmap v535: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:32 smithi121 ceph-mon[34316]: pgmap v535: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:32.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:32 smithi102 ceph-mon[31392]: pgmap v535: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:32.959 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:40:32.960 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:40:33.216 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:33.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 -- 172.21.15.102:0/1508358807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 msgr2=0x7fd638102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 --2- 172.21.15.102:0/1508358807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd638102e70 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd634009900 tx=0x7fd63402a410 comp rx=0 tx=0).stop 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 -- 172.21.15.102:0/1508358807 shutdown_connections 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 --2- 172.21.15.102:0/1508358807 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 0x7fd63810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 --2- 172.21.15.102:0/1508358807 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 0x7fd6381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 --2- 172.21.15.102:0/1508358807 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd638102e70 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 -- 172.21.15.102:0/1508358807 >> 172.21.15.102:0/1508358807 conn(0x7fd638079760 msgr2=0x7fd638079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 -- 172.21.15.102:0/1508358807 shutdown_connections 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 -- 172.21.15.102:0/1508358807 wait complete. 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.741+0000 7fd640778640 1 Processor -- start 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 -- start start 2024-09-21T03:40:33.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 0x7fd638199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 0x7fd638199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd638112af0 con 0x7fd638102a60 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd638112970 con 0x7fd6381083a0 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd640778640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd638112c70 con 0x7fd638108cf0 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44908/0 (socket says 172.21.15.102:44908) 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 -- 172.21.15.102:0/2800389464 learned_addr learned my addr 172.21.15.102:0/2800389464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63ed15640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 0x7fd638199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63dd13640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 0x7fd638199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 -- 172.21.15.102:0/2800389464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 msgr2=0x7fd638199d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 0x7fd638199d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 -- 172.21.15.102:0/2800389464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 msgr2=0x7fd638199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 0x7fd638199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 -- 172.21.15.102:0/2800389464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6381a8980 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.742+0000 7fd63e514640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd634005ab0 tx=0x7fd6340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.743+0000 7fd62f7fe640 1 -- 172.21.15.102:0/2800389464 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63403f030 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.743+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6381a8c10 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.743+0000 7fd62f7fe640 1 -- 172.21.15.102:0/2800389464 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd634003cd0 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.743+0000 7fd62f7fe640 1 -- 172.21.15.102:0/2800389464 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634035070 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.743+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6381a9140 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.745+0000 7fd646cec740 1 Processor -- start 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.745+0000 7fd62f7fe640 1 -- 172.21.15.102:0/2800389464 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fd634042030 con 0x7fd638102a60 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.745+0000 7fd646cec740 1 -- start start 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 0x55832111c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x55832111ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558321092e60 con 0x558320d75350 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558321082290 con 0x558320d4c490 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd646cec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5583210860a0 con 0x558320d54670 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44910/0 (socket says 172.21.15.102:44910) 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 -- 172.21.15.102:0/3687675363 learned_addr learned my addr 172.21.15.102:0/3687675363 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63e514640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 0x55832111c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd62f7fe640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 0x7fd6240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63dd13640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x55832111ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 -- 172.21.15.102:0/3687675363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 msgr2=0x55832111ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x55832111ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 -- 172.21.15.102:0/3687675363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 msgr2=0x55832111c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 0x55832111c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 -- 172.21.15.102:0/3687675363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558320de0930 con 0x558320d75350 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63e514640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 0x55832111c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd62f7fe640 1 -- 172.21.15.102:0/2800389464 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fd634107f00 con 0x7fd638102a60 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.746+0000 7fd63ed15640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 0x7fd6240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.747+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd630011590 tx=0x7fd630011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e727718c0094da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.747+0000 7fd62cff9640 1 -- 172.21.15.102:0/3687675363 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630017050 con 0x558320d75350 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.747+0000 7fd62cff9640 1 -- 172.21.15.102:0/3687675363 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd63001bb90 con 0x558320d75350 2024-09-21T03:40:33.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.747+0000 7fd62cff9640 1 -- 172.21.15.102:0/3687675363 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63000e3b0 con 0x558320d75350 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- 172.21.15.102:0/3687675363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 msgr2=0x55832111c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd630011590 tx=0x7fd630011a50 comp rx=0 tx=0).stop 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd63ed15640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 0x7fd6240b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd630022000 tx=0x7fd630023000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- 172.21.15.102:0/3687675363 shutdown_connections 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x55832111ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d4c490 0x55832111c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 --2- 172.21.15.102:0/3687675363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x55832111c430 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- 172.21.15.102:0/3687675363 >> 172.21.15.102:0/3687675363 conn(0x558320d69740 msgr2=0x55832111a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- 172.21.15.102:0/3687675363 shutdown_connections 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- 172.21.15.102:0/3687675363 wait complete. 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.748+0000 7fd646cec740 1 -- start start 2024-09-21T03:40:33.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 Processor -- start 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x558321128610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x558321133f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558320ee3890 con 0x558320d4c490 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55832101cd40 con 0x558320d75350 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55832112ac10 con 0x558320d54670 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44916/0 (socket says 172.21.15.102:44916) 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd646cec740 10 client.0 _ll_register_callbacks cb 0x558321080c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 -- 172.21.15.102:0/2490408851 learned_addr learned my addr 172.21.15.102:0/2490408851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63ed15640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x558321133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63dd13640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x558321128610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 -- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 msgr2=0x558321128610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x558321128610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 -- 172.21.15.102:0/2490408851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 msgr2=0x558321133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x558321133f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.749+0000 7fd63e514640 1 -- 172.21.15.102:0/2490408851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558321134510 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd63e514640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd6340cdac0 tx=0x7fd634005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fc77e43a580cd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634049070 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fd63403bc60 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd63001bb90 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd6340cd710 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 10 client.16707 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558321136e40 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd63001bb90 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd6340d72a0 con 0x558320d4c490 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 10 client.16707 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:33.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 10 client.16707 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 20 client.16707 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d33cd0 0x55832113a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 4 client.16707 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.750+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558321094db0 con 0x558320d33cd0 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.751+0000 7fd63dd13640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d33cd0 0x55832113a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.751+0000 7fd621ffb640 10 client.16707 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.751+0000 7fd63dd13640 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d33cd0 0x55832113a1f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1352b2afe7580c59 server_cookie=f533d27ce5b49cc9 in_seq=0 out_seq=0 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd621ffb640 1 -- 172.21.15.102:0/2490408851 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558321094db0 con 0x558320d33cd0 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd621ffb640 10 client.16707 handle_command_reply: tid=0 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 client.16707 shutdown 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 msgr2=0x558321128090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd6340cdac0 tx=0x7fd634005e60 comp rx=0 tx=0).stop 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 shutdown_connections 2024-09-21T03:40:33.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x558321133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d54670 0x558321128610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d33cd0 0x55832113a1f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 --2- 172.21.15.102:0/2490408851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d4c490 0x558321128090 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 >> 172.21.15.102:0/2490408851 conn(0x558320d69740 msgr2=0x55832111f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd621ffb640 0 client.16707 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 shutdown_connections 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 1 -- 172.21.15.102:0/2490408851 wait complete. 2024-09-21T03:40:33.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.752+0000 7fd646cec740 20 client.16707 trim_cache size 0 max 16384 2024-09-21T03:40:33.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.769+0000 7fd646cec740 1 Processor -- start 2024-09-21T03:40:33.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.769+0000 7fd646cec740 1 -- start start 2024-09-21T03:40:33.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x558321121c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 0x558321133e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381b44f0 con 0x558320d75350 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381b1dc0 con 0x558320d54670 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd646cec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381afc30 con 0x558320d4c490 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44922/0 (socket says 172.21.15.102:44922) 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 -- 172.21.15.102:0/3653222478 learned_addr learned my addr 172.21.15.102:0/3653222478 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63e514640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x558321121c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63dd13640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 0x558321133e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 -- 172.21.15.102:0/3653222478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 msgr2=0x558321121c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x558321121c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 -- 172.21.15.102:0/3653222478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 msgr2=0x558321133e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 0x558321133e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 -- 172.21.15.102:0/3653222478 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55832111e720 con 0x558320d75350 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63dd13640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 0x558321133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd63ed15640 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd630005c40 tx=0x7fd630014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36447bb93b1c6b16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd623fff640 1 -- 172.21.15.102:0/3653222478 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630034020 con 0x558320d75350 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd623fff640 1 -- 172.21.15.102:0/3653222478 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd63000f780 con 0x558320d75350 2024-09-21T03:40:33.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.770+0000 7fd623fff640 1 -- 172.21.15.102:0/3653222478 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63002a040 con 0x558320d75350 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 -- 172.21.15.102:0/3653222478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 msgr2=0x5583211275f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd630005c40 tx=0x7fd630014000 comp rx=0 tx=0).stop 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 -- 172.21.15.102:0/3653222478 shutdown_connections 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d75350 0x5583211275f0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d54670 0x558321133e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 --2- 172.21.15.102:0/3653222478 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x558321121c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 -- 172.21.15.102:0/3653222478 >> 172.21.15.102:0/3653222478 conn(0x558320d69740 msgr2=0x558321121540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 -- 172.21.15.102:0/3653222478 shutdown_connections 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.771+0000 7fd646cec740 1 -- 172.21.15.102:0/3653222478 wait complete. 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 -- start start 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 Processor -- start 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x55832112c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x5583211a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381b0280 con 0x558320d54670 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381b16f0 con 0x558320d75350 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd6381b0950 con 0x558320d4c490 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd646cec740 10 client.0 _ll_register_callbacks cb 0x7fd634005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44928/0 (socket says 172.21.15.102:44928) 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 -- 172.21.15.102:0/965599983 learned_addr learned my addr 172.21.15.102:0/965599983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63ed15640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x5583211a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63e514640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x55832112c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 -- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 msgr2=0x55832112c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x55832112c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 -- 172.21.15.102:0/965599983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 msgr2=0x5583211a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:33.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x5583211a3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63dd13640 1 -- 172.21.15.102:0/965599983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832112cf40 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.772+0000 7fd63e514640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x55832112c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd63dd13640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd628004700 tx=0x7fd62800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472406df7fefaaad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628003f30 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fd62801d420 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd63000f780 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd62801d620 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd646cec740 10 client.16713 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5583211a5140 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd63000f780 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd628024a80 con 0x558320d54670 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.773+0000 7fd646cec740 10 client.16713 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:33.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd646cec740 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd646cec740 20 client.16713 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d09080 0x5583211a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd646cec740 4 client.16713 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558321090860 con 0x558320d09080 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd63e514640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d09080 0x5583211a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd63e514640 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d09080 0x5583211a78e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b7bd1f7ee3e502f server_cookie=4eed57b3447d8bf2 in_seq=0 out_seq=0 2024-09-21T03:40:33.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.774+0000 7fd621ffb640 10 client.16713 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd621ffb640 1 -- 172.21.15.102:0/965599983 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558321090860 con 0x558320d09080 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd621ffb640 10 client.16713 handle_command_reply: tid=0 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd646cec740 1 client.16713 shutdown 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 msgr2=0x55832112c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd628004700 tx=0x7fd62800bd60 comp rx=0 tx=0).stop 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 shutdown_connections 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.776+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558320d09080 0x5583211a78e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558320d54670 0x55832112c6c0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558320d75350 0x5583211a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 --2- 172.21.15.102:0/965599983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558320d4c490 0x55832112c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 >> 172.21.15.102:0/965599983 conn(0x558320d69740 msgr2=0x558321129340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd621ffb640 0 client.16713 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 shutdown_connections 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 1 -- 172.21.15.102:0/965599983 wait complete. 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd646cec740 20 client.16713 trim_cache size 0 max 16384 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "dcce8df1-350f-42bd-96dd-abb588b09910", 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:40:33.782 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 msgr2=0x7fd6240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 0x7fd6240b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd630022000 tx=0x7fd630023000 comp rx=0 tx=0).stop 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 msgr2=0x7fd6381992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd634005ab0 tx=0x7fd6340042f0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 shutdown_connections 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd6240b6680 0x7fd6240b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd638108cf0 0x7fd638199d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd6381083a0 0x7fd638199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 --2- 172.21.15.102:0/2800389464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd638102a60 0x7fd6381992d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:33.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.777+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 >> 172.21.15.102:0/2800389464 conn(0x7fd638079760 msgr2=0x7fd6381064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:33.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.778+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 shutdown_connections 2024-09-21T03:40:33.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:33.778+0000 7fd640778640 1 -- 172.21.15.102:0/2800389464 wait complete. 2024-09-21T03:40:34.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:40:34.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:34 smithi102 ceph-mon[31392]: pgmap v536: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:34 smithi148 ceph-mon[34651]: pgmap v536: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:34.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:34 smithi121 ceph-mon[34316]: pgmap v536: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:34.820 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 -- 172.21.15.102:0/1196820020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c109e40 msgr2=0x7f976c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 --2- 172.21.15.102:0/1196820020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c109e40 0x7f976c110670 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9764009ca0 tx=0x7f976402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 -- 172.21.15.102:0/1196820020 shutdown_connections 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 --2- 172.21.15.102:0/1196820020 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c109e40 0x7f976c110670 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 --2- 172.21.15.102:0/1196820020 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c1094f0 0x7f976c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 --2- 172.21.15.102:0/1196820020 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 0x7f976c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 -- 172.21.15.102:0/1196820020 >> 172.21.15.102:0/1196820020 conn(0x7f976c0ff600 msgr2=0x7f976c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 -- 172.21.15.102:0/1196820020 shutdown_connections 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 -- 172.21.15.102:0/1196820020 wait complete. 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.297+0000 7f97711f0640 1 Processor -- start 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 -- start start 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 0x7f976c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c109e40 0x7f976c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f976c113c20 con 0x7f976c1094f0 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f976c113aa0 con 0x7f976c103bb0 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f97711f0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f976c113da0 con 0x7f976c109e40 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35386/0 (socket says 172.21.15.102:35386) 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 -- 172.21.15.102:0/570184598 learned_addr learned my addr 172.21.15.102:0/570184598 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976b59e640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c109e40 0x7f976c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976ad9d640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 0x7f976c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 -- 172.21.15.102:0/570184598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c109e40 msgr2=0x7f976c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c109e40 0x7f976c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 -- 172.21.15.102:0/570184598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 msgr2=0x7f976c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 0x7f976c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.298+0000 7f976259c640 1 -- 172.21.15.102:0/570184598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976c1a03e0 con 0x7f976c1094f0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f976259c640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f975400d740 tx=0x7f975400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f9768d99640 1 -- 172.21.15.102:0/570184598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754017070 con 0x7f976c1094f0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976c1a06d0 con 0x7f976c1094f0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f9768d99640 1 -- 172.21.15.102:0/570184598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f975400de50 con 0x7f976c1094f0 2024-09-21T03:40:35.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f9768d99640 1 -- 172.21.15.102:0/570184598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975400f620 con 0x7f976c1094f0 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.299+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f976c1a6ef0 con 0x7f976c1094f0 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 Processor -- start 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 -- start start 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9768d99640 1 -- 172.21.15.102:0/570184598 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f975401a070 con 0x7f976c1094f0 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d825741e50 con 0x55d8253fb1b0 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d825731280 con 0x55d825403390 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f9777764740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d825735090 con 0x55d825424070 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35398/0 (socket says 172.21.15.102:35398) 2024-09-21T03:40:35.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f976ad9d640 1 -- 172.21.15.102:0/3830050488 learned_addr learned my addr 172.21.15.102:0/3830050488 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f976b59e640 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.302+0000 7f976259c640 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 -- 172.21.15.102:0/3830050488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 msgr2=0x55d8257cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 -- 172.21.15.102:0/3830050488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 msgr2=0x55d8257cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 -- 172.21.15.102:0/3830050488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82548f650 con 0x55d8253fb1b0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f9768d99640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 0x7f97580b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976ad9d640 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f975c00cc60 tx=0x7f975c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a580bd71b82a8e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976b59e640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 0x7f97580b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976159a640 1 -- 172.21.15.102:0/3830050488 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c014070 con 0x55d8253fb1b0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f9768d99640 1 -- 172.21.15.102:0/570184598 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f97540e7120 con 0x7f976c1094f0 2024-09-21T03:40:35.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976159a640 1 -- 172.21.15.102:0/3830050488 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f975c0047a0 con 0x55d8253fb1b0 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.303+0000 7f976159a640 1 -- 172.21.15.102:0/3830050488 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c010720 con 0x55d8253fb1b0 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- 172.21.15.102:0/3830050488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 msgr2=0x55d8257cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f976b59e640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 0x7f97580b8bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9764006010 tx=0x7f976402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f975c00cc60 tx=0x7f975c00e720 comp rx=0 tx=0).stop 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- 172.21.15.102:0/3830050488 shutdown_connections 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257cb7b0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 --2- 172.21.15.102:0/3830050488 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- 172.21.15.102:0/3830050488 >> 172.21.15.102:0/3830050488 conn(0x55d825418460 msgr2=0x55d8257c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- 172.21.15.102:0/3830050488 shutdown_connections 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- 172.21.15.102:0/3830050488 wait complete. 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.304+0000 7f9777764740 1 -- start start 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 Processor -- start 2024-09-21T03:40:35.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257d6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257e2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d825592700 con 0x55d8253fb1b0 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d8256cc110 con 0x55d825403390 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d8257d9a50 con 0x55d825424070 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f9777764740 10 client.0 _ll_register_callbacks cb 0x55d8256e5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35412/0 (socket says 172.21.15.102:35412) 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 -- 172.21.15.102:0/2069404729 learned_addr learned my addr 172.21.15.102:0/2069404729 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976259c640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257d6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976b59e640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257e2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 -- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 msgr2=0x55d8257e2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257e2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 -- 172.21.15.102:0/2069404729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 msgr2=0x55d8257d6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257d6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 -- 172.21.15.102:0/2069404729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8256f9c40 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f976ad9d640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f975c005230 tx=0x7f975c005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce819239ff71ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.305+0000 7f97527fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c027060 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f975c0106a0 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f975c0047a0 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f975c014070 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 10 client.16725 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d8257e5760 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f975c0047a0 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f975c0185d0 con 0x55d8253fb1b0 2024-09-21T03:40:35.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 10 client.16725 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 10 client.16725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 20 client.16725 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253e29f0 0x55d8257e8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 4 client.16725 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.306+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d825743da0 con 0x55d8253e29f0 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.307+0000 7f976259c640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253e29f0 0x55d8257e8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.307+0000 7f976259c640 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253e29f0 0x55d8257e8ac0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5f73ab61c85e90b server_cookie=1c7f0e89412aef21 in_seq=0 out_seq=0 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.307+0000 7f97527fc640 10 client.16725 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f97527fc640 1 -- 172.21.15.102:0/2069404729 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d825743da0 con 0x55d8253e29f0 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f97527fc640 10 client.16725 handle_command_reply: tid=0 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 client.16725 shutdown 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 msgr2=0x55d8257d6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f975c005230 tx=0x7f975c005260 comp rx=0 tx=0).stop 2024-09-21T03:40:35.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 shutdown_connections 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825424070 0x55d8257e2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825403390 0x55d8257d6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253e29f0 0x55d8257e8ac0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 --2- 172.21.15.102:0/2069404729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d8257d6930 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f97527fc640 0 client.16725 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 >> 172.21.15.102:0/2069404729 conn(0x55d825418460 msgr2=0x55d8257ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 shutdown_connections 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 1 -- 172.21.15.102:0/2069404729 wait complete. 2024-09-21T03:40:35.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.308+0000 7f9777764740 20 client.16725 trim_cache size 0 max 16384 2024-09-21T03:40:35.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 Processor -- start 2024-09-21T03:40:35.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 -- start start 2024-09-21T03:40:35.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 0x55d8257cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d8257ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1b2270 con 0x55d825424070 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1afb40 con 0x55d8253fb1b0 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.326+0000 7f9777764740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1ad9b0 con 0x55d825403390 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35426/0 (socket says 172.21.15.102:35426) 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 -- 172.21.15.102:0/1495870743 learned_addr learned my addr 172.21.15.102:0/1495870743 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976259c640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d8257ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976ad9d640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 0x55d8257cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 -- 172.21.15.102:0/1495870743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 msgr2=0x55d8257ebed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d8257ebed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 -- 172.21.15.102:0/1495870743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 msgr2=0x55d8257cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 0x55d8257cea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 -- 172.21.15.102:0/1495870743 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8257ce0d0 con 0x55d825424070 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976ad9d640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 0x55d8257cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f976b59e640 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9764003a70 tx=0x7f9764041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c9db640b9dab344 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f9760d99640 1 -- 172.21.15.102:0/1495870743 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97640315d0 con 0x55d825424070 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f9760d99640 1 -- 172.21.15.102:0/1495870743 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9764036050 con 0x55d825424070 2024-09-21T03:40:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.327+0000 7f9760d99640 1 -- 172.21.15.102:0/1495870743 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976402f790 con 0x55d825424070 2024-09-21T03:40:35.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 -- 172.21.15.102:0/1495870743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 msgr2=0x55d8257ec410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f9764003a70 tx=0x7f9764041000 comp rx=0 tx=0).stop 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 -- 172.21.15.102:0/1495870743 shutdown_connections 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d825424070 0x55d8257ec410 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d8257ebed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 --2- 172.21.15.102:0/1495870743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d8253fb1b0 0x55d8257cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 -- 172.21.15.102:0/1495870743 >> 172.21.15.102:0/1495870743 conn(0x55d825418460 msgr2=0x55d8257ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 -- 172.21.15.102:0/1495870743 shutdown_connections 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.328+0000 7f9777764740 1 -- 172.21.15.102:0/1495870743 wait complete. 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 -- start start 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 Processor -- start 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d82584afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825424070 0x55d82584ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1ae000 con 0x55d8253fb1b0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1af470 con 0x55d825424070 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f976c1ae6d0 con 0x55d825403390 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f9777764740 10 client.0 _ll_register_callbacks cb 0x7f9764009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35434/0 (socket says 172.21.15.102:35434) 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 -- 172.21.15.102:0/4232762045 learned_addr learned my addr 172.21.15.102:0/4232762045 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976259c640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d82584afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976b59e640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825424070 0x55d82584ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 -- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 msgr2=0x55d82584afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d82584afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 -- 172.21.15.102:0/4232762045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825424070 msgr2=0x55d82584ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.329+0000 7f976ad9d640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825424070 0x55d82584ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f976ad9d640 1 -- 172.21.15.102:0/4232762045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d825850630 con 0x55d8253fb1b0 2024-09-21T03:40:35.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f976259c640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d82584afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f976ad9d640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f975c006010 tx=0x7f975c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47058d12decc8e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975c027040 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7f975c004660 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9764036050 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f975c03e050 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 10 client.16731 fetch_fsmap learned FSMap version 35 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d8258579a0 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9764036050 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f975c0227e0 con 0x55d8253fb1b0 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 10 client.16731 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.330+0000 7f9777764740 20 client.16731 populate_metadata read hostname 'smithi102' 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253b7da0 0x55d82585a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:40:35.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f9777764740 4 client.16731 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d82573f850 con 0x55d8253b7da0 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f976259c640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253b7da0 0x55d82585a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f97527fc640 10 client.16731 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f976259c640 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253b7da0 0x55d82585a100 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe9a297c7bd2a53 server_cookie=ffa639fbf5bc8f36 in_seq=0 out_seq=0 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f97527fc640 1 -- 172.21.15.102:0/4232762045 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55d82573f850 con 0x55d8253b7da0 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f97527fc640 10 client.16731 handle_command_reply: tid=0 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.331+0000 7f9777764740 1 client.16731 shutdown 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 msgr2=0x55d82584a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f975c006010 tx=0x7f975c005710 comp rx=0 tx=0).stop 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 shutdown_connections 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d825424070 0x55d82584ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d825403390 0x55d82584afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55d8253b7da0 0x55d82585a100 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 --2- 172.21.15.102:0/4232762045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8253fb1b0 0x55d82584a9c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 >> 172.21.15.102:0/4232762045 conn(0x55d825418460 msgr2=0x55d8257cc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97527fc640 0 client.16731 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 shutdown_connections 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 1 -- 172.21.15.102:0/4232762045 wait complete. 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f9777764740 20 client.16731 trim_cache size 0 max 16384 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.339 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "dcce8df1-350f-42bd-96dd-abb588b09910", 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:40:35.340 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.342 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:40:35.343 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.344 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.345 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:40:35.346 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:40:35.347 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 msgr2=0x7f97580b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 0x7f97580b8bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9764006010 tx=0x7f976402f310 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 msgr2=0x7f976c19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f975400d740 tx=0x7f975400dc00 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 shutdown_connections 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97580b66b0 0x7f97580b8bc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f976c1094f0 0x7f976c19aad0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f976c109e40 0x7f976c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.332+0000 7f97711f0640 1 --2- 172.21.15.102:0/570184598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f976c103bb0 0x7f976c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.333+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 >> 172.21.15.102:0/570184598 conn(0x7f976c0ff600 msgr2=0x7f976c107ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.333+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 shutdown_connections 2024-09-21T03:40:35.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:40:35.333+0000 7f97711f0640 1 -- 172.21.15.102:0/570184598 wait complete. 2024-09-21T03:40:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:35 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:40:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:35 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:35 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:40:35.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:35 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:35.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:35 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:40:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:35 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:35 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:40:35.787 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:35 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:35 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:40:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:35 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:35 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:40:35.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:35 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:40:36.026 INFO:tasks.cephfs.filesystem:scrub status for tag:dcce8df1-350f-42bd-96dd-abb588b09910 - {'path': '/', 'tag': 'dcce8df1-350f-42bd-96dd-abb588b09910', 'options': 'recursive,force'} 2024-09-21T03:40:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:36 smithi148 ceph-mon[34651]: pgmap v537: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:36 smithi121 ceph-mon[34316]: pgmap v537: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:36 smithi102 ceph-mon[31392]: pgmap v537: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:37.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:37 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:40:37.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:37 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:40:37.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:37 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:40:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:38 smithi148 ceph-mon[34651]: pgmap v538: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:40:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:38 smithi121 ceph-mon[34316]: pgmap v538: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:40:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:38 smithi102 ceph-mon[31392]: pgmap v538: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:40:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:40 smithi148 ceph-mon[34651]: pgmap v539: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:40.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:40 smithi121 ceph-mon[34316]: pgmap v539: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:40 smithi102 ceph-mon[31392]: pgmap v539: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:40:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:42 smithi148 ceph-mon[34651]: pgmap v540: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:40:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:42 smithi121 ceph-mon[34316]: pgmap v540: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:40:42.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:42 smithi102 ceph-mon[31392]: pgmap v540: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:40:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:44 smithi148 ceph-mon[34651]: pgmap v541: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:44 smithi121 ceph-mon[34316]: pgmap v541: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:44 smithi102 ceph-mon[31392]: pgmap v541: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:40:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:46 smithi148 ceph-mon[34651]: pgmap v542: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:46 smithi121 ceph-mon[34316]: pgmap v542: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:46.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:46 smithi102 ceph-mon[31392]: pgmap v542: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:40:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:48 smithi148 ceph-mon[34651]: pgmap v543: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:40:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:48 smithi121 ceph-mon[34316]: pgmap v543: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:40:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:48 smithi102 ceph-mon[31392]: pgmap v543: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:40:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:50 smithi148 ceph-mon[34651]: pgmap v544: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:50.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:50 smithi121 ceph-mon[34316]: pgmap v544: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:50.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:50 smithi102 ceph-mon[31392]: pgmap v544: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:40:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:52 smithi148 ceph-mon[34651]: pgmap v545: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:52.755 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:52 smithi102 ceph-mon[31392]: pgmap v545: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:52 smithi121 ceph-mon[34316]: pgmap v545: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:40:54.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:54 smithi148 ceph-mon[34651]: pgmap v546: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:54.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:54 smithi121 ceph-mon[34316]: pgmap v546: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:54 smithi102 ceph-mon[31392]: pgmap v546: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:40:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:56 smithi148 ceph-mon[34651]: pgmap v547: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:40:56.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:56 smithi121 ceph-mon[34316]: pgmap v547: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:40:56.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:56 smithi102 ceph-mon[31392]: pgmap v547: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:40:58.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:40:58 smithi148 ceph-mon[34651]: pgmap v548: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:40:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:40:58 smithi121 ceph-mon[34316]: pgmap v548: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:40:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:40:58 smithi102 ceph-mon[31392]: pgmap v548: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:41:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:00 smithi148 ceph-mon[34651]: pgmap v549: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:41:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:00 smithi121 ceph-mon[34316]: pgmap v549: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:41:00.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:00 smithi102 ceph-mon[31392]: pgmap v549: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:41:02.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:02 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:02.493 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:02 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:02.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:02 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: pgmap v550: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:03.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:03.454 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: pgmap v550: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:03.495 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:41:03.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: pgmap v550: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:41:03.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:41:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:04 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T03:41:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:04 smithi102 ceph-mon[31392]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-21T03:41:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:04 smithi102 ceph-mon[31392]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T03:41:04.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:04 smithi102 ceph-mon[31392]: Unable to set osd_memory_target on smithi121 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-21T03:41:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:04 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T03:41:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:04 smithi148 ceph-mon[34651]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-21T03:41:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:04 smithi148 ceph-mon[34651]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T03:41:04.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:04 smithi148 ceph-mon[34651]: Unable to set osd_memory_target on smithi121 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-21T03:41:04.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:04 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi148 to 176.0M 2024-09-21T03:41:04.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:04 smithi121 ceph-mon[34316]: Adjusting osd_memory_target on smithi121 to 175.9M 2024-09-21T03:41:04.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:04 smithi121 ceph-mon[34316]: Unable to set osd_memory_target on smithi148 to 184591052: error parsing value: Value '184591052' is below minimum 939524096 2024-09-21T03:41:04.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:04 smithi121 ceph-mon[34316]: Unable to set osd_memory_target on smithi121 to 184530841: error parsing value: Value '184530841' is below minimum 939524096 2024-09-21T03:41:05.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:05 smithi102 ceph-mon[31392]: pgmap v551: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 22 op/s 2024-09-21T03:41:05.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:05 smithi148 ceph-mon[34651]: pgmap v551: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 22 op/s 2024-09-21T03:41:05.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:05 smithi121 ceph-mon[34316]: pgmap v551: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 KiB/s wr, 22 op/s 2024-09-21T03:41:06.028 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:41:06.280 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:06.679 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:06 smithi102 ceph-mon[31392]: pgmap v552: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:41:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:06 smithi148 ceph-mon[34651]: pgmap v552: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:41:06.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:06 smithi121 ceph-mon[34316]: pgmap v552: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- 172.21.15.102:0/3405550351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414102a60 msgr2=0x7fa414102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 --2- 172.21.15.102:0/3405550351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414102a60 0x7fa414102e70 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa404009900 tx=0x7fa40402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- 172.21.15.102:0/3405550351 shutdown_connections 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 --2- 172.21.15.102:0/3405550351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa414108cf0 0x7fa41410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 --2- 172.21.15.102:0/3405550351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa4141083a0 0x7fa4141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 --2- 172.21.15.102:0/3405550351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414102a60 0x7fa414102e70 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- 172.21.15.102:0/3405550351 >> 172.21.15.102:0/3405550351 conn(0x7fa414079730 msgr2=0x7fa414079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- 172.21.15.102:0/3405550351 shutdown_connections 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- 172.21.15.102:0/3405550351 wait complete. 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 Processor -- start 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.909+0000 7fa419578640 1 -- start start 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa414102a60 0x7fa414199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4141083a0 0x7fa4141997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa414112b80 con 0x7fa414108cf0 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa414112a00 con 0x7fa414102a60 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa419578640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa414112d00 con 0x7fa4141083a0 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37452/0 (socket says 172.21.15.102:37452) 2024-09-21T03:41:06.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 -- 172.21.15.102:0/421641693 learned_addr learned my addr 172.21.15.102:0/421641693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa412ffd640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa414102a60 0x7fa414199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4141083a0 0x7fa4141997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 -- 172.21.15.102:0/421641693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4141083a0 msgr2=0x7fa4141997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4141083a0 0x7fa4141997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 -- 172.21.15.102:0/421641693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa414102a60 msgr2=0x7fa414199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa414102a60 0x7fa414199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 -- 172.21.15.102:0/421641693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4141a8930 con 0x7fa414108cf0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.910+0000 7fa4137fe640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00b970 tx=0x7fa40c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.911+0000 7fa410ff9640 1 -- 172.21.15.102:0/421641693 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c019070 con 0x7fa414108cf0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.911+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4141a8c20 con 0x7fa414108cf0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.911+0000 7fa410ff9640 1 -- 172.21.15.102:0/421641693 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa40c00cb40 con 0x7fa414108cf0 2024-09-21T03:41:06.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.911+0000 7fa410ff9640 1 -- 172.21.15.102:0/421641693 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c007610 con 0x7fa414108cf0 2024-09-21T03:41:06.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.911+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4141a9230 con 0x7fa414108cf0 2024-09-21T03:41:06.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.913+0000 7fa41faec740 1 Processor -- start 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.913+0000 7fa410ff9640 1 -- 172.21.15.102:0/421641693 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa40c01c070 con 0x7fa414108cf0 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 -- start start 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30ab070 0x563cb3452270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb30821b0 0x563cb34527b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563cb33c8e50 con 0x563cb308a390 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563cb33b8280 con 0x563cb30ab070 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa41faec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563cb33bc090 con 0x563cb30821b0 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa40a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa40a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37458/0 (socket says 172.21.15.102:37458) 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa40a7fc640 1 -- 172.21.15.102:0/2739160365 learned_addr learned my addr 172.21.15.102:0/2739160365 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:06.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa412ffd640 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb30821b0 0x563cb34527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.914+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30ab070 0x563cb3452270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 -- 172.21.15.102:0/2739160365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb30821b0 msgr2=0x563cb34527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb30821b0 0x563cb34527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 -- 172.21.15.102:0/2739160365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30ab070 msgr2=0x563cb3452270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30ab070 0x563cb3452270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 -- 172.21.15.102:0/2739160365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb3116650 con 0x563cb308a390 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc016500 tx=0x7fa3fc00a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a0511767d941dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa410ff9640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 0x7fa4000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa4097fa640 1 -- 172.21.15.102:0/2739160365 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc018430 con 0x563cb308a390 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa412ffd640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 0x7fa4000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa4097fa640 1 -- 172.21.15.102:0/2739160365 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3fc018aa0 con 0x563cb308a390 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa4097fa640 1 -- 172.21.15.102:0/2739160365 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc0178b0 con 0x563cb308a390 2024-09-21T03:41:06.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.915+0000 7fa410ff9640 1 -- 172.21.15.102:0/421641693 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa40c0e6ca0 con 0x7fa414108cf0 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 -- 172.21.15.102:0/2739160365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 msgr2=0x563cb3452cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa412ffd640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 0x7fa4000b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa404005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc016500 tx=0x7fa3fc00a290 comp rx=0 tx=0).stop 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 -- 172.21.15.102:0/2739160365 shutdown_connections 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb308a390 0x563cb3452cf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb30821b0 0x563cb34527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 --2- 172.21.15.102:0/2739160365 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30ab070 0x563cb3452270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 -- 172.21.15.102:0/2739160365 >> 172.21.15.102:0/2739160365 conn(0x563cb309f460 msgr2=0x563cb3450160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 -- 172.21.15.102:0/2739160365 shutdown_connections 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.916+0000 7fa41faec740 1 -- 172.21.15.102:0/2739160365 wait complete. 2024-09-21T03:41:06.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 -- start start 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 Processor -- start 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb345d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563cb3219700 con 0x563cb30ab070 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563cb3353110 con 0x563cb30821b0 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563cb34609f0 con 0x563cb308a390 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa41faec740 10 client.0 _ll_register_callbacks cb 0x563cb336c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37472/0 (socket says 172.21.15.102:37472) 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 -- 172.21.15.102:0/3400833704 learned_addr learned my addr 172.21.15.102:0/3400833704 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa412ffd640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb345d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 -- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 msgr2=0x563cb345dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.917+0000 7fa4137fe640 1 -- 172.21.15.102:0/3400833704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 msgr2=0x563cb345d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb345d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa4137fe640 1 -- 172.21.15.102:0/3400833704 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb3380c40 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0aca40 tx=0x7fa40c0a9210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bc71f9b4ce58e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0abf10 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa40c0b1250 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3fc018aa0 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa40c0ac5c0 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 10 client.16743 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563cb346c680 con 0x563cb30ab070 2024-09-21T03:41:06.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa3fc018aa0 con 0x563cb30ab070 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa40c0a8400 con 0x563cb30ab070 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 10 client.16743 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 10 client.16743 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 20 client.16743 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.918+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb30699f0 0x563cb346fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.919+0000 7fa41faec740 4 client.16743 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.919+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cb33cada0 con 0x563cb30699f0 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.919+0000 7fa412ffd640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb30699f0 0x563cb346fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.919+0000 7fa3fa7fc640 10 client.16743 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.919+0000 7fa412ffd640 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb30699f0 0x563cb346fb70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7d4b9a15e7dc4e1 server_cookie=2b1e31a66a233d28 in_seq=0 out_seq=0 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/3400833704 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cb33cada0 con 0x563cb30699f0 2024-09-21T03:41:06.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa3fa7fc640 10 client.16743 handle_command_reply: tid=0 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 client.16743 shutdown 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 msgr2=0x563cb345e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0aca40 tx=0x7fa40c0a9210 comp rx=0 tx=0).stop 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 shutdown_connections 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb30699f0 0x563cb346fb70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb345e2b0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.920+0000 7fa41faec740 1 --2- 172.21.15.102:0/3400833704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb345d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.921+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 >> 172.21.15.102:0/3400833704 conn(0x563cb309f460 msgr2=0x563cb3455400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.921+0000 7fa3fa7fc640 0 client.16743 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.921+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 shutdown_connections 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.921+0000 7fa41faec740 1 -- 172.21.15.102:0/3400833704 wait complete. 2024-09-21T03:41:06.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.921+0000 7fa41faec740 20 client.16743 trim_cache size 0 max 16384 2024-09-21T03:41:06.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 Processor -- start 2024-09-21T03:41:06.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 -- start start 2024-09-21T03:41:06.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3453c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141b44c0 con 0x563cb30ab070 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141b1d90 con 0x563cb30821b0 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa41faec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141afc00 con 0x563cb308a390 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa412ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3453c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37480/0 (socket says 172.21.15.102:37480) 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa4137fe640 1 -- 172.21.15.102:0/3981432606 learned_addr learned my addr 172.21.15.102:0/3981432606 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.938+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 -- 172.21.15.102:0/3981432606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 msgr2=0x563cb345f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 -- 172.21.15.102:0/3981432606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 msgr2=0x563cb3453c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3453c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 -- 172.21.15.102:0/3981432606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cb34506a0 con 0x563cb30ab070 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa412ffd640 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3453c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa4137fe640 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009a00 tx=0x7fa40c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72e2f32d5842af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa408ff9640 1 -- 172.21.15.102:0/3981432606 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0ac880 con 0x563cb30ab070 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa408ff9640 1 -- 172.21.15.102:0/3981432606 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa40c0ad1b0 con 0x563cb30ab070 2024-09-21T03:41:06.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.939+0000 7fa408ff9640 1 -- 172.21.15.102:0/3981432606 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0a8560 con 0x563cb30ab070 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 -- 172.21.15.102:0/3981432606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 msgr2=0x563cb344f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009a00 tx=0x7fa40c004b50 comp rx=0 tx=0).stop 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 -- 172.21.15.102:0/3981432606 shutdown_connections 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb344f710 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb345f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 --2- 172.21.15.102:0/3981432606 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3453c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 -- 172.21.15.102:0/3981432606 >> 172.21.15.102:0/3981432606 conn(0x563cb309f460 msgr2=0x563cb345ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 -- 172.21.15.102:0/3981432606 shutdown_connections 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.940+0000 7fa41faec740 1 -- 172.21.15.102:0/3981432606 wait complete. 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 -- start start 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 Processor -- start 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3461f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb3462490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141b0250 con 0x563cb30ab070 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141b16c0 con 0x563cb30821b0 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa4141b0920 con 0x563cb308a390 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa41faec740 10 client.0 _ll_register_callbacks cb 0x7fa40c0098b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa4137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37486/0 (socket says 172.21.15.102:37486) 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa4137fe640 1 -- 172.21.15.102:0/966034863 learned_addr learned my addr 172.21.15.102:0/966034863 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:06.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.941+0000 7fa40a7fc640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb3462490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa412ffd640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3461f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 -- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 msgr2=0x563cb3462490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb3462490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 -- 172.21.15.102:0/966034863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 msgr2=0x563cb3461f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3461f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 -- 172.21.15.102:0/966034863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cb3469c10 con 0x563cb30ab070 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa4137fe640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0cecf0 tx=0x7fa40c0a8610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab83404fbe002b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa3fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c0ac880 con 0x563cb30ab070 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8586+0+0 (secure 0 0 0) 0x7fa40c0abf10 con 0x563cb30ab070 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa40c0ad1b0 con 0x563cb30ab070 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa40c0b1590 con 0x563cb30ab070 2024-09-21T03:41:06.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa41faec740 10 client.16749 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.942+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563cb3469c10 con 0x563cb30ab070 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa40c0ad1b0 con 0x563cb30ab070 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa40c097070 con 0x563cb30ab070 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 10 client.16749 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 20 client.16749 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb303eda0 0x563cb34dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 4 client.16749 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563cb33c6850 con 0x563cb303eda0 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.943+0000 7fa412ffd640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb303eda0 0x563cb34dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:06.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa3fa7fc640 10 client.16749 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa412ffd640 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb303eda0 0x563cb34dcb90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf98dd553b8c71 server_cookie=c545a597a9e1bf22 in_seq=0 out_seq=0 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa3fa7fc640 1 -- 172.21.15.102:0/966034863 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x563cb33c6850 con 0x563cb303eda0 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa3fa7fc640 10 client.16749 handle_command_reply: tid=0 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 client.16749 shutdown 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 msgr2=0x563cb34d9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fa40c0cecf0 tx=0x7fa40c0a8610 comp rx=0 tx=0).stop 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 shutdown_connections 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563cb303eda0 0x563cb34dcb90 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563cb30ab070 0x563cb34d9550 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa3fa7fc640 0 client.16749 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:06.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563cb308a390 0x563cb3462490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 --2- 172.21.15.102:0/966034863 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563cb30821b0 0x563cb3461f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 >> 172.21.15.102:0/966034863 conn(0x563cb309f460 msgr2=0x563cb3469390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 shutdown_connections 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.944+0000 7fa41faec740 1 -- 172.21.15.102:0/966034863 wait complete. 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa41faec740 20 client.16749 trim_cache size 0 max 16384 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:41:06.952 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.954 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:41:06.955 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.956 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:41:06.957 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.958 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:06.959 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 msgr2=0x7fa4000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 0x7fa4000b8b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa404005a40 comp rx=0 tx=0).stop 2024-09-21T03:41:06.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 msgr2=0x7fa414199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa40c00b970 tx=0x7fa40c00be30 comp rx=0 tx=0).stop 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 shutdown_connections 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa4000b6680 0x7fa4000b8b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa414108cf0 0x7fa414199d00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa4141083a0 0x7fa4141997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 --2- 172.21.15.102:0/421641693 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa414102a60 0x7fa414199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 >> 172.21.15.102:0/421641693 conn(0x7fa414079730 msgr2=0x7fa414101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 shutdown_connections 2024-09-21T03:41:06.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:06.945+0000 7fa419578640 1 -- 172.21.15.102:0/421641693 wait complete. 2024-09-21T03:41:07.892 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:41:07.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:08.324 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:08 smithi148 ceph-mon[34651]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:41:08.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:08 smithi148 ceph-mon[34651]: pgmap v554: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:08.746 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:08 smithi102 ceph-mon[31392]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:41:08.746 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:08 smithi102 ceph-mon[31392]: pgmap v554: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:08.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:08 smithi121 ceph-mon[34316]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T03:41:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:08 smithi121 ceph-mon[34316]: pgmap v554: 97 pgs: 97 active+clean; 270 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2069971706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4103b60 msgr2=0x7f2ea4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2069971706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4103b60 0x7f2ea4103f70 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009900 tx=0x7f2e9402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2069971706 shutdown_connections 2024-09-21T03:41:08.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2069971706 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea4109df0 0x7f2ea4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2069971706 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea41094a0 0x7f2ea41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2069971706 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4103b60 0x7f2ea4103f70 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2069971706 >> 172.21.15.102:0/2069971706 conn(0x7f2ea407b850 msgr2=0x7f2ea407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2069971706 shutdown_connections 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2069971706 wait complete. 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.835+0000 7f2ea97dc640 1 Processor -- start 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 -- start start 2024-09-21T03:41:08.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea4103b60 0x7f2ea419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea41094a0 0x7f2ea419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4113bd0 con 0x7f2ea4109df0 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4113a50 con 0x7f2ea4103b60 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea97dc640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4113d50 con 0x7f2ea41094a0 2024-09-21T03:41:08.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37504/0 (socket says 172.21.15.102:37504) 2024-09-21T03:41:08.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 -- 172.21.15.102:0/2868011553 learned_addr learned my addr 172.21.15.102:0/2868011553 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:08.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea27fc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea41094a0 0x7f2ea419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea2ffd640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea4103b60 0x7f2ea419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 -- 172.21.15.102:0/2868011553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea41094a0 msgr2=0x7f2ea419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea41094a0 0x7f2ea419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 -- 172.21.15.102:0/2868011553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea4103b60 msgr2=0x7f2ea419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea4103b60 0x7f2ea419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.836+0000 7f2ea37fe640 1 -- 172.21.15.102:0/2868011553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea41a0510 con 0x7f2ea4109df0 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2ea37fe640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009fd0 tx=0x7f2e9c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:08.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c017070 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2e9c003e40 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea41a0800 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c004820 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.837+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea41a6f60 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.838+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea4104de0 con 0x7f2ea4109df0 2024-09-21T03:41:08.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.839+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f2e9c003970 con 0x7f2ea4109df0 2024-09-21T03:41:08.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.840+0000 7f2e8bfff640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 0x7f2e8c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:08.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.840+0000 7f2ea2ffd640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 0x7f2e8c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:08.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.840+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f2e9c0e7450 con 0x7f2ea4109df0 2024-09-21T03:41:08.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.840+0000 7f2ea2ffd640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 0x7f2e8c0b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009230 tx=0x7f2e940058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:08.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:08.843+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e9c003c60 con 0x7f2ea4109df0 2024-09-21T03:41:09.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.056+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ea410bbc0 con 0x7f2ea4109df0 2024-09-21T03:41:09.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.057+0000 7f2e8bfff640 1 -- 172.21.15.102:0/2868011553 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f2e9c0b1d10 con 0x7f2ea4109df0 2024-09-21T03:41:09.060 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:41:09.060 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:41:09.060 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 msgr2=0x7f2e8c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 0x7f2e8c0b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2e94009230 tx=0x7f2e940058d0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 msgr2=0x7f2ea419fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009fd0 tx=0x7f2e9c00b260 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 shutdown_connections 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f2e8c0b6680 0x7f2e8c0b8b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea4109df0 0x7f2ea419fde0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2ea41094a0 0x7f2ea419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 --2- 172.21.15.102:0/2868011553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2ea4103b60 0x7f2ea419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:09.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.059+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 >> 172.21.15.102:0/2868011553 conn(0x7f2ea407b850 msgr2=0x7f2ea41074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:09.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.060+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 shutdown_connections 2024-09-21T03:41:09.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:09.060+0000 7f2ea97dc640 1 -- 172.21.15.102:0/2868011553 wait complete. 2024-09-21T03:41:09.712 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:41:09.738 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:09 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2868011553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:09.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:09 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2868011553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:09.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:09 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2868011553' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:09.956 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 -- 172.21.15.102:0/2456961282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8102a80 msgr2=0x7f00b8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 --2- 172.21.15.102:0/2456961282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8102a80 0x7f00b8102e90 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 -- 172.21.15.102:0/2456961282 shutdown_connections 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 --2- 172.21.15.102:0/2456961282 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8108d10 0x7f00b810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 --2- 172.21.15.102:0/2456961282 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 0x7f00b81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 --2- 172.21.15.102:0/2456961282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8102a80 0x7f00b8102e90 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 -- 172.21.15.102:0/2456961282 >> 172.21.15.102:0/2456961282 conn(0x7f00b8079740 msgr2=0x7f00b8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 -- 172.21.15.102:0/2456961282 shutdown_connections 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 -- 172.21.15.102:0/2456961282 wait complete. 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.462+0000 7f00bddee640 1 Processor -- start 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 -- start start 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8102a80 0x7f00b819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 0x7f00b819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113bc0 con 0x7f00b8108d10 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113a40 con 0x7f00b8102a80 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00bddee640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00b8113d40 con 0x7f00b81083c0 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37528/0 (socket says 172.21.15.102:37528) 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 -- 172.21.15.102:0/3377347455 learned_addr learned my addr 172.21.15.102:0/3377347455 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b77fe640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8102a80 0x7f00b819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 0x7f00b819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 -- 172.21.15.102:0/3377347455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 msgr2=0x7f00b819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 0x7f00b819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 -- 172.21.15.102:0/3377347455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8102a80 msgr2=0x7f00b819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8102a80 0x7f00b819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.463+0000 7f00b7fff640 1 -- 172.21.15.102:0/3377347455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b81a26a0 con 0x7f00b8108d10 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00b7fff640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f00b000eaa0 tx=0x7f00b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00b57fa640 1 -- 172.21.15.102:0/3377347455 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b000cdb0 con 0x7f00b8108d10 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00b57fa640 1 -- 172.21.15.102:0/3377347455 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00b0005020 con 0x7f00b8108d10 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b81a2990 con 0x7f00b8108d10 2024-09-21T03:41:10.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00b57fa640 1 -- 172.21.15.102:0/3377347455 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b00116d0 con 0x7f00b8108d10 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.464+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b81a90f0 con 0x7f00b8108d10 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.466+0000 7f00c4362740 1 Processor -- start 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.466+0000 7f00b57fa640 1 -- 172.21.15.102:0/3377347455 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f00b00051d0 con 0x7f00b8108d10 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.466+0000 7f00c4362740 1 -- start start 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 0x561005a3a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a3ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5610059b0ea0 con 0x56100566a1b0 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5610059a02d0 con 0x561005693070 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00c4362740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5610059a40e0 con 0x561005672390 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37532/0 (socket says 172.21.15.102:37532) 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 -- 172.21.15.102:0/3538516677 learned_addr learned my addr 172.21.15.102:0/3538516677 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:10.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 0x561005a3a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a3ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 -- 172.21.15.102:0/3538516677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 msgr2=0x561005a3ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a3ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 -- 172.21.15.102:0/3538516677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 msgr2=0x561005a3a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 0x561005a3a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 -- 172.21.15.102:0/3538516677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610056fe650 con 0x56100566a1b0 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 0x561005a3a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b57fa640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 0x7f00a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 0x7f00a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.467+0000 7f00b77fe640 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a8031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98127c7ceb0e5aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.468+0000 7f00b57fa640 1 -- 172.21.15.102:0/3377347455 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f00b00e7900 con 0x7f00b8108d10 2024-09-21T03:41:10.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.468+0000 7f00adffb640 1 -- 172.21.15.102:0/3538516677 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8040070 con 0x56100566a1b0 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.468+0000 7f00adffb640 1 -- 172.21.15.102:0/3538516677 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a8031710 con 0x56100566a1b0 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.468+0000 7f00adffb640 1 -- 172.21.15.102:0/3538516677 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035040 con 0x56100566a1b0 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- 172.21.15.102:0/3538516677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 msgr2=0x561005a3a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00aeffd640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 0x7f00a40b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00b8100db0 tx=0x7f00a0014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a8031bc0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- 172.21.15.102:0/3538516677 shutdown_connections 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a3a800 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a3ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 --2- 172.21.15.102:0/3538516677 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005693070 0x561005a3a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- 172.21.15.102:0/3538516677 >> 172.21.15.102:0/3538516677 conn(0x561005687460 msgr2=0x561005a381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- 172.21.15.102:0/3538516677 shutdown_connections 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- 172.21.15.102:0/3538516677 wait complete. 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 -- start start 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.469+0000 7f00c4362740 1 Processor -- start 2024-09-21T03:41:10.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 0x561005a458f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a45e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561005801700 con 0x561005693070 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56100593b160 con 0x56100566a1b0 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561005a48a40 con 0x561005672390 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 10 client.0 _ll_register_callbacks cb 0x5610059549e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37544/0 (socket says 172.21.15.102:37544) 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 -- 172.21.15.102:0/1181690150 learned_addr learned my addr 172.21.15.102:0/1181690150 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00aeffd640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a45e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 0x561005a458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 -- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 msgr2=0x561005a45e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a45e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 -- 172.21.15.102:0/1181690150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 msgr2=0x561005a458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 0x561005a458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 -- 172.21.15.102:0/1181690150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561005968c90 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 0x561005a458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00b7fff640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f00b00e55e0 tx=0x7f00b00ad200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbf6d03e25eac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f0096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b001f030 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f00b00ac460 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.470+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a8031710 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f00b00b21c0 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 10 client.16767 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561005a54700 con 0x561005693070 2024-09-21T03:41:10.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a8031710 con 0x561005693070 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f00b000f040 con 0x561005693070 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 10 client.16767 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 10 client.16767 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 20 client.16767 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5610056519f0 0x561005a57c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 4 client.16767 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.471+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610059b2df0 con 0x5610056519f0 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.472+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5610056519f0 0x561005a57c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.472+0000 7f0096ffd640 10 client.16767 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.472+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5610056519f0 0x561005a57c30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=361574151c9b07d8 server_cookie=4dbf7aaf75229b94 in_seq=0 out_seq=0 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f0096ffd640 1 -- 172.21.15.102:0/1181690150 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5610059b2df0 con 0x5610056519f0 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f0096ffd640 10 client.16767 handle_command_reply: tid=0 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 client.16767 shutdown 2024-09-21T03:41:10.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 msgr2=0x561005a46370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f00b00e55e0 tx=0x7f00b00ad200 comp rx=0 tx=0).stop 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 shutdown_connections 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5610056519f0 0x561005a57c30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561005693070 0x561005a46370 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005672390 0x561005a45e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 --2- 172.21.15.102:0/1181690150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56100566a1b0 0x561005a458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 >> 172.21.15.102:0/1181690150 conn(0x561005687460 msgr2=0x561005a3d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f0096ffd640 0 client.16767 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 shutdown_connections 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 1 -- 172.21.15.102:0/1181690150 wait complete. 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.473+0000 7f00c4362740 20 client.16767 trim_cache size 0 max 16384 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.487+0000 7f00c4362740 1 Processor -- start 2024-09-21T03:41:10.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.487+0000 7f00c4362740 1 -- start start 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a42ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a43020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81b4410 con 0x56100566a1b0 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81b1ce0 con 0x561005672390 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00c4362740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81afb50 con 0x561005693070 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37558/0 (socket says 172.21.15.102:37558) 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 -- 172.21.15.102:0/2911913665 learned_addr learned my addr 172.21.15.102:0/2911913665 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00aeffd640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a42ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b7fff640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a43020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 -- 172.21.15.102:0/2911913665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 msgr2=0x561005a43020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a43020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 -- 172.21.15.102:0/2911913665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 msgr2=0x561005a42ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a42ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 -- 172.21.15.102:0/2911913665 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561005a32440 con 0x56100566a1b0 2024-09-21T03:41:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b7fff640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a43020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:10.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.488+0000 7f00b77fe640 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f00a8004730 tx=0x7f00a8046040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac3246af80c9b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.489+0000 7f00ad7fa640 1 -- 172.21.15.102:0/2911913665 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8040070 con 0x56100566a1b0 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.489+0000 7f00ad7fa640 1 -- 172.21.15.102:0/2911913665 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a80318f0 con 0x56100566a1b0 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.489+0000 7f00ad7fa640 1 -- 172.21.15.102:0/2911913665 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035050 con 0x56100566a1b0 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 -- 172.21.15.102:0/2911913665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 msgr2=0x561005a47520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f00a8004730 tx=0x7f00a8046040 comp rx=0 tx=0).stop 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 -- 172.21.15.102:0/2911913665 shutdown_connections 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a43020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a42ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 --2- 172.21.15.102:0/2911913665 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a47520 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 -- 172.21.15.102:0/2911913665 >> 172.21.15.102:0/2911913665 conn(0x561005687460 msgr2=0x561005a46e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 -- 172.21.15.102:0/2911913665 shutdown_connections 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.490+0000 7f00c4362740 1 -- 172.21.15.102:0/2911913665 wait complete. 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 -- start start 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 Processor -- start 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a49880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a49dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81b01a0 con 0x56100566a1b0 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81b1610 con 0x561005672390 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f00b81b0870 con 0x561005693070 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00c4362740 10 client.0 _ll_register_callbacks cb 0x7f00b00a9de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.491+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37568/0 (socket says 172.21.15.102:37568) 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 -- 172.21.15.102:0/1577942014 learned_addr learned my addr 172.21.15.102:0/1577942014 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:10.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00aeffd640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a49880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b7fff640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a49dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 -- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 msgr2=0x561005a49dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a49dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 -- 172.21.15.102:0/1577942014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 msgr2=0x561005a49880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a49880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 -- 172.21.15.102:0/1577942014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561005a4a4b0 con 0x56100566a1b0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f00b77fe640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009850 tx=0x7f00a802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c65f80d83694d3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.492+0000 7f0096ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a805e060 con 0x56100566a1b0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f00a8004980 con 0x56100566a1b0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a80318f0 con 0x56100566a1b0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f00a8035020 con 0x56100566a1b0 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 10 client.16773 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:10.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561005ac2450 con 0x56100566a1b0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f00a80318f0 con 0x56100566a1b0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f00a80051c0 con 0x56100566a1b0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 10 client.16773 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 10 client.16773 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 20 client.16773 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561005626da0 0x561005ac47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 4 client.16773 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.494+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5610059ae8a0 con 0x561005626da0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f00aeffd640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561005626da0 0x561005ac47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f00aeffd640 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561005626da0 0x561005ac47b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f721a858a8e4045c server_cookie=d5fef38f525a0d9 in_seq=0 out_seq=0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f0096ffd640 10 client.16773 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f0096ffd640 1 -- 172.21.15.102:0/1577942014 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5610059ae8a0 con 0x561005626da0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f0096ffd640 10 client.16773 handle_command_reply: tid=0 2024-09-21T03:41:10.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.495+0000 7f00c4362740 1 client.16773 shutdown 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 msgr2=0x561005a4e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009850 tx=0x7f00a802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 shutdown_connections 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x561005626da0 0x561005ac47b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561005693070 0x561005a49dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f0096ffd640 0 client.16773 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561005672390 0x561005a49880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 --2- 172.21.15.102:0/1577942014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56100566a1b0 0x561005a4e3d0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 >> 172.21.15.102:0/1577942014 conn(0x561005687460 msgr2=0x561005a3bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 shutdown_connections 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 1 -- 172.21.15.102:0/1577942014 wait complete. 2024-09-21T03:41:10.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00c4362740 20 client.16773 trim_cache size 0 max 16384 2024-09-21T03:41:10.511 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:10.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 msgr2=0x7f00a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 0x7f00a40b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f00b8100db0 tx=0x7f00a0014040 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 msgr2=0x7f00b81a1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.496+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f00b000eaa0 tx=0x7f00b000ef60 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 shutdown_connections 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f00a40b6680 0x7f00a40b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00b8108d10 0x7f00b81a1f70 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f00b81083c0 0x7f00b819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 --2- 172.21.15.102:0/3377347455 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00b8102a80 0x7f00b819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 >> 172.21.15.102:0/3377347455 conn(0x7f00b8079740 msgr2=0x7f00b810d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 shutdown_connections 2024-09-21T03:41:10.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:10.497+0000 7f00bddee640 1 -- 172.21.15.102:0/3377347455 wait complete. 2024-09-21T03:41:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:10 smithi102 ceph-mon[31392]: pgmap v555: 97 pgs: 97 active+clean; 234 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:10 smithi121 ceph-mon[34316]: pgmap v555: 97 pgs: 97 active+clean; 234 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:10 smithi148 ceph-mon[34651]: pgmap v555: 97 pgs: 97 active+clean; 234 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:41:11.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:41:11.458 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 -- 172.21.15.102:0/2661763641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe81094b0 msgr2=0x7f1fe81098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 --2- 172.21.15.102:0/2661763641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe81094b0 0x7f1fe81098c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009900 tx=0x7f1fdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 -- 172.21.15.102:0/2661763641 shutdown_connections 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 --2- 172.21.15.102:0/2661763641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe81094b0 0x7f1fe81098c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 --2- 172.21.15.102:0/2661763641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 0x7f1fe8110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 --2- 172.21.15.102:0/2661763641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe8101f70 0x7f1fe8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 -- 172.21.15.102:0/2661763641 >> 172.21.15.102:0/2661763641 conn(0x7f1fe8077c60 msgr2=0x7f1fe80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 -- 172.21.15.102:0/2661763641 shutdown_connections 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.988+0000 7f1feed8a640 1 -- 172.21.15.102:0/2661763641 wait complete. 2024-09-21T03:41:11.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 Processor -- start 2024-09-21T03:41:11.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 -- start start 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe81094b0 0x7f1fe819ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 0x7f1fe819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8113be0 con 0x7f1fe8101f70 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8113a60 con 0x7f1fe8109e00 2024-09-21T03:41:11.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1feed8a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe8113d60 con 0x7f1fe81094b0 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37582/0 (socket says 172.21.15.102:37582) 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe81094b0 0x7f1fe819ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1fecb26640 1 -- 172.21.15.102:0/18847474 learned_addr learned my addr 172.21.15.102:0/18847474 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.989+0000 7f1fed327640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 0x7f1fe819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 -- 172.21.15.102:0/18847474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe81094b0 msgr2=0x7f1fe819ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe81094b0 0x7f1fe819ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 -- 172.21.15.102:0/18847474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 msgr2=0x7f1fe819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 0x7f1fe819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 -- 172.21.15.102:0/18847474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe81a0420 con 0x7f1fe8101f70 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fecb26640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800d770 tx=0x7f1fd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fe5ffb640 1 -- 172.21.15.102:0/18847474 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017070 con 0x7f1fe8101f70 2024-09-21T03:41:11.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe81a0710 con 0x7f1fe8101f70 2024-09-21T03:41:11.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fe5ffb640 1 -- 172.21.15.102:0/18847474 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fd80054f0 con 0x7f1fe8101f70 2024-09-21T03:41:11.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1fe5ffb640 1 -- 172.21.15.102:0/18847474 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8004de0 con 0x7f1fe8101f70 2024-09-21T03:41:11.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.990+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe81a0bd0 con 0x7f1fe8101f70 2024-09-21T03:41:12.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 Processor -- start 2024-09-21T03:41:12.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1fe5ffb640 1 -- 172.21.15.102:0/18847474 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1fd8005020 con 0x7f1fe8101f70 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 -- start start 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 0x56226b2772c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 0x56226b277d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56226b1edea0 con 0x56226aea71b0 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56226b1dd2d0 con 0x56226aed0070 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56226b1e10e0 con 0x56226aeaf390 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37594/0 (socket says 172.21.15.102:37594) 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.993+0000 7f1fecb26640 1 -- 172.21.15.102:0/3467122110 learned_addr learned my addr 172.21.15.102:0/3467122110 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:12.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fed327640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 0x56226b2772c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 0x56226b277d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 -- 172.21.15.102:0/3467122110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 msgr2=0x56226b277d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 0x56226b277d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 -- 172.21.15.102:0/3467122110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 msgr2=0x56226b2772c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 0x56226b2772c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fe5ffb640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 0x7f1fd00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 -- 172.21.15.102:0/3467122110 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226af3b650 con 0x56226aea71b0 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 0x56226b277d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fed327640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 0x56226b2772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 0x7f1fd00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80e48a0 tx=0x7f1fd80ef890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598c5768334d2029 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fe5ffb640 1 -- 172.21.15.102:0/18847474 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1fd80e7250 con 0x7f1fe8101f70 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fceffd640 1 -- 172.21.15.102:0/3467122110 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8020030 con 0x56226aea71b0 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fceffd640 1 -- 172.21.15.102:0/3467122110 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fd80acb40 con 0x56226aea71b0 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.994+0000 7f1fceffd640 1 -- 172.21.15.102:0/3467122110 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80ac980 con 0x56226aea71b0 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3467122110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 msgr2=0x56226b277800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80e48a0 tx=0x7f1fd80ef890 comp rx=0 tx=0).stop 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 0x7f1fd00b8bc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc005940 tx=0x7f1fdc0058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3467122110 shutdown_connections 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b277800 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aeaf390 0x56226b277d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3467122110 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aed0070 0x56226b2772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3467122110 >> 172.21.15.102:0/3467122110 conn(0x56226aec4460 msgr2=0x56226b2751b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3467122110 shutdown_connections 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.995+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3467122110 wait complete. 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 -- start start 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 Processor -- start 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aea71b0 0x56226b282950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b283410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56226b03e700 con 0x56226aeaf390 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56226b178160 con 0x56226aea71b0 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56226b285aa0 con 0x56226aed0070 2024-09-21T03:41:12.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1ff52fe740 10 client.0 _ll_register_callbacks cb 0x56226b1919e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37598/0 (socket says 172.21.15.102:37598) 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.996+0000 7f1fe7fff640 1 -- 172.21.15.102:0/4233186033 learned_addr learned my addr 172.21.15.102:0/4233186033 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fed327640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b283410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fecb26640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aea71b0 0x56226b282950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 -- 172.21.15.102:0/4233186033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 msgr2=0x56226b283410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b283410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 -- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aea71b0 msgr2=0x56226b282950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aea71b0 0x56226b282950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 -- 172.21.15.102:0/4233186033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226b1a5c90 con 0x56226aeaf390 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009900 tx=0x7f1fdc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b16a6ac2c1022 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:12.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc04c070 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1fdc0043d0 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fd80acb40 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.997+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1fdc058050 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 10 client.16785 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56226b291700 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fd80acb40 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1fdc03c710 con 0x56226aeaf390 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 10 client.16785 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 10 client.16785 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 20 client.16785 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae8e9f0 0x56226b294be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 4 client.16785 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:12.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56226b1efdf0 con 0x56226ae8e9f0 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.998+0000 7f1fecb26640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae8e9f0 0x56226b294be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.999+0000 7f1fc7fff640 10 client.16785 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.999+0000 7f1fecb26640 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae8e9f0 0x56226b294be0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a37ce8632d088a81 server_cookie=4aa43dab1f09a797 in_seq=0 out_seq=0 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.999+0000 7f1fc7fff640 1 -- 172.21.15.102:0/4233186033 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56226b1efdf0 con 0x56226ae8e9f0 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.999+0000 7f1fc7fff640 10 client.16785 handle_command_reply: tid=0 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:11.999+0000 7f1ff52fe740 1 client.16785 shutdown 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 msgr2=0x56226b282e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009900 tx=0x7f1fdc02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 shutdown_connections 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae8e9f0 0x56226b294be0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aeaf390 0x56226b282e90 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b283410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/4233186033 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aea71b0 0x56226b282950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 >> 172.21.15.102:0/4233186033 conn(0x56226aec4460 msgr2=0x56226b27a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1fc7fff640 0 client.16785 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:12.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 shutdown_connections 2024-09-21T03:41:12.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 1 -- 172.21.15.102:0/4233186033 wait complete. 2024-09-21T03:41:12.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.000+0000 7f1ff52fe740 20 client.16785 trim_cache size 0 max 16384 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 Processor -- start 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 -- start start 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b284580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b27fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81b2180 con 0x56226aea71b0 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81afa50 con 0x56226aeaf390 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81ad8c0 con 0x56226aed0070 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37606/0 (socket says 172.21.15.102:37606) 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 -- 172.21.15.102:0/760334355 learned_addr learned my addr 172.21.15.102:0/760334355 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b284580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 -- 172.21.15.102:0/760334355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 msgr2=0x56226b27fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b27fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 -- 172.21.15.102:0/760334355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 msgr2=0x56226b284580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.013+0000 7f1fecb26640 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b284580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fecb26640 1 -- 172.21.15.102:0/760334355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226b27a120 con 0x56226aea71b0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b284580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fecb26640 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80a9600 tx=0x7f1fd80d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbff208e656b22b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fce7fc640 1 -- 172.21.15.102:0/760334355 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8020040 con 0x56226aea71b0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fce7fc640 1 -- 172.21.15.102:0/760334355 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fd80eab70 con 0x56226aea71b0 2024-09-21T03:41:12.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.014+0000 7f1fce7fc640 1 -- 172.21.15.102:0/760334355 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80ac7a0 con 0x56226aea71b0 2024-09-21T03:41:12.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- 172.21.15.102:0/760334355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 msgr2=0x56226b278cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80a9600 tx=0x7f1fd80d0040 comp rx=0 tx=0).stop 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- 172.21.15.102:0/760334355 shutdown_connections 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aed0070 0x56226b27fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b284580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/760334355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aea71b0 0x56226b278cb0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- 172.21.15.102:0/760334355 >> 172.21.15.102:0/760334355 conn(0x56226aec4460 msgr2=0x56226b283e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- 172.21.15.102:0/760334355 shutdown_connections 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- 172.21.15.102:0/760334355 wait complete. 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 -- start start 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.015+0000 7f1ff52fe740 1 Processor -- start 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aea71b0 0x56226b286760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b286d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81adf10 con 0x56226aed0070 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81af380 con 0x56226aeaf390 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe81ae5e0 con 0x56226aea71b0 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 10 client.0 _ll_register_callbacks cb 0x7f1fdc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37614/0 (socket says 172.21.15.102:37614) 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 -- 172.21.15.102:0/3189614241 learned_addr learned my addr 172.21.15.102:0/3189614241 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aea71b0 0x56226b286760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b286d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 -- 172.21.15.102:0/3189614241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aea71b0 msgr2=0x56226b286760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aea71b0 0x56226b286760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 -- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 msgr2=0x56226b286d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b286d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 -- 172.21.15.102:0/3189614241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56226b28b200 con 0x56226aed0070 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fe7fff640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b286d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fed327640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0004a80 tx=0x7f1fe0010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c575f444703b127 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0003b80 con 0x56226aed0070 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1fe0003d20 con 0x56226aed0070 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.016+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fd80eab70 con 0x56226aed0070 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1fe0004050 con 0x56226aed0070 2024-09-21T03:41:12.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 10 client.16791 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56226b2ff060 con 0x56226aed0070 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1fd80eab70 con 0x56226aed0070 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1fe00238c0 con 0x56226aed0070 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 10 client.16791 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 10 client.16791 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 20 client.16791 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae63da0 0x56226b301880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 4 client.16791 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56226b1eb8a0 con 0x56226ae63da0 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.017+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae63da0 0x56226b301880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:12.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1fc7fff640 10 client.16791 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1fecb26640 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae63da0 0x56226b301880 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=beba73b08b1d5ef server_cookie=8db9cd7e0bdf3d57 in_seq=0 out_seq=0 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1fc7fff640 1 -- 172.21.15.102:0/3189614241 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56226b1eb8a0 con 0x56226ae63da0 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1fc7fff640 10 client.16791 handle_command_reply: tid=0 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 client.16791 shutdown 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 msgr2=0x56226b28ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0004a80 tx=0x7f1fe0010800 comp rx=0 tx=0).stop 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 shutdown_connections 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x56226ae63da0 0x56226b301880 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56226aed0070 0x56226b28ab90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56226aeaf390 0x56226b286d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1fc7fff640 0 client.16791 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:12.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 --2- 172.21.15.102:0/3189614241 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56226aea71b0 0x56226b286760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 >> 172.21.15.102:0/3189614241 conn(0x56226aec4460 msgr2=0x56226b278a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 shutdown_connections 2024-09-21T03:41:12.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.018+0000 7f1ff52fe740 1 -- 172.21.15.102:0/3189614241 wait complete. 2024-09-21T03:41:12.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1ff52fe740 20 client.16791 trim_cache size 0 max 16384 2024-09-21T03:41:12.028 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 msgr2=0x7f1fd00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 0x7f1fd00b8bc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc005940 tx=0x7f1fdc0058d0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 msgr2=0x7f1fe819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800d770 tx=0x7f1fd800dc30 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 shutdown_connections 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1fd00b66b0 0x7f1fd00b8bc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1fe8109e00 0x7f1fe819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1fe81094b0 0x7f1fe819ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 --2- 172.21.15.102:0/18847474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1fe8101f70 0x7f1fe819a570 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 >> 172.21.15.102:0/18847474 conn(0x7f1fe8077c60 msgr2=0x7f1fe8107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:12.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 shutdown_connections 2024-09-21T03:41:12.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:12.019+0000 7f1feed8a640 1 -- 172.21.15.102:0/18847474 wait complete. 2024-09-21T03:41:12.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:12 smithi102 ceph-mon[31392]: pgmap v556: 97 pgs: 97 active+clean; 183 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-21T03:41:12.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:12 smithi148 ceph-mon[34651]: pgmap v556: 97 pgs: 97 active+clean; 183 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-21T03:41:12.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:12 smithi121 ceph-mon[34316]: pgmap v556: 97 pgs: 97 active+clean; 183 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-09-21T03:41:12.921 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:41:13.170 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:13.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 -- 172.21.15.102:0/2743699726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4102ae0 msgr2=0x7f52f4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2743699726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4102ae0 0x7f52f4102ef0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009900 tx=0x7f52e402a410 comp rx=0 tx=0).stop 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 -- 172.21.15.102:0/2743699726 shutdown_connections 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2743699726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f4108d20 0x7f52f410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2743699726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f41083d0 0x7f52f41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2743699726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4102ae0 0x7f52f4102ef0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 -- 172.21.15.102:0/2743699726 >> 172.21.15.102:0/2743699726 conn(0x7f52f4079760 msgr2=0x7f52f4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 -- 172.21.15.102:0/2743699726 shutdown_connections 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 -- 172.21.15.102:0/2743699726 wait complete. 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.797+0000 7f52fa16f640 1 Processor -- start 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 -- start start 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f4102ae0 0x7f52f4199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f41083d0 0x7f52f41999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4112ab0 con 0x7f52f4108d20 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4112930 con 0x7f52f41083d0 2024-09-21T03:41:13.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52fa16f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4112c30 con 0x7f52f4102ae0 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37636/0 (socket says 172.21.15.102:37636) 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 -- 172.21.15.102:0/2488924624 learned_addr learned my addr 172.21.15.102:0/2488924624 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f41083d0 0x7f52f41999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f37fe640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f4102ae0 0x7f52f4199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 -- 172.21.15.102:0/2488924624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f4102ae0 msgr2=0x7f52f4199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f4102ae0 0x7f52f4199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 -- 172.21.15.102:0/2488924624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f41083d0 msgr2=0x7f52f41999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f41083d0 0x7f52f41999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.798+0000 7f52f3fff640 1 -- 172.21.15.102:0/2488924624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f419f370 con 0x7f52f4108d20 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52f3fff640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00cad0 tx=0x7f52ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52f0ff9640 1 -- 172.21.15.102:0/2488924624 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00ae20 con 0x7f52f4108d20 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f419f660 con 0x7f52f4108d20 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52f0ff9640 1 -- 172.21.15.102:0/2488924624 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52ec005020 con 0x7f52f4108d20 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52f0ff9640 1 -- 172.21.15.102:0/2488924624 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00f6b0 con 0x7f52f4108d20 2024-09-21T03:41:13.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.799+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f41a5dc0 con 0x7f52f4108d20 2024-09-21T03:41:13.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.802+0000 7f53006e3740 1 Processor -- start 2024-09-21T03:41:13.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.802+0000 7f52f0ff9640 1 -- 172.21.15.102:0/2488924624 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f52ec0051d0 con 0x7f52f4108d20 2024-09-21T03:41:13.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.802+0000 7f53006e3740 1 -- start start 2024-09-21T03:41:13.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 0x56430c88dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c88e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56430c803ea0 con 0x56430c4e6070 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56430c7f32d0 con 0x56430c4bd1b0 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f53006e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56430c7f70e0 con 0x56430c4c5390 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37644/0 (socket says 172.21.15.102:37644) 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 -- 172.21.15.102:0/73536362 learned_addr learned my addr 172.21.15.102:0/73536362 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f37fe640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 0x56430c88dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c88e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 -- 172.21.15.102:0/73536362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 msgr2=0x56430c88e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c88e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 -- 172.21.15.102:0/73536362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 msgr2=0x56430c88dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 0x56430c88dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f0ff9640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 0x7f52dc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 -- 172.21.15.102:0/73536362 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430c551650 con 0x56430c4e6070 2024-09-21T03:41:13.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f37fe640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 0x56430c88dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:13.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f0ff9640 1 -- 172.21.15.102:0/2488924624 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f52ec0e7800 con 0x7f52f4108d20 2024-09-21T03:41:13.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f52e80058a0 tx=0x7f52e800b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da40ea33ce9fbf65 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.803+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 0x7f52dc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.804+0000 7f52d9ffb640 1 -- 172.21.15.102:0/73536362 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e800f480 con 0x56430c4e6070 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.804+0000 7f52d9ffb640 1 -- 172.21.15.102:0/73536362 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52e800fd90 con 0x56430c4e6070 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.804+0000 7f52d9ffb640 1 -- 172.21.15.102:0/73536362 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e801e6a0 con 0x56430c4e6070 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- 172.21.15.102:0/73536362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 msgr2=0x56430c88d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f52e80058a0 tx=0x7f52e800b820 comp rx=0 tx=0).stop 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 0x7f52dc0b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52e801b000 tx=0x7f52e801e9a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- 172.21.15.102:0/73536362 shutdown_connections 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c88e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4bd1b0 0x56430c88dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 --2- 172.21.15.102:0/73536362 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4e6070 0x56430c88d6a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- 172.21.15.102:0/73536362 >> 172.21.15.102:0/73536362 conn(0x56430c4da460 msgr2=0x56430c88b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- 172.21.15.102:0/73536362 shutdown_connections 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- 172.21.15.102:0/73536362 wait complete. 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 -- start start 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.805+0000 7f53006e3740 1 Processor -- start 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4bd1b0 0x56430c898d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 0x56430c899780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56430c654700 con 0x56430c4c5390 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56430c78e160 con 0x56430c4e6070 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56430c89be80 con 0x56430c4bd1b0 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f53006e3740 10 client.0 _ll_register_callbacks cb 0x56430c7a79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37648/0 (socket says 172.21.15.102:37648) 2024-09-21T03:41:13.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 -- 172.21.15.102:0/3750484148 learned_addr learned my addr 172.21.15.102:0/3750484148 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f3fff640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 0x56430c899780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f37fe640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4bd1b0 0x56430c898d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 -- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4bd1b0 msgr2=0x56430c898d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4bd1b0 0x56430c898d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 -- 172.21.15.102:0/3750484148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 msgr2=0x56430c899780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 0x56430c899780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 -- 172.21.15.102:0/3750484148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430c7bbc90 con 0x56430c4c5390 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f3fff640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 0x56430c899780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f52e8012300 tx=0x7f52e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34b69d3eaf7defa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.806+0000 7f52d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e800f480 con 0x56430c4c5390 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f52e801e440 con 0x56430c4c5390 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52e800fd90 con 0x56430c4c5390 2024-09-21T03:41:13.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f52e8041050 con 0x56430c4c5390 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 10 client.16803 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56430c8a9d10 con 0x56430c4c5390 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52e800fd90 con 0x56430c4c5390 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f52e801e640 con 0x56430c4c5390 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 10 client.16803 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 20 client.16803 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4a49f0 0x56430c8ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 4 client.16803 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.807+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56430c805df0 con 0x56430c4a49f0 2024-09-21T03:41:13.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.808+0000 7f52f37fe640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4a49f0 0x56430c8ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.808+0000 7f52d2ffd640 10 client.16803 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:13.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.808+0000 7f52f37fe640 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4a49f0 0x56430c8ad180 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b923ed8ce709a41 server_cookie=6b3d57d263add098 in_seq=0 out_seq=0 2024-09-21T03:41:13.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f52d2ffd640 1 -- 172.21.15.102:0/3750484148 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56430c805df0 con 0x56430c4a49f0 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f52d2ffd640 10 client.16803 handle_command_reply: tid=0 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 client.16803 shutdown 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 msgr2=0x56430c899240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f52e8012300 tx=0x7f52e8017000 comp rx=0 tx=0).stop 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 shutdown_connections 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4a49f0 0x56430c8ad180 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4c5390 0x56430c899240 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f52d2ffd640 0 client.16803 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4e6070 0x56430c899780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 --2- 172.21.15.102:0/3750484148 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4bd1b0 0x56430c898d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 >> 172.21.15.102:0/3750484148 conn(0x56430c4da460 msgr2=0x56430c890880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 shutdown_connections 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 1 -- 172.21.15.102:0/3750484148 wait complete. 2024-09-21T03:41:13.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.809+0000 7f53006e3740 20 client.16803 trim_cache size 0 max 16384 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.822+0000 7f53006e3740 1 Processor -- start 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.822+0000 7f53006e3740 1 -- start start 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4a49f0 0x56430c89abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c8a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41aff40 con 0x56430c4bd1b0 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41ad810 con 0x56430c4a49f0 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f53006e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41ab680 con 0x56430c4c5390 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37654/0 (socket says 172.21.15.102:37654) 2024-09-21T03:41:13.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 -- 172.21.15.102:0/4058296337 learned_addr learned my addr 172.21.15.102:0/4058296337 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:13.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f37fe640 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4a49f0 0x56430c89abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 -- 172.21.15.102:0/4058296337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 msgr2=0x56430c8a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c8a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 -- 172.21.15.102:0/4058296337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4a49f0 msgr2=0x56430c89abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4a49f0 0x56430c89abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 -- 172.21.15.102:0/4058296337 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56430c890500 con 0x56430c4bd1b0 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f52e80124e0 tx=0x7f52e800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71452e52a4b557c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52d97fa640 1 -- 172.21.15.102:0/4058296337 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e801ee60 con 0x56430c4bd1b0 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.823+0000 7f52d97fa640 1 -- 172.21.15.102:0/4058296337 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52e8038070 con 0x56430c4bd1b0 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f52d97fa640 1 -- 172.21.15.102:0/4058296337 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8010670 con 0x56430c4bd1b0 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 -- 172.21.15.102:0/4058296337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 msgr2=0x56430c88e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f52e80124e0 tx=0x7f52e800bd40 comp rx=0 tx=0).stop 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 -- 172.21.15.102:0/4058296337 shutdown_connections 2024-09-21T03:41:13.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c88e6d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4c5390 0x56430c8a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 --2- 172.21.15.102:0/4058296337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4a49f0 0x56430c89abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 -- 172.21.15.102:0/4058296337 >> 172.21.15.102:0/4058296337 conn(0x56430c4da460 msgr2=0x56430c8a4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 -- 172.21.15.102:0/4058296337 shutdown_connections 2024-09-21T03:41:13.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.824+0000 7f53006e3740 1 -- 172.21.15.102:0/4058296337 wait complete. 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 -- start start 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 Processor -- start 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4a49f0 0x56430c8a1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4c5390 0x56430c89d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41abcd0 con 0x56430c4bd1b0 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41ad140 con 0x56430c4c5390 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41ac3a0 con 0x56430c4a49f0 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f53006e3740 10 client.0 _ll_register_callbacks cb 0x7f52e80123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:13.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.825+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37670/0 (socket says 172.21.15.102:37670) 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 -- 172.21.15.102:0/202474330 learned_addr learned my addr 172.21.15.102:0/202474330 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f3fff640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4c5390 0x56430c89d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f37fe640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4a49f0 0x56430c8a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 -- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4a49f0 msgr2=0x56430c8a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4a49f0 0x56430c8a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 -- 172.21.15.102:0/202474330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4c5390 msgr2=0x56430c89d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4c5390 0x56430c89d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 -- 172.21.15.102:0/202474330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56430c89db30 con 0x56430c4bd1b0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52f2ffd640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f52e800bfd0 tx=0x7f52e801ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24bc75cb0efb07f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e801e440 con 0x56430c4bd1b0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f52e801e5e0 con 0x56430c4bd1b0 2024-09-21T03:41:13.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.826+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52e8038070 con 0x56430c4bd1b0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f52e8010670 con 0x56430c4bd1b0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 10 client.16809 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56430c8a6350 con 0x56430c4bd1b0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f52e8038070 con 0x56430c4bd1b0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f52e8028b50 con 0x56430c4bd1b0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 10 client.16809 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 20 client.16809 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4e6070 0x56430c8a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 4 client.16809 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56430c8018a0 con 0x56430c4e6070 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.827+0000 7f52f37fe640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4e6070 0x56430c8a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:13.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f52d2ffd640 10 client.16809 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f52f37fe640 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4e6070 0x56430c8a6ae0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f67e3031d6b675 server_cookie=984d73ec28b7efa2 in_seq=0 out_seq=0 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f52d2ffd640 1 -- 172.21.15.102:0/202474330 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56430c8018a0 con 0x56430c4e6070 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f52d2ffd640 10 client.16809 handle_command_reply: tid=0 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 client.16809 shutdown 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 msgr2=0x56430c89ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f52e800bfd0 tx=0x7f52e801ee60 comp rx=0 tx=0).stop 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 shutdown_connections 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56430c4e6070 0x56430c8a6ae0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56430c4bd1b0 0x56430c89ce00 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56430c4c5390 0x56430c89d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 --2- 172.21.15.102:0/202474330 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56430c4a49f0 0x56430c8a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 >> 172.21.15.102:0/202474330 conn(0x56430c4da460 msgr2=0x56430c8a4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.828+0000 7f52d2ffd640 0 client.16809 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:13.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 shutdown_connections 2024-09-21T03:41:13.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f53006e3740 1 -- 172.21.15.102:0/202474330 wait complete. 2024-09-21T03:41:13.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f53006e3740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T03:41:13.835 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 msgr2=0x7f52dc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 0x7f52dc0b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52e801b000 tx=0x7f52e801e9a0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 msgr2=0x7f52f419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00cad0 tx=0x7f52ec00cf90 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 shutdown_connections 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f52dc0b6680 0x7f52dc0b8b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f52f4108d20 0x7f52f419ec40 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52f41083d0 0x7f52f41999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 --2- 172.21.15.102:0/2488924624 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f52f4102ae0 0x7f52f4199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 >> 172.21.15.102:0/2488924624 conn(0x7f52f4079760 msgr2=0x7f52f4101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 shutdown_connections 2024-09-21T03:41:13.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:13.829+0000 7f52fa16f640 1 -- 172.21.15.102:0/2488924624 wait complete. 2024-09-21T03:41:14.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:14 smithi148 ceph-mon[34651]: pgmap v557: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T03:41:14.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:14 smithi121 ceph-mon[34316]: pgmap v557: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T03:41:14.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:14 smithi102 ceph-mon[31392]: pgmap v557: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 13 KiB/s wr, 9 op/s 2024-09-21T03:41:15.506 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:41:15.506 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:41:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 -- 172.21.15.102:0/1288589456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 msgr2=0x7f1a4c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 --2- 172.21.15.102:0/1288589456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c1087b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f1a40009900 tx=0x7f1a4002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:16.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 -- 172.21.15.102:0/1288589456 shutdown_connections 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 --2- 172.21.15.102:0/1288589456 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c1087b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 --2- 172.21.15.102:0/1288589456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 --2- 172.21.15.102:0/1288589456 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 -- 172.21.15.102:0/1288589456 >> 172.21.15.102:0/1288589456 conn(0x7f1a4c079730 msgr2=0x7f1a4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 -- 172.21.15.102:0/1288589456 shutdown_connections 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.242+0000 7f1a52816640 1 -- 172.21.15.102:0/1288589456 wait complete. 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 Processor -- start 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 -- start start 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c19b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c112ae0 con 0x7f1a4c1083a0 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c112960 con 0x7f1a4c108cf0 2024-09-21T03:41:16.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a52816640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c112c60 con 0x7f1a4c102a60 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56576/0 (socket says 172.21.15.102:56576) 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/596044168 learned_addr learned my addr 172.21.15.102:0/596044168 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c19b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.243+0000 7f1a50db3640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/596044168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 msgr2=0x7f1a4c19b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c19b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/596044168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 msgr2=0x7f1a4c19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/596044168 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c1a6660 con 0x7f1a4c1083a0 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a50db3640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005940 tx=0x7f1a400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a497fa640 1 -- 172.21.15.102:0/596044168 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4003f030 con 0x7f1a4c1083a0 2024-09-21T03:41:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a497fa640 1 -- 172.21.15.102:0/596044168 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a40031910 con 0x7f1a4c1083a0 2024-09-21T03:41:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a497fa640 1 -- 172.21.15.102:0/596044168 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40035070 con 0x7f1a4c1083a0 2024-09-21T03:41:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c1a68f0 con 0x7f1a4c1083a0 2024-09-21T03:41:16.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.244+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1a6e00 con 0x7f1a4c1083a0 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a497fa640 1 -- 172.21.15.102:0/596044168 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1a40042030 con 0x7f1a4c1083a0 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 Processor -- start 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 -- start start 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc45f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc097670 0x55f2cc45feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc3d5e60 con 0x55f2cc0b8350 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc3c5290 con 0x55f2cc08f490 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc3c90a0 con 0x55f2cc097670 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56588/0 (socket says 172.21.15.102:56588) 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 -- 172.21.15.102:0/1392946342 learned_addr learned my addr 172.21.15.102:0/1392946342 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc45f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 -- 172.21.15.102:0/1392946342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc097670 msgr2=0x55f2cc45feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc097670 0x55f2cc45feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 -- 172.21.15.102:0/1392946342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 msgr2=0x55f2cc45f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc45f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.247+0000 7f1a50db3640 1 -- 172.21.15.102:0/1392946342 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2cc123930 con 0x55f2cc0b8350 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a497fa640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 0x7f1a340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a50db3640 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fb0 tx=0x7f1a44010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4810911bcf0c54f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 0x7f1a340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a497fa640 1 -- 172.21.15.102:0/596044168 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1a40107970 con 0x7f1a4c1083a0 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a327fc640 1 -- 172.21.15.102:0/1392946342 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44016070 con 0x55f2cc0b8350 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a327fc640 1 -- 172.21.15.102:0/1392946342 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a44012be0 con 0x55f2cc0b8350 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.248+0000 7f1a327fc640 1 -- 172.21.15.102:0/1392946342 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4401bce0 con 0x55f2cc0b8350 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1392946342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 msgr2=0x55f2cc45f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 0x7f1a340b8bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f2cc45e0b0 tx=0x7f1a3c008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1a44009fb0 tx=0x7f1a44010800 comp rx=0 tx=0).stop 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1392946342 shutdown_connections 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc097670 0x55f2cc45feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc45f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1392946342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc0b8350 0x55f2cc45f430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1392946342 >> 172.21.15.102:0/1392946342 conn(0x55f2cc0ac740 msgr2=0x55f2cc45d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1392946342 shutdown_connections 2024-09-21T03:41:16.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1392946342 wait complete. 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.249+0000 7f1a58d8a740 1 -- start start 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 Processor -- start 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 0x55f2cc46b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc476f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc226890 con 0x55f2cc08f490 2024-09-21T03:41:16.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc35fd40 con 0x55f2cc097670 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f2cc46dc10 con 0x55f2cc0b8350 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a58d8a740 10 client.0 _ll_register_callbacks cb 0x55f2cc3c3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56598/0 (socket says 172.21.15.102:56598) 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4bfff640 1 -- 172.21.15.102:0/3501014792 learned_addr learned my addr 172.21.15.102:0/3501014792 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 0x55f2cc46b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a50db3640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc476f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4bfff640 1 -- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 msgr2=0x55f2cc476f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.250+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc476f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a4bfff640 1 -- 172.21.15.102:0/3501014792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 msgr2=0x55f2cc46b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 0x55f2cc46b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a4bfff640 1 -- 172.21.15.102:0/3501014792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2cc477540 con 0x55f2cc08f490 2024-09-21T03:41:16.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 0x55f2cc46b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ef20 tx=0x7f1a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b03c056ba827b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c025060 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1a3c015d20 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a44012be0 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1a3c00f040 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a58d8a740 10 client.16821 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f2cc479ed0 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a44012be0 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.251+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1a3c012030 con 0x55f2cc08f490 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 10 client.16821 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 10 client.16821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 20 client.16821 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:16.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc076cd0 0x55f2cc47d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 4 client.16821 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2cc3d7db0 con 0x55f2cc076cd0 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc076cd0 0x55f2cc47d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a2b7fe640 10 client.16821 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.252+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc076cd0 0x55f2cc47d450 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fea51ab7186976e2 server_cookie=f73129c39c98ecb4 in_seq=0 out_seq=0 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/3501014792 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2cc3d7db0 con 0x55f2cc076cd0 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a2b7fe640 10 client.16821 handle_command_reply: tid=0 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 client.16821 shutdown 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 msgr2=0x55f2cc46b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00ef20 tx=0x7f1a3c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 shutdown_connections 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc476f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc097670 0x55f2cc46b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.253+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc076cd0 0x55f2cc47d450 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3501014792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc08f490 0x55f2cc46b0a0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 >> 172.21.15.102:0/3501014792 conn(0x55f2cc0ac740 msgr2=0x55f2cc462610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a2b7fe640 0 client.16821 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 shutdown_connections 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3501014792 wait complete. 2024-09-21T03:41:16.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.254+0000 7f1a58d8a740 20 client.16821 trim_cache size 0 max 16384 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.271+0000 7f1a58d8a740 1 Processor -- start 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.271+0000 7f1a58d8a740 1 -- start start 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc476e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc4737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1b2320 con 0x55f2cc097670 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1afbf0 con 0x55f2cc08f490 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1ada60 con 0x55f2cc0b8350 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56610/0 (socket says 172.21.15.102:56610) 2024-09-21T03:41:16.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/3451175219 learned_addr learned my addr 172.21.15.102:0/3451175219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a50db3640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc4737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc476e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/3451175219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 msgr2=0x55f2cc4737b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc4737b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/3451175219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 msgr2=0x55f2cc476e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc476e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/3451175219 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2cc477370 con 0x55f2cc097670 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a50db3640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc4737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc476e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.272+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1a401050b0 tx=0x7f1a4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf19677a7d808c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a31ffb640 1 -- 172.21.15.102:0/3451175219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40049040 con 0x55f2cc097670 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a31ffb640 1 -- 172.21.15.102:0/3451175219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a400c7e50 con 0x55f2cc097670 2024-09-21T03:41:16.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a31ffb640 1 -- 172.21.15.102:0/3451175219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400c99c0 con 0x55f2cc097670 2024-09-21T03:41:16.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3451175219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 msgr2=0x55f2cc473270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1a401050b0 tx=0x7f1a4002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3451175219 shutdown_connections 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc473270 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc4737b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/3451175219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc476e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3451175219 >> 172.21.15.102:0/3451175219 conn(0x55f2cc0ac740 msgr2=0x55f2cc469720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.273+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3451175219 shutdown_connections 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 -- 172.21.15.102:0/3451175219 wait complete. 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 -- start start 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 Processor -- start 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc4830b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc481e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1ae0b0 con 0x55f2cc097670 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1af520 con 0x55f2cc08f490 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.274+0000 7f1a58d8a740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c1ae780 con 0x55f2cc0b8350 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a58d8a740 10 client.0 _ll_register_callbacks cb 0x7f1a3c009160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56620/0 (socket says 172.21.15.102:56620) 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/1654372937 learned_addr learned my addr 172.21.15.102:0/1654372937 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc4830b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a50db3640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc481e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 msgr2=0x55f2cc481e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc481e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/1654372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 msgr2=0x55f2cc4830b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:16.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc4830b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 -- 172.21.15.102:0/1654372937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2cc4825a0 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a50db3640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc481e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a4b7fe640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a40105100 tx=0x7f1a40105580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e676809143beb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a400f3020 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8630+0+0 (secure 0 0 0) 0x7f1a400d6ce0 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a400c7e50 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1a40049070 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a58d8a740 10 client.16827 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.275+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f2cc4eca20 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1a400c7e50 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1a4003bb80 con 0x55f2cc097670 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 10 client.16827 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:16.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 20 client.16827 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc04c080 0x55f2cc4ef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 4 client.16827 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f2cc3d3860 con 0x55f2cc04c080 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.276+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc04c080 0x55f2cc4ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.277+0000 7f1a2b7fe640 10 client.16827 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:16.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.277+0000 7f1a4bfff640 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc04c080 0x55f2cc4ef170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26b00bc7c4eb2926 server_cookie=9301087685a37816 in_seq=0 out_seq=0 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.278+0000 7f1a2b7fe640 1 -- 172.21.15.102:0/1654372937 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f2cc3d3860 con 0x55f2cc04c080 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.278+0000 7f1a2b7fe640 10 client.16827 handle_command_reply: tid=0 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.278+0000 7f1a58d8a740 1 client.16827 shutdown 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 msgr2=0x55f2cc483670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1a40105100 tx=0x7f1a40105580 comp rx=0 tx=0).stop 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 shutdown_connections 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f2cc04c080 0x55f2cc4ef170 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f2cc097670 0x55f2cc483670 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f2cc0b8350 0x55f2cc481e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 --2- 172.21.15.102:0/1654372937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f2cc08f490 0x55f2cc4830b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 >> 172.21.15.102:0/1654372937 conn(0x55f2cc0ac740 msgr2=0x55f2cc462530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a2b7fe640 0 client.16827 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 shutdown_connections 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 1 -- 172.21.15.102:0/1654372937 wait complete. 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a58d8a740 20 client.16827 trim_cache size 0 max 16384 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "d42d22a0-5955-4519-b56a-79aecad6530d", 2024-09-21T03:41:16.285 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:41:16.286 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:16.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 msgr2=0x7f1a340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 0x7f1a340b8bc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55f2cc45e0b0 tx=0x7f1a3c008040 comp rx=0 tx=0).stop 2024-09-21T03:41:16.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 msgr2=0x7f1a4c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:16.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.279+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f1a40005940 tx=0x7f1a400042f0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 shutdown_connections 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1a340b66b0 0x7f1a340b8bc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a4c1083a0 0x7f1a4c19b910 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a4c108cf0 0x7f1a4c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 --2- 172.21.15.102:0/596044168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1a4c102a60 0x7f1a4c19b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 >> 172.21.15.102:0/596044168 conn(0x7f1a4c079730 msgr2=0x7f1a4c105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 shutdown_connections 2024-09-21T03:41:16.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:16.280+0000 7f1a52816640 1 -- 172.21.15.102:0/596044168 wait complete. 2024-09-21T03:41:16.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:16 smithi148 ceph-mon[34651]: pgmap v558: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:41:16.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:16 smithi121 ceph-mon[34316]: pgmap v558: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:41:16.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:16 smithi102 ceph-mon[31392]: pgmap v558: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:41:17.095 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:41:17.342 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:17.742 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:41:17.743 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.743 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:41:17.743 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.743 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:41:17.743 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:17 smithi102 ceph-mon[31392]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:41:17.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:17 smithi148 ceph-mon[34651]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:41:17.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:41:17.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:41:17.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:17.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:41:17.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:17 smithi121 ceph-mon[34316]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T03:41:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 -- 172.21.15.102:0/1098866346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 msgr2=0x7facc81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 --2- 172.21.15.102:0/1098866346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc81098b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7facb8009900 tx=0x7facb802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 -- 172.21.15.102:0/1098866346 shutdown_connections 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 --2- 172.21.15.102:0/1098866346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc81098b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 --2- 172.21.15.102:0/1098866346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8109df0 0x7facc8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 --2- 172.21.15.102:0/1098866346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8103b60 0x7facc8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 -- 172.21.15.102:0/1098866346 >> 172.21.15.102:0/1098866346 conn(0x7facc807b850 msgr2=0x7facc807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 -- 172.21.15.102:0/1098866346 shutdown_connections 2024-09-21T03:41:17.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.842+0000 7facd07d9640 1 -- 172.21.15.102:0/1098866346 wait complete. 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 Processor -- start 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 -- start start 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 0x7facc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8109df0 0x7facc8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7facc8113bd0 con 0x7facc81094a0 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facc8113a50 con 0x7facc8103b60 2024-09-21T03:41:17.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facd07d9640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7facc8113d50 con 0x7facc8109df0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facce575640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 0x7facc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56634/0 (socket says 172.21.15.102:56634) 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facce575640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 0x7facc8075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:55560/0 (socket says 172.21.15.102:55560) 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 -- 172.21.15.102:0/4096106484 learned_addr learned my addr 172.21.15.102:0/4096106484 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7facced76640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8109df0 0x7facc8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 -- 172.21.15.102:0/4096106484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8109df0 msgr2=0x7facc8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8109df0 0x7facc8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 -- 172.21.15.102:0/4096106484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 msgr2=0x7facc8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 0x7facc8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.843+0000 7faccdd74640 1 -- 172.21.15.102:0/4096106484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc81a8880 con 0x7facc81094a0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7faccdd74640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7facb8005940 tx=0x7facb8004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7facbf7fe640 1 -- 172.21.15.102:0/4096106484 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb803f030 con 0x7facc81094a0 2024-09-21T03:41:17.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc81a8b10 con 0x7facc81094a0 2024-09-21T03:41:17.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7facbf7fe640 1 -- 172.21.15.102:0/4096106484 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facb8003cd0 con 0x7facc81094a0 2024-09-21T03:41:17.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7facbf7fe640 1 -- 172.21.15.102:0/4096106484 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb8035070 con 0x7facc81094a0 2024-09-21T03:41:17.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.844+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81a9040 con 0x7facc81094a0 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 Processor -- start 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 -- start start 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facbf7fe640 1 -- 172.21.15.102:0/4096106484 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7facb8042030 con 0x7facc81094a0 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e601907b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e60190cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559e60106e50 con 0x559e5fde9070 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559e600f6280 con 0x559e5fdc01b0 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facd6d4d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559e600fa090 con 0x559e5fdc8390 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56646/0 (socket says 172.21.15.102:56646) 2024-09-21T03:41:17.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.847+0000 7facced76640 1 -- 172.21.15.102:0/2503904901 learned_addr learned my addr 172.21.15.102:0/2503904901 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facce575640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e601907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7faccdd74640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e60190cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 -- 172.21.15.102:0/2503904901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 msgr2=0x559e60190cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e60190cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 -- 172.21.15.102:0/2503904901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 msgr2=0x559e601907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e601907b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 -- 172.21.15.102:0/2503904901 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e5fe54650 con 0x559e5fde9070 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7faccdd74640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e60190cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facced76640 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7facc000ae90 tx=0x7facc000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6311846199cfd68c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facbcff9640 1 -- 172.21.15.102:0/2503904901 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0003b70 con 0x559e5fde9070 2024-09-21T03:41:17.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facbf7fe640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 0x7facb40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facbcff9640 1 -- 172.21.15.102:0/2503904901 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facc0003d10 con 0x559e5fde9070 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facbcff9640 1 -- 172.21.15.102:0/2503904901 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0010ba0 con 0x559e5fde9070 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facce575640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 0x7facb40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.848+0000 7facbf7fe640 1 -- 172.21.15.102:0/4096106484 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7facb8107a00 con 0x7facc81094a0 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 -- 172.21.15.102:0/2503904901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 msgr2=0x559e60190270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facce575640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 0x7facb40b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x559e6018eef0 tx=0x7facc400a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7facc000ae90 tx=0x7facc000f790 comp rx=0 tx=0).stop 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 -- 172.21.15.102:0/2503904901 shutdown_connections 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e60190cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e601907b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2503904901 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e60190270 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 -- 172.21.15.102:0/2503904901 >> 172.21.15.102:0/2503904901 conn(0x559e5fddd460 msgr2=0x559e6018e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 -- 172.21.15.102:0/2503904901 shutdown_connections 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.849+0000 7facd6d4d740 1 -- 172.21.15.102:0/2503904901 wait complete. 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 -- start start 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 Processor -- start 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559e5ff57700 con 0x559e5fde9070 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559e60091110 con 0x559e5fdc01b0 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559e6019ea50 con 0x559e5fdc8390 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facd6d4d740 10 client.0 _ll_register_callbacks cb 0x559e600aa990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56660/0 (socket says 172.21.15.102:56660) 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facced76640 1 -- 172.21.15.102:0/331075917 learned_addr learned my addr 172.21.15.102:0/331075917 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:17.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7faccdd74640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.850+0000 7facce575640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 -- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 msgr2=0x559e6019be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 -- 172.21.15.102:0/331075917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 msgr2=0x559e6019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 -- 172.21.15.102:0/331075917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e600bec40 con 0x559e5fde9070 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facced76640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7facc0010880 tx=0x7facc0010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bde93d0f4058f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:17.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc001d040 con 0x559e5fde9070 2024-09-21T03:41:17.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7facc0010dc0 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc0003d10 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7facc002f050 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facd6d4d740 10 client.16839 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e601aa6c0 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.851+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facc0003d10 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7facc00187e0 con 0x559e5fde9070 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 10 client.16839 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 20 client.16839 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fda79f0 0x559e601adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 4 client.16839 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e60108da0 con 0x559e5fda79f0 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.852+0000 7facce575640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fda79f0 0x559e601adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.853+0000 7facb1ffb640 10 client.16839 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:17.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.853+0000 7facce575640 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fda79f0 0x559e601adad0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf2489ad9306f99e server_cookie=cbdbdfbc710f8396 in_seq=0 out_seq=0 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.853+0000 7facb1ffb640 1 -- 172.21.15.102:0/331075917 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559e60108da0 con 0x559e5fda79f0 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.853+0000 7facb1ffb640 10 client.16839 handle_command_reply: tid=0 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.853+0000 7facd6d4d740 1 client.16839 shutdown 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 msgr2=0x559e601a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7facc0010880 tx=0x7facc0010bd0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 shutdown_connections 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fda79f0 0x559e601adad0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a7d70 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 --2- 172.21.15.102:0/331075917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 >> 172.21.15.102:0/331075917 conn(0x559e5fddd460 msgr2=0x559e60193450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facb1ffb640 0 client.16839 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 shutdown_connections 2024-09-21T03:41:17.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 1 -- 172.21.15.102:0/331075917 wait complete. 2024-09-21T03:41:17.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.854+0000 7facd6d4d740 20 client.16839 trim_cache size 0 max 16384 2024-09-21T03:41:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 Processor -- start 2024-09-21T03:41:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 -- start start 2024-09-21T03:41:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fde9070 0x559e60198b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b43a0 con 0x559e5fdc01b0 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b1c70 con 0x559e5fde9070 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facd6d4d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7facc81afae0 con 0x559e5fdc8390 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.871+0000 7facce575640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56674/0 (socket says 172.21.15.102:56674) 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 -- 172.21.15.102:0/2914836615 learned_addr learned my addr 172.21.15.102:0/2914836615 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7faccdd74640 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 -- 172.21.15.102:0/2914836615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 msgr2=0x559e6019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 -- 172.21.15.102:0/2914836615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fde9070 msgr2=0x559e60198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fde9070 0x559e60198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 -- 172.21.15.102:0/2914836615 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e6019c9e0 con 0x559e5fdc01b0 2024-09-21T03:41:17.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facce575640 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7facc8077160 tx=0x7facc4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f57aa56eb8223f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facb3fff640 1 -- 172.21.15.102:0/2914836615 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4004220 con 0x559e5fdc01b0 2024-09-21T03:41:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facb3fff640 1 -- 172.21.15.102:0/2914836615 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facc40043c0 con 0x559e5fdc01b0 2024-09-21T03:41:17.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.872+0000 7facb3fff640 1 -- 172.21.15.102:0/2914836615 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4003d20 con 0x559e5fdc01b0 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- 172.21.15.102:0/2914836615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 msgr2=0x559e6019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7facc8077160 tx=0x7facc4015000 comp rx=0 tx=0).stop 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- 172.21.15.102:0/2914836615 shutdown_connections 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fde9070 0x559e60198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e6019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 --2- 172.21.15.102:0/2914836615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fdc01b0 0x559e6019b6f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- 172.21.15.102:0/2914836615 >> 172.21.15.102:0/2914836615 conn(0x559e5fddd460 msgr2=0x559e6019a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- 172.21.15.102:0/2914836615 shutdown_connections 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- 172.21.15.102:0/2914836615 wait complete. 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 -- start start 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.873+0000 7facd6d4d740 1 Processor -- start 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e601a0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b0130 con 0x559e5fde9070 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b15a0 con 0x559e5fdc01b0 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7facc81b0800 con 0x559e5fdc8390 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facd6d4d740 10 client.0 _ll_register_callbacks cb 0x7facc000ace0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56684/0 (socket says 172.21.15.102:56684) 2024-09-21T03:41:17.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 -- 172.21.15.102:0/716653452 learned_addr learned my addr 172.21.15.102:0/716653452 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facce575640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7faccdd74640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e601a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 -- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 msgr2=0x559e601a0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e601a0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 -- 172.21.15.102:0/716653452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 msgr2=0x559e6019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 -- 172.21.15.102:0/716653452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e602173d0 con 0x559e5fde9070 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facced76640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7facc000fc90 tx=0x7facc00108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61db33dc74e83e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.874+0000 7facb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0010660 con 0x559e5fde9070 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7facc0027040 con 0x559e5fde9070 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facc40043c0 con 0x559e5fde9070 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7facc0010b30 con 0x559e5fde9070 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 10 client.16845 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:17.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559e60218660 con 0x559e5fde9070 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7facc40043c0 con 0x559e5fde9070 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7facc0018710 con 0x559e5fde9070 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 10 client.16845 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 20 client.16845 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fd7cda0 0x559e6021ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 4 client.16845 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.875+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559e60193f90 con 0x559e5fd7cda0 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facce575640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fd7cda0 0x559e6021ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facb1ffb640 10 client.16845 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facce575640 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fd7cda0 0x559e6021ae40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55b1b092b2b9a1fe server_cookie=d940700ac5f97384 in_seq=0 out_seq=0 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facb1ffb640 1 -- 172.21.15.102:0/716653452 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x559e60193f90 con 0x559e5fd7cda0 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facb1ffb640 10 client.16845 handle_command_reply: tid=0 2024-09-21T03:41:17.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.876+0000 7facd6d4d740 1 client.16845 shutdown 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 msgr2=0x559e601a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7facc000fc90 tx=0x7facc00108b0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 shutdown_connections 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x559e5fd7cda0 0x559e6021ae40 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facb1ffb640 0 client.16845 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559e5fde9070 0x559e601a0890 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559e5fdc8390 0x559e601a0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 --2- 172.21.15.102:0/716653452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559e5fdc01b0 0x559e6019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 >> 172.21.15.102:0/716653452 conn(0x559e5fddd460 msgr2=0x559e6019b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 shutdown_connections 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 1 -- 172.21.15.102:0/716653452 wait complete. 2024-09-21T03:41:17.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd6d4d740 20 client.16845 trim_cache size 0 max 16384 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.884 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.885 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:41:17.886 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.887 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.889 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.890 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:17.891 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 msgr2=0x7facb40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 0x7facb40b8b90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x559e6018eef0 tx=0x7facc400a250 comp rx=0 tx=0).stop 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 msgr2=0x7facc8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7facb8005940 tx=0x7facb8004360 comp rx=0 tx=0).stop 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 shutdown_connections 2024-09-21T03:41:17.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7facb40b6680 0x7facb40b8b90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7facc81094a0 0x7facc8075c50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7facc8109df0 0x7facc8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 --2- 172.21.15.102:0/4096106484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facc8103b60 0x7facc8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.877+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 >> 172.21.15.102:0/4096106484 conn(0x7facc807b850 msgr2=0x7facc8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.878+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 shutdown_connections 2024-09-21T03:41:17.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:17.878+0000 7facd07d9640 1 -- 172.21.15.102:0/4096106484 wait complete. 2024-09-21T03:41:18.592 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:41:18.593 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:18.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:18 smithi148 ceph-mon[34651]: pgmap v560: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:18.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:18 smithi121 ceph-mon[34316]: pgmap v560: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:18.842 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:18.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:18 smithi102 ceph-mon[31392]: pgmap v560: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 -- 172.21.15.102:0/890605414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce81083e0 msgr2=0x7fcce81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 --2- 172.21.15.102:0/890605414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce81083e0 0x7fcce81087f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009900 tx=0x7fccd002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 -- 172.21.15.102:0/890605414 shutdown_connections 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 --2- 172.21.15.102:0/890605414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce81083e0 0x7fcce81087f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 --2- 172.21.15.102:0/890605414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 0x7fcce810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 --2- 172.21.15.102:0/890605414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce8102aa0 0x7fcce8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 -- 172.21.15.102:0/890605414 >> 172.21.15.102:0/890605414 conn(0x7fcce80797e0 msgr2=0x7fcce8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 -- 172.21.15.102:0/890605414 shutdown_connections 2024-09-21T03:41:19.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.324+0000 7fccee31e640 1 -- 172.21.15.102:0/890605414 wait complete. 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 Processor -- start 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 -- start start 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce81083e0 0x7fcce819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 0x7fcce819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8112b20 con 0x7fcce8102aa0 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81129a0 con 0x7fcce81083e0 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccee31e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8112ca0 con 0x7fcce8108d30 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fcce7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56696/0 (socket says 172.21.15.102:56696) 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fcce7fff640 1 -- 172.21.15.102:0/511225092 learned_addr learned my addr 172.21.15.102:0/511225092 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccdffff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce81083e0 0x7fcce819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.325+0000 7fccec8bb640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 0x7fcce819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:19.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 -- 172.21.15.102:0/511225092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 msgr2=0x7fcce819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 0x7fcce819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 -- 172.21.15.102:0/511225092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce81083e0 msgr2=0x7fcce819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce81083e0 0x7fcce819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 -- 172.21.15.102:0/511225092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce81a6690 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce7fff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d950 tx=0x7fccd800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8017070 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fccd8009c30 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce81a6980 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd800f6b0 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.326+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce81a6f10 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.327+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce8102eb0 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.328+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fccd80109c0 con 0x7fcce8102aa0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.329+0000 7fcce5ffb640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 0x7fccd40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.329+0000 7fccdffff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 0x7fccd40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:19.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.329+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fccd80e73f0 con 0x7fcce8102aa0 2024-09-21T03:41:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.330+0000 7fccdffff640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 0x7fccd40b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fccd00314b0 tx=0x7fccd00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:19.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.334+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fccd8009de0 con 0x7fcce8102aa0 2024-09-21T03:41:19.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.550+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcce802e640 con 0x7fcce8102aa0 2024-09-21T03:41:19.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.551+0000 7fcce5ffb640 1 -- 172.21.15.102:0/511225092 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7fccd80ad900 con 0x7fcce8102aa0 2024-09-21T03:41:19.554 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:41:19.554 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:41:19.554 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 msgr2=0x7fccd40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 0x7fccd40b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fccd00314b0 tx=0x7fccd00058d0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 msgr2=0x7fcce819b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fccd800d950 tx=0x7fccd800de10 comp rx=0 tx=0).stop 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 shutdown_connections 2024-09-21T03:41:19.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fccd40b6680 0x7fccd40b8b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcce8108d30 0x7fcce819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcce81083e0 0x7fcce819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 --2- 172.21.15.102:0/511225092 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcce8102aa0 0x7fcce819b3d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 >> 172.21.15.102:0/511225092 conn(0x7fcce80797e0 msgr2=0x7fcce8105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 shutdown_connections 2024-09-21T03:41:19.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:19.553+0000 7fccee31e640 1 -- 172.21.15.102:0/511225092 wait complete. 2024-09-21T03:41:19.883 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:19 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/511225092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:19.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:19 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/511225092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:20.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:19 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/511225092' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:20.178 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:41:20.422 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:20.872 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:20 smithi102 ceph-mon[31392]: pgmap v561: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 -- 172.21.15.102:0/525891698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 msgr2=0x7f47901106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 --2- 172.21.15.102:0/525891698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f47901106f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f4788009ca0 tx=0x7f478802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 -- 172.21.15.102:0/525891698 shutdown_connections 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 --2- 172.21.15.102:0/525891698 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f47901106f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 --2- 172.21.15.102:0/525891698 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790109570 0x7f4790109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 --2- 172.21.15.102:0/525891698 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790103c30 0x7f4790104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 -- 172.21.15.102:0/525891698 >> 172.21.15.102:0/525891698 conn(0x7f479007b8d0 msgr2=0x7f479007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 -- 172.21.15.102:0/525891698 shutdown_connections 2024-09-21T03:41:20.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.876+0000 7f47977c4640 1 -- 172.21.15.102:0/525891698 wait complete. 2024-09-21T03:41:20.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 Processor -- start 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 -- start start 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790103c30 0x7f479019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790109570 0x7f479019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4790113c90 con 0x7f4790109ec0 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4790113b10 con 0x7f4790109570 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f47977c4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f4790113e10 con 0x7f4790103c30 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f4795d61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f4795d61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56716/0 (socket says 172.21.15.102:56716) 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f4795d61640 1 -- 172.21.15.102:0/801765555 learned_addr learned my addr 172.21.15.102:0/801765555 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f4794d5f640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790109570 0x7f479019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.877+0000 7f4795560640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790103c30 0x7f479019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 -- 172.21.15.102:0/801765555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790103c30 msgr2=0x7f479019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790103c30 0x7f479019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 -- 172.21.15.102:0/801765555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790109570 msgr2=0x7f479019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790109570 0x7f479019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 -- 172.21.15.102:0/801765555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47901a05b0 con 0x7f4790109ec0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f4795d61640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4788009dc0 tx=0x7f4788003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f47867fc640 1 -- 172.21.15.102:0/801765555 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788004040 con 0x7f4790109ec0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f47867fc640 1 -- 172.21.15.102:0/801765555 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f47880046b0 con 0x7f4790109ec0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47901a0840 con 0x7f4790109ec0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f47867fc640 1 -- 172.21.15.102:0/801765555 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4788030d90 con 0x7f4790109ec0 2024-09-21T03:41:20.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.878+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47901a7000 con 0x7f4790109ec0 2024-09-21T03:41:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 Processor -- start 2024-09-21T03:41:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f47867fc640 1 -- 172.21.15.102:0/801765555 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f47880305e0 con 0x7f4790109ec0 2024-09-21T03:41:20.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 -- start start 2024-09-21T03:41:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8d3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b848ea0 con 0x55dc6b5021b0 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b8382d0 con 0x55dc6b52b070 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f479dd38740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b83c0e0 con 0x55dc6b50a390 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f4795560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f4795560640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56726/0 (socket says 172.21.15.102:56726) 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.881+0000 7f4795560640 1 -- 172.21.15.102:0/2819615103 learned_addr learned my addr 172.21.15.102:0/2819615103 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f47867fc640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 0x7f477c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8d3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 -- 172.21.15.102:0/2819615103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 msgr2=0x55dc6b8d3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795d61640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 0x7f477c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8d3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 -- 172.21.15.102:0/2819615103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 msgr2=0x55dc6b8d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 -- 172.21.15.102:0/2819615103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc6b596650 con 0x55dc6b5021b0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f47867fc640 1 -- 172.21.15.102:0/801765555 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f4788108b40 con 0x7f4790109ec0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795560640 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f478c009a70 tx=0x7f478c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a60ebcf18b5077 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f477b7fe640 1 -- 172.21.15.102:0/2819615103 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c017070 con 0x55dc6b5021b0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f477b7fe640 1 -- 172.21.15.102:0/2819615103 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f478c013470 con 0x55dc6b5021b0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f477b7fe640 1 -- 172.21.15.102:0/2819615103 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478c012630 con 0x55dc6b5021b0 2024-09-21T03:41:20.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.882+0000 7f4795d61640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 0x7f477c0b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4788106300 tx=0x7f478803d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 -- 172.21.15.102:0/2819615103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 msgr2=0x55dc6b8d2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f478c009a70 tx=0x7f478c009f30 comp rx=0 tx=0).stop 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 -- 172.21.15.102:0/2819615103 shutdown_connections 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d2be0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8d3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 --2- 172.21.15.102:0/2819615103 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 -- 172.21.15.102:0/2819615103 >> 172.21.15.102:0/2819615103 conn(0x55dc6b51f460 msgr2=0x55dc6b8d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 -- 172.21.15.102:0/2819615103 shutdown_connections 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.883+0000 7f479dd38740 1 -- 172.21.15.102:0/2819615103 wait complete. 2024-09-21T03:41:20.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 -- start start 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 Processor -- start 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b699700 con 0x55dc6b5021b0 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b7d3160 con 0x55dc6b52b070 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55dc6b8e0e80 con 0x55dc6b50a390 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f479dd38740 10 client.0 _ll_register_callbacks cb 0x55dc6b7ec9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56740/0 (socket says 172.21.15.102:56740) 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.884+0000 7f4794d5f640 1 -- 172.21.15.102:0/2365412081 learned_addr learned my addr 172.21.15.102:0/2365412081 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4795560640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 -- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 msgr2=0x55dc6b8de2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8de2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 -- 172.21.15.102:0/2365412081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 msgr2=0x55dc6b8ea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8ea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 -- 172.21.15.102:0/2365412081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc6b800c90 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ea0 tx=0x7f4780009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19154f1f27dcb68 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4778ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780014b10 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f4780014cb0 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f478c013470 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f47800059c0 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f479dd38740 10 client.16863 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.885+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dc6b8ecc00 con 0x55dc6b5021b0 2024-09-21T03:41:20.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f478c013470 con 0x55dc6b5021b0 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f47800064f0 con 0x55dc6b5021b0 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 10 client.16863 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 10 client.16863 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 20 client.16863 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4e99f0 0x55dc6b8f0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 4 client.16863 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc6b84adf0 con 0x55dc6b4e99f0 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.886+0000 7f4795560640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4e99f0 0x55dc6b8f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.887+0000 7f4778ff9640 10 client.16863 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:20.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.887+0000 7f4795560640 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4e99f0 0x55dc6b8f0130 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39cf4e1dcae6ad45 server_cookie=e7420e5926737013 in_seq=0 out_seq=0 2024-09-21T03:41:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.887+0000 7f4778ff9640 1 -- 172.21.15.102:0/2365412081 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc6b84adf0 con 0x55dc6b4e99f0 2024-09-21T03:41:20.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.887+0000 7f4778ff9640 10 client.16863 handle_command_reply: tid=0 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.887+0000 7f479dd38740 1 client.16863 shutdown 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 msgr2=0x55dc6b8ddd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ea0 tx=0x7f4780009730 comp rx=0 tx=0).stop 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 shutdown_connections 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4e99f0 0x55dc6b8f0130 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8ea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8de2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 --2- 172.21.15.102:0/2365412081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8ddd70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 >> 172.21.15.102:0/2365412081 conn(0x55dc6b51f460 msgr2=0x55dc6b8d5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f4778ff9640 0 client.16863 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 shutdown_connections 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 1 -- 172.21.15.102:0/2365412081 wait complete. 2024-09-21T03:41:20.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.888+0000 7f479dd38740 20 client.16863 trim_cache size 0 max 16384 2024-09-21T03:41:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 Processor -- start 2024-09-21T03:41:20.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 -- start start 2024-09-21T03:41:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47901b2300 con 0x55dc6b5021b0 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47901afbd0 con 0x55dc6b52b070 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f479dd38740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47901ada40 con 0x55dc6b50a390 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56744/0 (socket says 172.21.15.102:56744) 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 -- 172.21.15.102:0/2264300541 learned_addr learned my addr 172.21.15.102:0/2264300541 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4795560640 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 -- 172.21.15.102:0/2264300541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 msgr2=0x55dc6b8cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 -- 172.21.15.102:0/2264300541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 msgr2=0x55dc6b8d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4794d5f640 1 -- 172.21.15.102:0/2264300541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc6b8d89d0 con 0x55dc6b5021b0 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.901+0000 7f4795560640 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.902+0000 7f4794d5f640 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f47800093c0 tx=0x7f478000afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab91ba8c2a984da5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.902+0000 7f477affd640 1 -- 172.21.15.102:0/2264300541 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780014b10 con 0x55dc6b5021b0 2024-09-21T03:41:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.902+0000 7f477affd640 1 -- 172.21.15.102:0/2264300541 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f478001f070 con 0x55dc6b5021b0 2024-09-21T03:41:20.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.902+0000 7f477affd640 1 -- 172.21.15.102:0/2264300541 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478002c440 con 0x55dc6b5021b0 2024-09-21T03:41:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- 172.21.15.102:0/2264300541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 msgr2=0x55dc6b8d3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f47800093c0 tx=0x7f478000afc0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- 172.21.15.102:0/2264300541 shutdown_connections 2024-09-21T03:41:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 --2- 172.21.15.102:0/2264300541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8d3de0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- 172.21.15.102:0/2264300541 >> 172.21.15.102:0/2264300541 conn(0x55dc6b51f460 msgr2=0x55dc6b8d36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- 172.21.15.102:0/2264300541 shutdown_connections 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- 172.21.15.102:0/2264300541 wait complete. 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 -- start start 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.903+0000 7f479dd38740 1 Processor -- start 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8e1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8e2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f47901ae090 con 0x55dc6b5021b0 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47901af500 con 0x55dc6b52b070 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f47901ae760 con 0x55dc6b50a390 2024-09-21T03:41:20.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f479dd38740 10 client.0 _ll_register_callbacks cb 0x7f4780019690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56752/0 (socket says 172.21.15.102:56752) 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 -- 172.21.15.102:0/1020381471 learned_addr learned my addr 172.21.15.102:0/1020381471 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4795560640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8e1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 -- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 msgr2=0x55dc6b8e1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8e1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 -- 172.21.15.102:0/1020381471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 msgr2=0x55dc6b8e2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8e2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 -- 172.21.15.102:0/1020381471 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc6b8e2ca0 con 0x55dc6b5021b0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4795560640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4794d5f640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4780019010 tx=0x7f4780014720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a9715fac015d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4778ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:20.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.904+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4780014d20 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f478002c440 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f478001f070 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f4780017680 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 10 client.16869 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55dc6b95ab30 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f478001f070 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f4780035590 con 0x55dc6b5021b0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 10 client.16869 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 10 client.16869 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 20 client.16869 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4beda0 0x55dc6b95d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 4 client.16869 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.905+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc6b8468a0 con 0x55dc6b4beda0 2024-09-21T03:41:20.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f4795560640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4beda0 0x55dc6b95d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f4795560640 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4beda0 0x55dc6b95d270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed0d7b496c00050a server_cookie=3d1c43f320f200df in_seq=0 out_seq=0 2024-09-21T03:41:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f4778ff9640 10 client.16869 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f4778ff9640 1 -- 172.21.15.102:0/1020381471 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc6b8468a0 con 0x55dc6b4beda0 2024-09-21T03:41:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f4778ff9640 10 client.16869 handle_command_reply: tid=0 2024-09-21T03:41:20.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.906+0000 7f479dd38740 1 client.16869 shutdown 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 msgr2=0x55dc6b8e69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f4780019010 tx=0x7f4780014720 comp rx=0 tx=0).stop 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 shutdown_connections 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55dc6b4beda0 0x55dc6b95d270 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55dc6b52b070 0x55dc6b8e2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55dc6b50a390 0x55dc6b8e1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f4778ff9640 0 client.16869 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 --2- 172.21.15.102:0/1020381471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dc6b5021b0 0x55dc6b8e69e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 >> 172.21.15.102:0/1020381471 conn(0x55dc6b51f460 msgr2=0x55dc6b8df220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 shutdown_connections 2024-09-21T03:41:20.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 1 -- 172.21.15.102:0/1020381471 wait complete. 2024-09-21T03:41:20.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f479dd38740 20 client.16869 trim_cache size 0 max 16384 2024-09-21T03:41:20.914 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 msgr2=0x7f477c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 0x7f477c0b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4788106300 tx=0x7f478803d040 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 msgr2=0x7f479019fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.907+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f4788009dc0 tx=0x7f4788003ba0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 shutdown_connections 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f477c0b6700 0x7f477c0b8c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4790109ec0 0x7f479019fe80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4790109570 0x7f479019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 --2- 172.21.15.102:0/801765555 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f4790103c30 0x7f479019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 >> 172.21.15.102:0/801765555 conn(0x7f479007b8d0 msgr2=0x7f47901075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 shutdown_connections 2024-09-21T03:41:20.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:20.908+0000 7f47977c4640 1 -- 172.21.15.102:0/801765555 wait complete. 2024-09-21T03:41:20.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:20 smithi148 ceph-mon[34651]: pgmap v561: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:21.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:20 smithi121 ceph-mon[34316]: pgmap v561: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:21.638 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:41:21.882 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:22.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 -- 172.21.15.102:0/3926022625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330109ec0 msgr2=0x7fc3301106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 --2- 172.21.15.102:0/3926022625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330109ec0 0x7fc3301106f0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc328009ca0 tx=0x7fc32802a8e0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 -- 172.21.15.102:0/3926022625 shutdown_connections 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 --2- 172.21.15.102:0/3926022625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330109ec0 0x7fc3301106f0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 --2- 172.21.15.102:0/3926022625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109570 0x7fc330109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 --2- 172.21.15.102:0/3926022625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330103c30 0x7fc330104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 -- 172.21.15.102:0/3926022625 >> 172.21.15.102:0/3926022625 conn(0x7fc33007b8d0 msgr2=0x7fc33007bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 -- 172.21.15.102:0/3926022625 shutdown_connections 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.362+0000 7fc336433640 1 -- 172.21.15.102:0/3926022625 wait complete. 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 Processor -- start 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 -- start start 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 0x7fc33019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 0x7fc33019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc330113c10 con 0x7fc330103c30 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc330113a90 con 0x7fc330109570 2024-09-21T03:41:22.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc336433640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc330113d90 con 0x7fc330109ec0 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56766/0 (socket says 172.21.15.102:56766) 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 -- 172.21.15.102:0/470036620 learned_addr learned my addr 172.21.15.102:0/470036620 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 0x7fc33019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc3349d0640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 0x7fc33019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 -- 172.21.15.102:0/470036620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 msgr2=0x7fc33019fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 0x7fc33019fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 -- 172.21.15.102:0/470036620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 msgr2=0x7fc33019ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 0x7fc33019ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32ffff640 1 -- 172.21.15.102:0/470036620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3301a04f0 con 0x7fc330103c30 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 0x7fc33019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.363+0000 7fc3349d0640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 0x7fc33019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc32ffff640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc32000d950 tx=0x7fc32000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc32d7fa640 1 -- 172.21.15.102:0/470036620 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc320017070 con 0x7fc330103c30 2024-09-21T03:41:22.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc32d7fa640 1 -- 172.21.15.102:0/470036620 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc320009c30 con 0x7fc330103c30 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3301a07e0 con 0x7fc330103c30 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc32d7fa640 1 -- 172.21.15.102:0/470036620 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000f6b0 con 0x7fc330103c30 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.364+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3301a6f40 con 0x7fc330103c30 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.366+0000 7fc33c9a7740 1 Processor -- start 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.366+0000 7fc33c9a7740 1 -- start start 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.366+0000 7fc32d7fa640 1 -- 172.21.15.102:0/470036620 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc3200109c0 con 0x7fc330103c30 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb56be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb57120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563c0caccea0 con 0x563c0c7af070 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563c0cabc2d0 con 0x563c0c78e390 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563c0cac00e0 con 0x563c0c7861b0 2024-09-21T03:41:22.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56770/0 (socket says 172.21.15.102:56770) 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 -- 172.21.15.102:0/775224682 learned_addr learned my addr 172.21.15.102:0/775224682 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc32ffff640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb56be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb57120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 -- 172.21.15.102:0/775224682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 msgr2=0x563c0cb56be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb56be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 -- 172.21.15.102:0/775224682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 msgr2=0x563c0cb57120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb57120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 -- 172.21.15.102:0/775224682 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0c81a650 con 0x563c0c7af070 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc32ffff640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb56be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3349d0640 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc328031040 tx=0x7fc3280094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c7a1c93181fd8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc32d7fa640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 0x7fc3180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.367+0000 7fc3167fc640 1 -- 172.21.15.102:0/775224682 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32803f070 con 0x563c0c7af070 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc32ffff640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 0x7fc3180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc3167fc640 1 -- 172.21.15.102:0/775224682 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc328036040 con 0x563c0c7af070 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc3167fc640 1 -- 172.21.15.102:0/775224682 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3280042a0 con 0x563c0c7af070 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc32d7fa640 1 -- 172.21.15.102:0/470036620 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fc3200e74a0 con 0x7fc330103c30 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 -- 172.21.15.102:0/775224682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 msgr2=0x563c0cb566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc32ffff640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 0x7fc3180b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3200e4c60 tx=0x7fc320010d60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fc328031040 tx=0x7fc3280094a0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 -- 172.21.15.102:0/775224682 shutdown_connections 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb57120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb56be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.368+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/775224682 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7af070 0x563c0cb566a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.369+0000 7fc33c9a7740 1 -- 172.21.15.102:0/775224682 >> 172.21.15.102:0/775224682 conn(0x563c0c7a3460 msgr2=0x563c0cb54590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.369+0000 7fc33c9a7740 1 -- 172.21.15.102:0/775224682 shutdown_connections 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.369+0000 7fc33c9a7740 1 -- 172.21.15.102:0/775224682 wait complete. 2024-09-21T03:41:22.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.369+0000 7fc33c9a7740 1 -- start start 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.369+0000 7fc33c9a7740 1 Processor -- start 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb62300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c7af070 0x563c0cb6e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563c0c91d700 con 0x563c0c7861b0 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563c0ca57160 con 0x563c0c7af070 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x563c0cb64e20 con 0x563c0c78e390 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 10 client.0 _ll_register_callbacks cb 0x563c0ca709e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56778/0 (socket says 172.21.15.102:56778) 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 -- 172.21.15.102:0/3995493946 learned_addr learned my addr 172.21.15.102:0/3995493946 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 -- 172.21.15.102:0/3995493946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 msgr2=0x563c0cb62300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb62300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 -- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c7af070 msgr2=0x563c0cb6e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c7af070 0x563c0cb6e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 -- 172.21.15.102:0/3995493946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0ca84c90 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc3349d0640 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc32802a920 tx=0x7fc3280098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2835c1ea21c5782f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc30f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32803f040 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fc3280305e0 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.370+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc328036040 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3280307e0 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 10 client.16881 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563c0cb70b90 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc328036040 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc328044460 con 0x563c0c7861b0 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 10 client.16881 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 10 client.16881 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:22.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 20 client.16881 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c76d9f0 0x563c0cb73ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 4 client.16881 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c0cacedf0 con 0x563c0c76d9f0 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.371+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c76d9f0 0x563c0cb73ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.372+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c76d9f0 0x563c0cb73ef0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63031656335424aa server_cookie=918d2fbbd23f6130 in_seq=0 out_seq=0 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.372+0000 7fc30f7fe640 10 client.16881 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.372+0000 7fc30f7fe640 1 -- 172.21.15.102:0/3995493946 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c0cacedf0 con 0x563c0c76d9f0 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.372+0000 7fc30f7fe640 10 client.16881 handle_command_reply: tid=0 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 client.16881 shutdown 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 msgr2=0x563c0cb61dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc32802a920 tx=0x7fc3280098a0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 shutdown_connections 2024-09-21T03:41:22.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c76d9f0 0x563c0cb73ef0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c7af070 0x563c0cb6e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb62300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc30f7fe640 0 client.16881 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/3995493946 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb61dc0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 >> 172.21.15.102:0/3995493946 conn(0x563c0c7a3460 msgr2=0x563c0cb59880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 shutdown_connections 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 1 -- 172.21.15.102:0/3995493946 wait complete. 2024-09-21T03:41:22.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.373+0000 7fc33c9a7740 20 client.16881 trim_cache size 0 max 16384 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 Processor -- start 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 -- start start 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb639f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb6e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301b22a0 con 0x563c0c76d9f0 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301afb70 con 0x563c0c78e390 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301ad9e0 con 0x563c0c7861b0 2024-09-21T03:41:22.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc3349d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56786/0 (socket says 172.21.15.102:56786) 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.386+0000 7fc3349d0640 1 -- 172.21.15.102:0/2948953340 learned_addr learned my addr 172.21.15.102:0/2948953340 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 -- 172.21.15.102:0/2948953340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 msgr2=0x563c0cb639f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 -- 172.21.15.102:0/2948953340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 msgr2=0x563c0cb6e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb6e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 -- 172.21.15.102:0/2948953340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0cb58990 con 0x563c0c76d9f0 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc3349d0640 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc328005e30 tx=0x7fc328000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daabbc3d16fe254 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc315ffb640 1 -- 172.21.15.102:0/2948953340 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32805c020 con 0x563c0c76d9f0 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc315ffb640 1 -- 172.21.15.102:0/2948953340 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc328036070 con 0x563c0c76d9f0 2024-09-21T03:41:22.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.387+0000 7fc315ffb640 1 -- 172.21.15.102:0/2948953340 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32803f040 con 0x563c0c76d9f0 2024-09-21T03:41:22.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- 172.21.15.102:0/2948953340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 msgr2=0x563c0cb58090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc328005e30 tx=0x7fc328000f40 comp rx=0 tx=0).stop 2024-09-21T03:41:22.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- 172.21.15.102:0/2948953340 shutdown_connections 2024-09-21T03:41:22.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c78e390 0x563c0cb6e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c7861b0 0x563c0cb639f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/2948953340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c76d9f0 0x563c0cb58090 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- 172.21.15.102:0/2948953340 >> 172.21.15.102:0/2948953340 conn(0x563c0c7a3460 msgr2=0x563c0cb632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- 172.21.15.102:0/2948953340 shutdown_connections 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- 172.21.15.102:0/2948953340 wait complete. 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 -- start start 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.388+0000 7fc33c9a7740 1 Processor -- start 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 0x563c0cb751b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb75c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301ae030 con 0x563c0c7861b0 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301af4a0 con 0x563c0c76d9f0 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3301ae700 con 0x563c0c78e390 2024-09-21T03:41:22.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc33c9a7740 10 client.0 _ll_register_callbacks cb 0x7fc3280099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56792/0 (socket says 172.21.15.102:56792) 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 -- 172.21.15.102:0/1114832233 learned_addr learned my addr 172.21.15.102:0/1114832233 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc3349d0640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 0x563c0cb751b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc3349d0640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb75c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 -- 172.21.15.102:0/1114832233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 msgr2=0x563c0cb75c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb75c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 -- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 msgr2=0x563c0cb751b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 0x563c0cb751b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 -- 172.21.15.102:0/1114832233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0cbdd870 con 0x563c0c7861b0 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc3349d0640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 0x563c0cb751b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:22.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc32f7fe640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc324004700 tx=0x7fc324009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143b06930d6d75e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.389+0000 7fc30f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc324020020 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fc32401c460 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc328036070 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc32402b050 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 10 client.16887 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563c0cbdeb50 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc328036070 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc32401a040 con 0x563c0c7861b0 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 10 client.16887 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 10 client.16887 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 20 client.16887 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:22.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c7af070 0x563c0cbe12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 4 client.16887 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c0caca8a0 con 0x563c0c7af070 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.390+0000 7fc3349d0640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c7af070 0x563c0cbe12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc30f7fe640 10 client.16887 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc3349d0640 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c7af070 0x563c0cbe12e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3fac58ef19550858 server_cookie=e6072dce2a8765a2 in_seq=0 out_seq=0 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc30f7fe640 1 -- 172.21.15.102:0/1114832233 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c0caca8a0 con 0x563c0c7af070 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc30f7fe640 10 client.16887 handle_command_reply: tid=0 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 client.16887 shutdown 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 msgr2=0x563c0cb756f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fc324004700 tx=0x7fc324009f80 comp rx=0 tx=0).stop 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 shutdown_connections 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x563c0c7af070 0x563c0cbe12e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563c0c7861b0 0x563c0cb756f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563c0c78e390 0x563c0cb75c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc30f7fe640 0 client.16887 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 --2- 172.21.15.102:0/1114832233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c0c76d9f0 0x563c0cb751b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 >> 172.21.15.102:0/1114832233 conn(0x563c0c7a3460 msgr2=0x563c0cb57e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 shutdown_connections 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.391+0000 7fc33c9a7740 1 -- 172.21.15.102:0/1114832233 wait complete. 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc33c9a7740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T03:41:22.399 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 msgr2=0x7fc3180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 0x7fc3180b8b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc3200e4c60 tx=0x7fc320010d60 comp rx=0 tx=0).stop 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 msgr2=0x7fc33019a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc32000d950 tx=0x7fc32000de10 comp rx=0 tx=0).stop 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 shutdown_connections 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3180b6680 0x7fc3180b8b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc330109ec0 0x7fc33019fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc330109570 0x7fc33019ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 --2- 172.21.15.102:0/470036620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc330103c30 0x7fc33019a580 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:22.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 >> 172.21.15.102:0/470036620 conn(0x7fc33007b8d0 msgr2=0x7fc330105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:22.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 shutdown_connections 2024-09-21T03:41:22.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:22.392+0000 7fc336433640 1 -- 172.21.15.102:0/470036620 wait complete. 2024-09-21T03:41:22.673 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:22 smithi102 ceph-mon[31392]: pgmap v562: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:22.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:22 smithi148 ceph-mon[34651]: pgmap v562: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:22.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:22 smithi121 ceph-mon[34316]: pgmap v562: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:41:23.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:41:23.415 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:23.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 -- 172.21.15.102:0/2107965991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37841021f0 msgr2=0x7f3784102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2107965991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37841021f0 0x7f3784102600 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f3774009ca0 tx=0x7f377402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 -- 172.21.15.102:0/2107965991 shutdown_connections 2024-09-21T03:41:23.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2107965991 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784108480 0x7f378410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2107965991 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3784107b30 0x7f3784107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2107965991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37841021f0 0x7f3784102600 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 -- 172.21.15.102:0/2107965991 >> 172.21.15.102:0/2107965991 conn(0x7f3784077c60 msgr2=0x7f37840780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 -- 172.21.15.102:0/2107965991 shutdown_connections 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.917+0000 7f3789a5a640 1 -- 172.21.15.102:0/2107965991 wait complete. 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 Processor -- start 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 -- start start 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37841021f0 0x7f378419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784107b30 0x7f378419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37841119f0 con 0x7f3784108480 2024-09-21T03:41:23.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3784111870 con 0x7f3784107b30 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f3789a5a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3784111b70 con 0x7f37841021f0 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f37837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f37837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56796/0 (socket says 172.21.15.102:56796) 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.918+0000 7f37837fe640 1 -- 172.21.15.102:0/2979144242 learned_addr learned my addr 172.21.15.102:0/2979144242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3782ffd640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37841021f0 0x7f378419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37827fc640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784107b30 0x7f378419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 -- 172.21.15.102:0/2979144242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37841021f0 msgr2=0x7f378419a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37841021f0 0x7f378419a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 -- 172.21.15.102:0/2979144242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784107b30 msgr2=0x7f378419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784107b30 0x7f378419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 -- 172.21.15.102:0/2979144242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37841a0490 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f37837fe640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c970 tx=0x7f377c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3788a58640 1 -- 172.21.15.102:0/2979144242 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c007bb0 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3788a58640 1 -- 172.21.15.102:0/2979144242 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f377c007d50 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3788a58640 1 -- 172.21.15.102:0/2979144242 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0187c0 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37841a0780 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.919+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37841a6fa0 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.922+0000 7f378ffce740 1 Processor -- start 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3788a58640 1 -- 172.21.15.102:0/2979144242 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f377c00fa40 con 0x7f3784108480 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 -- start start 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e8390 0x55b42f5b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b42f526ea0 con 0x55b42f1e01b0 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b42f5162d0 con 0x55b42f209070 2024-09-21T03:41:23.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f378ffce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b42f51a0e0 con 0x55b42f1e8390 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3782ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3782ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56806/0 (socket says 172.21.15.102:56806) 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3782ffd640 1 -- 172.21.15.102:0/1868668139 learned_addr learned my addr 172.21.15.102:0/1868668139 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f37827fc640 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f37827fc640 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e8390 0x55b42f5b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3782ffd640 1 -- 172.21.15.102:0/1868668139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e8390 msgr2=0x55b42f5b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.923+0000 7f3782ffd640 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e8390 0x55b42f5b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3782ffd640 1 -- 172.21.15.102:0/1868668139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 msgr2=0x55b42f5b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3782ffd640 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3782ffd640 1 -- 172.21.15.102:0/1868668139 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b42f274650 con 0x55b42f1e01b0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3788a58640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 0x7f376c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3782ffd640 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3774009920 tx=0x7f3774009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309e5f1f18751121 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f37827fc640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 0x7f376c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3788a58640 1 -- 172.21.15.102:0/2979144242 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f377c0e7820 con 0x7f3784108480 2024-09-21T03:41:23.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3769ffb640 1 -- 172.21.15.102:0/1868668139 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774031dc0 con 0x55b42f1e01b0 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3769ffb640 1 -- 172.21.15.102:0/1868668139 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3774036040 con 0x55b42f1e01b0 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.924+0000 7f3769ffb640 1 -- 172.21.15.102:0/1868668139 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774004350 con 0x55b42f1e01b0 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- 172.21.15.102:0/1868668139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 msgr2=0x55b42f5b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f37827fc640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 0x7f376c0b8c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f377800d010 tx=0x7f3778004730 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f3774009920 tx=0x7f3774009950 comp rx=0 tx=0).stop 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- 172.21.15.102:0/1868668139 shutdown_connections 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5b0800 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e8390 0x55b42f5b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 --2- 172.21.15.102:0/1868668139 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- 172.21.15.102:0/1868668139 >> 172.21.15.102:0/1868668139 conn(0x55b42f1fd460 msgr2=0x55b42f5ae1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- 172.21.15.102:0/1868668139 shutdown_connections 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- 172.21.15.102:0/1868668139 wait complete. 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.925+0000 7f378ffce740 1 -- start start 2024-09-21T03:41:23.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 Processor -- start 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e8390 0x55b42f5bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b42f377700 con 0x55b42f1e01b0 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b42f4b1160 con 0x55b42f1e8390 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b42f5bea40 con 0x55b42f209070 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f378ffce740 10 client.0 _ll_register_callbacks cb 0x55b42f4ca9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:23.958 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56810/0 (socket says 172.21.15.102:56810) 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 -- 172.21.15.102:0/3991240123 learned_addr learned my addr 172.21.15.102:0/3991240123 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f37837fe640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f37827fc640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e8390 0x55b42f5bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 -- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 msgr2=0x55b42f5bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 -- 172.21.15.102:0/3991240123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e8390 msgr2=0x55b42f5bbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.926+0000 7f3782ffd640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e8390 0x55b42f5bbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3782ffd640 1 -- 172.21.15.102:0/3991240123 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b42f4dec90 con 0x55b42f1e01b0 2024-09-21T03:41:23.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f37837fe640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3782ffd640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3774006010 tx=0x7f377402afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa1ef02221dd0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774052020 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3774036040 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f3774031450 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f377405d050 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f378ffce740 10 client.16899 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b42f5ca710 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3774036040 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f377404d030 con 0x55b42f1e01b0 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f378ffce740 10 client.16899 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.927+0000 7f378ffce740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f378ffce740 20 client.16899 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:23.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f1c79f0 0x55b42f5cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f378ffce740 4 client.16899 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b42f528df0 con 0x55b42f1c79f0 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f37827fc640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f1c79f0 0x55b42f5cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f3762ffd640 10 client.16899 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.928+0000 7f37827fc640 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f1c79f0 0x55b42f5cda70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdad60f10cbc6a10 server_cookie=f281d1150787f9f5 in_seq=0 out_seq=0 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f3762ffd640 1 -- 172.21.15.102:0/3991240123 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b42f528df0 con 0x55b42f1c79f0 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f3762ffd640 10 client.16899 handle_command_reply: tid=0 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 client.16899 shutdown 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 msgr2=0x55b42f5bb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f3774006010 tx=0x7f377402afd0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 shutdown_connections 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e8390 0x55b42f5bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.929+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f1c79f0 0x55b42f5cda70 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f378ffce740 1 --2- 172.21.15.102:0/3991240123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e01b0 0x55b42f5bb960 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f3762ffd640 0 client.16899 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 >> 172.21.15.102:0/3991240123 conn(0x55b42f1fd460 msgr2=0x55b42f5b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 shutdown_connections 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f378ffce740 1 -- 172.21.15.102:0/3991240123 wait complete. 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.930+0000 7f378ffce740 20 client.16899 trim_cache size 0 max 16384 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 Processor -- start 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 -- start start 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 0x55b42f5bd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37841b2160 con 0x55b42f1e8390 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37841afa30 con 0x55b42f209070 2024-09-21T03:41:23.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f378ffce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37841ad8a0 con 0x55b42f1e01b0 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56826/0 (socket says 172.21.15.102:56826) 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 -- 172.21.15.102:0/64199414 learned_addr learned my addr 172.21.15.102:0/64199414 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f3782ffd640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 0x55b42f5bd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37837fe640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 -- 172.21.15.102:0/64199414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 msgr2=0x55b42f5bd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 0x55b42f5bd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 -- 172.21.15.102:0/64199414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 msgr2=0x55b42f5b9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37827fc640 1 -- 172.21.15.102:0/64199414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b42f5bcc20 con 0x55b42f1e8390 2024-09-21T03:41:23.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f37837fe640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.943+0000 7f3782ffd640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 0x55b42f5bd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f37827fc640 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f377801e690 tx=0x7f377800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4de44f545c20f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f37697fa640 1 -- 172.21.15.102:0/64199414 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377801e390 con 0x55b42f1e8390 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f37697fa640 1 -- 172.21.15.102:0/64199414 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f377801fc20 con 0x55b42f1e8390 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f37697fa640 1 -- 172.21.15.102:0/64199414 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778029610 con 0x55b42f1e8390 2024-09-21T03:41:23.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f378ffce740 1 -- 172.21.15.102:0/64199414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 msgr2=0x55b42f5b8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.944+0000 7f378ffce740 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f377801e690 tx=0x7f377800f040 comp rx=0 tx=0).stop 2024-09-21T03:41:23.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- 172.21.15.102:0/64199414 shutdown_connections 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5b8b50 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f209070 0x55b42f5b9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- 172.21.15.102:0/64199414 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f1e01b0 0x55b42f5bd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- 172.21.15.102:0/64199414 >> 172.21.15.102:0/64199414 conn(0x55b42f1fd460 msgr2=0x55b42f5bce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- 172.21.15.102:0/64199414 shutdown_connections 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- 172.21.15.102:0/64199414 wait complete. 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- start start 2024-09-21T03:41:23.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 Processor -- start 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 0x55b42f5cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37841adef0 con 0x55b42f1e8390 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37841af360 con 0x55b42f1e01b0 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.945+0000 7f378ffce740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37841ae5c0 con 0x55b42f209070 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f378ffce740 10 client.0 _ll_register_callbacks cb 0x7f377800ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:23.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:56832/0 (socket says 172.21.15.102:56832) 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 -- 172.21.15.102:0/2458003356 learned_addr learned my addr 172.21.15.102:0/2458003356 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37837fe640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3782ffd640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 0x55b42f5cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 -- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 msgr2=0x55b42f5cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 -- 172.21.15.102:0/2458003356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 msgr2=0x55b42f5cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 0x55b42f5cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 -- 172.21.15.102:0/2458003356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b42f637370 con 0x55b42f1e8390 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3782ffd640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 0x55b42f5cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f37827fc640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f377800c570 tx=0x7f3778028c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c922585bb727bbc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3762ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3778028870 con 0x55b42f1e8390 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f37780293d0 con 0x55b42f1e8390 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f377801fc20 con 0x55b42f1e8390 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f37780295d0 con 0x55b42f1e8390 2024-09-21T03:41:23.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f378ffce740 10 client.16905 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.946+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b42f6384d0 con 0x55b42f1e8390 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f377801fc20 con 0x55b42f1e8390 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f377800b040 con 0x55b42f1e8390 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 10 client.16905 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 20 client.16905 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f19cda0 0x55b42f63ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 4 client.16905 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:23.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b42f5248a0 con 0x55b42f19cda0 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.947+0000 7f3782ffd640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f19cda0 0x55b42f63ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f3762ffd640 10 client.16905 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f3782ffd640 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f19cda0 0x55b42f63ac50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc6aa321888a10 server_cookie=29b6e75d274425f8 in_seq=0 out_seq=0 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f3762ffd640 1 -- 172.21.15.102:0/2458003356 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b42f5248a0 con 0x55b42f19cda0 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f3762ffd640 10 client.16905 handle_command_reply: tid=0 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 client.16905 shutdown 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 msgr2=0x55b42f5cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f377800c570 tx=0x7f3778028c40 comp rx=0 tx=0).stop 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 shutdown_connections 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b42f19cda0 0x55b42f63ac50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b42f1e8390 0x55b42f5cf1b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b42f209070 0x55b42f5cf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f3762ffd640 0 client.16905 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 --2- 172.21.15.102:0/2458003356 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b42f1e01b0 0x55b42f5cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 >> 172.21.15.102:0/2458003356 conn(0x55b42f1fd460 msgr2=0x55b42f5bcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 shutdown_connections 2024-09-21T03:41:23.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 1 -- 172.21.15.102:0/2458003356 wait complete. 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.948+0000 7f378ffce740 20 client.16905 trim_cache size 0 max 16384 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 msgr2=0x7f376c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 0x7f376c0b8c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f377800d010 tx=0x7f3778004730 comp rx=0 tx=0).stop 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 msgr2=0x7f378419fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c970 tx=0x7f377c00ce30 comp rx=0 tx=0).stop 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 shutdown_connections 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f376c0b6730 0x7f376c0b8c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3784108480 0x7f378419fe20 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3784107b30 0x7f378419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 --2- 172.21.15.102:0/2979144242 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37841021f0 0x7f378419a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:23.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 >> 172.21.15.102:0/2979144242 conn(0x7f3784077c60 msgr2=0x7f3784105dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:23.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 shutdown_connections 2024-09-21T03:41:23.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:23.949+0000 7f3789a5a640 1 -- 172.21.15.102:0/2979144242 wait complete. 2024-09-21T03:41:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:24 smithi148 ceph-mon[34651]: pgmap v563: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:24 smithi121 ceph-mon[34316]: pgmap v563: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:24.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:24 smithi102 ceph-mon[31392]: pgmap v563: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:25.660 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:41:25.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:41:25.919 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 -- 172.21.15.102:0/2255336000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720104840 msgr2=0x7f7720104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 --2- 172.21.15.102:0/2255336000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720104840 0x7f7720104c50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7710009900 tx=0x7f771002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 -- 172.21.15.102:0/2255336000 shutdown_connections 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 --2- 172.21.15.102:0/2255336000 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f7720110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 --2- 172.21.15.102:0/2255336000 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720105270 0x7f772010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 --2- 172.21.15.102:0/2255336000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720104840 0x7f7720104c50 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 -- 172.21.15.102:0/2255336000 >> 172.21.15.102:0/2255336000 conn(0x7f7720079730 msgr2=0x7f7720079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 -- 172.21.15.102:0/2255336000 shutdown_connections 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.422+0000 7f7726cc3640 1 -- 172.21.15.102:0/2255336000 wait complete. 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 Processor -- start 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 -- start start 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720104840 0x7f772019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f772019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7720113bb0 con 0x7f7720105270 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7720113a30 con 0x7f7720104840 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7726cc3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7720113d30 con 0x7f772010ddf0 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34232/0 (socket says 172.21.15.102:34232) 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 -- 172.21.15.102:0/1441480133 learned_addr learned my addr 172.21.15.102:0/1441480133 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7724a5f640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720104840 0x7f772019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7725260640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f772019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 -- 172.21.15.102:0/1441480133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 msgr2=0x7f772019fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f772019fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 -- 172.21.15.102:0/1441480133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720104840 msgr2=0x7f772019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720104840 0x7f772019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f771ffff640 1 -- 172.21.15.102:0/1441480133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77201a04d0 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.423+0000 7f7725260640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f772019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f771ffff640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f771400d740 tx=0x7f771400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f771dffb640 1 -- 172.21.15.102:0/1441480133 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714017070 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77201a07c0 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f771dffb640 1 -- 172.21.15.102:0/1441480133 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f771400de50 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f771dffb640 1 -- 172.21.15.102:0/1441480133 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771400f620 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.424+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77201a6fe0 con 0x7f7720105270 2024-09-21T03:41:26.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 Processor -- start 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 -- start start 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f771dffb640 1 -- 172.21.15.102:0/1441480133 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f771401a070 con 0x7f7720105270 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x5635253fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x5635253fd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563525373e60 con 0x563525035670 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563525363290 con 0x563525056350 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f772d237740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5635253670a0 con 0x56352502d490 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34240/0 (socket says 172.21.15.102:34240) 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f771ffff640 1 -- 172.21.15.102:0/4205187841 learned_addr learned my addr 172.21.15.102:0/4205187841 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f7725260640 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x5635253fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.427+0000 7f7724a5f640 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x5635253fd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 -- 172.21.15.102:0/4205187841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 msgr2=0x5635253fd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x5635253fd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 -- 172.21.15.102:0/4205187841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 msgr2=0x5635253fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x5635253fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 -- 172.21.15.102:0/4205187841 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635250c1930 con 0x563525035670 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771dffb640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 0x7f77080b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771ffff640 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f77140e47c0 tx=0x7f77140ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647100f05c26c4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f7725260640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 0x7f77080b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f7706ffd640 1 -- 172.21.15.102:0/4205187841 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77140a95a0 con 0x563525035670 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f771dffb640 1 -- 172.21.15.102:0/1441480133 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f77140e7140 con 0x7f7720105270 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f7706ffd640 1 -- 172.21.15.102:0/4205187841 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f77140aca60 con 0x563525035670 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.428+0000 7f7706ffd640 1 -- 172.21.15.102:0/4205187841 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77140b3fd0 con 0x563525035670 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 -- 172.21.15.102:0/4205187841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 msgr2=0x5635253fdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f7725260640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 0x7f77080b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7718005cc0 tx=0x7f7718008620 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f77140e47c0 tx=0x7f77140ef910 comp rx=0 tx=0).stop 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 -- 172.21.15.102:0/4205187841 shutdown_connections 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x5635253fdeb0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x5635253fd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 --2- 172.21.15.102:0/4205187841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x5635253fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 -- 172.21.15.102:0/4205187841 >> 172.21.15.102:0/4205187841 conn(0x56352504a740 msgr2=0x5635253fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 -- 172.21.15.102:0/4205187841 shutdown_connections 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.429+0000 7f772d237740 1 -- 172.21.15.102:0/4205187841 wait complete. 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 -- start start 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 Processor -- start 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525035670 0x563525409640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 0x563525414f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5635251c4890 con 0x56352502d490 2024-09-21T03:41:26.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5635252fdd40 con 0x563525035670 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56352540bc10 con 0x563525056350 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.430+0000 7f772d237740 10 client.0 _ll_register_callbacks cb 0x563525361c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34246/0 (socket says 172.21.15.102:34246) 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 -- 172.21.15.102:0/1002917541 learned_addr learned my addr 172.21.15.102:0/1002917541 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f771ffff640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525035670 0x563525409640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7725260640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 0x563525414f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 -- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 msgr2=0x563525414f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 0x563525414f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 -- 172.21.15.102:0/1002917541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525035670 msgr2=0x563525409640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525035670 0x563525409640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 -- 172.21.15.102:0/1002917541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563525415570 con 0x56352502d490 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7725260640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 0x563525414f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:26.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f7724a5f640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7710009230 tx=0x7f7710031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557a78a6612571e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f76fffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710035040 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f7710004250 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77140aca60 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7710004450 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f772d237740 10 client.16917 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.431+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563525417e80 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f77140aca60 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f77100035f0 con 0x56352502d490 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 10 client.16917 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 10 client.16917 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 20 client.16917 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:26.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563525014cd0 0x56352541b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 4 client.16917 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563525375db0 con 0x563525014cd0 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.432+0000 7f771ffff640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563525014cd0 0x56352541b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.433+0000 7f76fffff640 10 client.16917 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.433+0000 7f771ffff640 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563525014cd0 0x56352541b390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c4579ff99991cc server_cookie=3345007b2133d9b in_seq=0 out_seq=0 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f76fffff640 1 -- 172.21.15.102:0/1002917541 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563525375db0 con 0x563525014cd0 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f76fffff640 10 client.16917 handle_command_reply: tid=0 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 client.16917 shutdown 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 msgr2=0x563525409080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7710009230 tx=0x7f7710031510 comp rx=0 tx=0).stop 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 shutdown_connections 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525056350 0x563525414f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525035670 0x563525409640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563525014cd0 0x56352541b390 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 --2- 172.21.15.102:0/1002917541 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525409080 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f76fffff640 0 client.16917 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 >> 172.21.15.102:0/1002917541 conn(0x56352504a740 msgr2=0x5635253fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 shutdown_connections 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 1 -- 172.21.15.102:0/1002917541 wait complete. 2024-09-21T03:41:26.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.434+0000 7f772d237740 20 client.16917 trim_cache size 0 max 16384 2024-09-21T03:41:26.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.453+0000 7f772d237740 1 Processor -- start 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.453+0000 7f772d237740 1 -- start start 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525035670 0x563525402a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525406070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77201b2280 con 0x56352502d490 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77201afb50 con 0x563525056350 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f772d237740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77201ad9c0 con 0x563525035670 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34252/0 (socket says 172.21.15.102:34252) 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 -- 172.21.15.102:0/2884292998 learned_addr learned my addr 172.21.15.102:0/2884292998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f771ffff640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525035670 0x563525402a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7725260640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525406070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 -- 172.21.15.102:0/2884292998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525035670 msgr2=0x563525402a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525035670 0x563525402a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 -- 172.21.15.102:0/2884292998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 msgr2=0x563525406070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525406070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 -- 172.21.15.102:0/2884292998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563525402fc0 con 0x56352502d490 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7725260640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525406070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f7724a5f640 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7710009850 tx=0x7f7710005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1836083ea5fe35f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f77067fc640 1 -- 172.21.15.102:0/2884292998 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710035030 con 0x56352502d490 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f77067fc640 1 -- 172.21.15.102:0/2884292998 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7710041070 con 0x56352502d490 2024-09-21T03:41:26.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.454+0000 7f77067fc640 1 -- 172.21.15.102:0/2884292998 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7710052070 con 0x56352502d490 2024-09-21T03:41:26.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 -- 172.21.15.102:0/2884292998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 msgr2=0x563525402540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7710009850 tx=0x7f7710005fd0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 -- 172.21.15.102:0/2884292998 shutdown_connections 2024-09-21T03:41:26.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525406070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x563525035670 0x563525402a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 --2- 172.21.15.102:0/2884292998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56352502d490 0x563525402540 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 -- 172.21.15.102:0/2884292998 >> 172.21.15.102:0/2884292998 conn(0x56352504a740 msgr2=0x563525407700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 -- 172.21.15.102:0/2884292998 shutdown_connections 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.455+0000 7f772d237740 1 -- 172.21.15.102:0/2884292998 wait complete. 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 -- start start 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 Processor -- start 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x56352540d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525484d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f77201ae010 con 0x563525035670 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f77201af480 con 0x563525056350 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f77201ae6e0 con 0x56352502d490 2024-09-21T03:41:26.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f772d237740 10 client.0 _ll_register_callbacks cb 0x7f7710005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f771ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34264/0 (socket says 172.21.15.102:34264) 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.456+0000 7f771ffff640 1 -- 172.21.15.102:0/3703525594 learned_addr learned my addr 172.21.15.102:0/3703525594 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f7725260640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525484d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f7724a5f640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x56352540d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 -- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 msgr2=0x56352540d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x56352540d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 -- 172.21.15.102:0/3703525594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 msgr2=0x563525484d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525484d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 -- 172.21.15.102:0/3703525594 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56352540de50 con 0x563525035670 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f7724a5f640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x56352540d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f771ffff640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f77140a9520 tx=0x7f77140eaf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d38c19b7d829a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f76fffff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:26.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714021040 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f77140a91c0 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7710041070 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f77140b4220 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f772d237740 10 client.16923 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.457+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563525486200 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7710041070 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7714009c30 con 0x563525035670 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 10 client.16923 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 10 client.16923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 20 client.16923 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563524fea080 0x563525488490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 4 client.16923 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563525371860 con 0x563524fea080 2024-09-21T03:41:26.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f7724a5f640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563524fea080 0x563525488490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:26.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f7724a5f640 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563524fea080 0x563525488490 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781ea92ce970b177 server_cookie=15410beb6de74c07 in_seq=0 out_seq=0 2024-09-21T03:41:26.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.458+0000 7f76fffff640 10 client.16923 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:26.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f76fffff640 1 -- 172.21.15.102:0/3703525594 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563525371860 con 0x563524fea080 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f76fffff640 10 client.16923 handle_command_reply: tid=0 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 client.16923 shutdown 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 msgr2=0x56352540d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f77140a9520 tx=0x7f77140eaf60 comp rx=0 tx=0).stop 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 shutdown_connections 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x563524fea080 0x563525488490 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563525035670 0x56352540d640 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563525056350 0x563525484d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 --2- 172.21.15.102:0/3703525594 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56352502d490 0x56352540d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f76fffff640 0 client.16923 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 >> 172.21.15.102:0/3703525594 conn(0x56352504a740 msgr2=0x5635254076c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 shutdown_connections 2024-09-21T03:41:26.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.460+0000 7f772d237740 1 -- 172.21.15.102:0/3703525594 wait complete. 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f772d237740 20 client.16923 trim_cache size 0 max 16384 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa", 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:41:26.467 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 msgr2=0x7f77080b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 0x7f77080b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7718005cc0 tx=0x7f7718008620 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 msgr2=0x7f772019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f771400d740 tx=0x7f771400dc00 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 shutdown_connections 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f77080b66b0 0x7f77080b8bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7720105270 0x7f772019abc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f772010ddf0 0x7f772019fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 --2- 172.21.15.102:0/1441480133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7720104840 0x7f772019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 >> 172.21.15.102:0/1441480133 conn(0x7f7720079730 msgr2=0x7f7720100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:26.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 shutdown_connections 2024-09-21T03:41:26.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:26.461+0000 7f7726cc3640 1 -- 172.21.15.102:0/1441480133 wait complete. 2024-09-21T03:41:26.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:26 smithi102 ceph-mon[31392]: pgmap v564: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:26 smithi148 ceph-mon[34651]: pgmap v564: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:26.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:26 smithi121 ceph-mon[34316]: pgmap v564: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:41:27.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:41:27.430 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:27 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:41:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:27 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:27 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:41:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:27 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:27 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:41:27.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:27 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:41:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:27 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:27 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:41:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:27 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:27 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:41:27.847 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:27 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:41:27.847 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:27 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.847 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:27 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:41:27.847 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:27 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:27.847 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:27 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:41:27.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 -- 172.21.15.102:0/2524716949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4109e40 msgr2=0x7f6df4110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/2524716949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4109e40 0x7f6df4110670 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009ca0 tx=0x7f6dec02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 -- 172.21.15.102:0/2524716949 shutdown_connections 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/2524716949 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4109e40 0x7f6df4110670 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/2524716949 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 0x7f6df4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/2524716949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4103bb0 0x7f6df4103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 -- 172.21.15.102:0/2524716949 >> 172.21.15.102:0/2524716949 conn(0x7f6df40ff600 msgr2=0x7f6df4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 -- 172.21.15.102:0/2524716949 shutdown_connections 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.935+0000 7f6dfa71d640 1 -- 172.21.15.102:0/2524716949 wait complete. 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 Processor -- start 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 -- start start 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 0x7f6df4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 0x7f6df4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113c40 con 0x7f6df4103bb0 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113ac0 con 0x7f6df4109e40 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.936+0000 7f6dfa71d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6df4113dc0 con 0x7f6df41094f0 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34294/0 (socket says 172.21.15.102:34294) 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 -- 172.21.15.102:0/358145176 learned_addr learned my addr 172.21.15.102:0/358145176 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df37fe640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 0x7f6df4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df8cba640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 0x7f6df4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 -- 172.21.15.102:0/358145176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 msgr2=0x7f6df4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 0x7f6df4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 -- 172.21.15.102:0/358145176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 msgr2=0x7f6df4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 0x7f6df4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 -- 172.21.15.102:0/358145176 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df41a8830 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df8cba640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 0x7f6df4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df3fff640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6de400d950 tx=0x7f6de400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df17fa640 1 -- 172.21.15.102:0/358145176 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4017070 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df17fa640 1 -- 172.21.15.102:0/358145176 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6de4009c30 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df41a8b20 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6df17fa640 1 -- 172.21.15.102:0/358145176 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f6b0 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.937+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df41a9060 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.940+0000 7f6e00c91740 1 Processor -- start 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.940+0000 7f6e00c91740 1 -- start start 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.940+0000 7f6df17fa640 1 -- 172.21.15.102:0/358145176 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f6de400f850 con 0x7f6df4103bb0 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.940+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb191b0 0x56058fee9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058feea0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6e00c91740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56058fe5fe50 con 0x56058fb42070 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6e00c91740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56058fe4f280 con 0x56058fb191b0 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6e00c91740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56058fe53090 con 0x56058fb21390 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34300/0 (socket says 172.21.15.102:34300) 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 -- 172.21.15.102:0/1204922336 learned_addr learned my addr 172.21.15.102:0/1204922336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df37fe640 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058feea0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df3fff640 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb191b0 0x56058fee9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 -- 172.21.15.102:0/1204922336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 msgr2=0x56058feea0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058feea0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 -- 172.21.15.102:0/1204922336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb191b0 msgr2=0x56058fee9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb191b0 0x56058fee9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 -- 172.21.15.102:0/1204922336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058fbad650 con 0x56058fb42070 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df8cba640 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006010 tx=0x7f6dec009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd94595eb6a0421d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df17fa640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 0x7f6ddc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6dda7fc640 1 -- 172.21.15.102:0/1204922336 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec031dc0 con 0x56058fb42070 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.941+0000 7f6df3fff640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 0x7f6ddc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6dda7fc640 1 -- 172.21.15.102:0/1204922336 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6dec036070 con 0x56058fb42070 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6dda7fc640 1 -- 172.21.15.102:0/1204922336 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0042a0 con 0x56058fb42070 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6df17fa640 1 -- 172.21.15.102:0/358145176 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f6de40e73c0 con 0x7f6df4103bb0 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 -- 172.21.15.102:0/1204922336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 msgr2=0x56058fee9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6df3fff640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 0x7f6ddc0b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6de40e4b80 tx=0x7f6de40ec040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f6dec006010 tx=0x7f6dec009880 comp rx=0 tx=0).stop 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 -- 172.21.15.102:0/1204922336 shutdown_connections 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058feea0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb191b0 0x56058fee9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 --2- 172.21.15.102:0/1204922336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb42070 0x56058fee9650 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.942+0000 7f6e00c91740 1 -- 172.21.15.102:0/1204922336 >> 172.21.15.102:0/1204922336 conn(0x56058fb36460 msgr2=0x56058fee7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- 172.21.15.102:0/1204922336 shutdown_connections 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- 172.21.15.102:0/1204922336 wait complete. 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- start start 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 Processor -- start 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fef4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb42070 0x56058fef5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56058fcb0700 con 0x56058fb21390 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56058fdea110 con 0x56058fb42070 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.943+0000 7f6e00c91740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56058fef7e20 con 0x56058fb191b0 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6e00c91740 10 client.0 _ll_register_callbacks cb 0x56058fe03990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34308/0 (socket says 172.21.15.102:34308) 2024-09-21T03:41:27.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 -- 172.21.15.102:0/2437921098 learned_addr learned my addr 172.21.15.102:0/2437921098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb42070 0x56058fef5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fef4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 -- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 msgr2=0x56058fef4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fef4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 -- 172.21.15.102:0/2437921098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb42070 msgr2=0x56058fef5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb42070 0x56058fef5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 -- 172.21.15.102:0/2437921098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058fe17c40 con 0x56058fb21390 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6de800b990 tx=0x7f6de800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554dfd491128f033 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6dd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005020 con 0x56058fb21390 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f6de80051c0 con 0x56058fb21390 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.944+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dec036070 con 0x56058fb21390 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6de80053c0 con 0x56058fb21390 2024-09-21T03:41:27.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 10 client.16935 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56058ff03ab0 con 0x56058fb21390 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6dec036070 con 0x56058fb21390 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6de801b630 con 0x56058fb21390 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 10 client.16935 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 20 client.16935 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb009f0 0x56058ff07020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 4 client.16935 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56058fe61da0 con 0x56058fb009f0 2024-09-21T03:41:27.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.945+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb009f0 0x56058ff07020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.946+0000 7f6dd37fe640 10 client.16935 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:27.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.946+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb009f0 0x56058ff07020 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85d8bdde99d212a7 server_cookie=881aefed2091f8a9 in_seq=0 out_seq=0 2024-09-21T03:41:27.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2437921098 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56058fe61da0 con 0x56058fb009f0 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6dd37fe640 10 client.16935 handle_command_reply: tid=0 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 client.16935 shutdown 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 msgr2=0x56058fef51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f6de800b990 tx=0x7f6de800be50 comp rx=0 tx=0).stop 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 shutdown_connections 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb009f0 0x56058ff07020 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb21390 0x56058fef51d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb42070 0x56058fef5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2437921098 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fef4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 >> 172.21.15.102:0/2437921098 conn(0x56058fb36460 msgr2=0x56058feea680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6dd37fe640 0 client.16935 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 shutdown_connections 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 1 -- 172.21.15.102:0/2437921098 wait complete. 2024-09-21T03:41:27.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.947+0000 7f6e00c91740 20 client.16935 trim_cache size 0 max 16384 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 Processor -- start 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 -- start start 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb36460 0x56058fef6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058fef1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b44a0 con 0x56058fb191b0 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b1d70 con 0x56058fb36460 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6e00c91740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41afbe0 con 0x56058fb21390 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.964+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34316/0 (socket says 172.21.15.102:34316) 2024-09-21T03:41:27.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 -- 172.21.15.102:0/395794031 learned_addr learned my addr 172.21.15.102:0/395794031 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df8cba640 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb36460 0x56058fef6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 -- 172.21.15.102:0/395794031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 msgr2=0x56058fef1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df8cba640 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058fef1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058fef1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 -- 172.21.15.102:0/395794031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb36460 msgr2=0x56058fef6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb36460 0x56058fef6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 -- 172.21.15.102:0/395794031 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56058fef73d0 con 0x56058fb191b0 2024-09-21T03:41:27.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6df37fe640 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6de80044f0 tx=0x7f6de8003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50f61705551d4ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6dd9ffb640 1 -- 172.21.15.102:0/395794031 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8032070 con 0x56058fb191b0 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6dd9ffb640 1 -- 172.21.15.102:0/395794031 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6de8028040 con 0x56058fb191b0 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.965+0000 7f6dd9ffb640 1 -- 172.21.15.102:0/395794031 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8027070 con 0x56058fb191b0 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- 172.21.15.102:0/395794031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 msgr2=0x56058feead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6de80044f0 tx=0x7f6de8003ec0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- 172.21.15.102:0/395794031 shutdown_connections 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb191b0 0x56058feead90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb21390 0x56058fef1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 --2- 172.21.15.102:0/395794031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb36460 0x56058fef6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- 172.21.15.102:0/395794031 >> 172.21.15.102:0/395794031 conn(0x56058ff07390 msgr2=0x56058feea680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- 172.21.15.102:0/395794031 shutdown_connections 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- 172.21.15.102:0/395794031 wait complete. 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.966+0000 7f6e00c91740 1 -- start start 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 Processor -- start 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fefd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb21390 0x56058fef8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b0230 con 0x56058fb36460 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b16a0 con 0x56058fb21390 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6df41b0900 con 0x56058fb191b0 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6e00c91740 10 client.0 _ll_register_callbacks cb 0x7f6de80042b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34330/0 (socket says 172.21.15.102:34330) 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 -- 172.21.15.102:0/2474811900 learned_addr learned my addr 172.21.15.102:0/2474811900 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fefd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb21390 0x56058fef8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 -- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 msgr2=0x56058fefd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fefd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 -- 172.21.15.102:0/2474811900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb21390 msgr2=0x56058fef8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb21390 0x56058fef8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.967+0000 7f6df8cba640 1 -- 172.21.15.102:0/2474811900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56058fef9830 con 0x56058fb36460 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6df8cba640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6dec005e30 tx=0x7f6dec005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57081a9bcdf6e4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec049040 con 0x56058fb36460 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f6dec003c30 con 0x56058fb36460 2024-09-21T03:41:27.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6de8028040 con 0x56058fb36460 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6dec003e30 con 0x56058fb36460 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 10 client.16941 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56058ff71840 con 0x56058fb36460 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6de8028040 con 0x56058fb36460 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6dec02f660 con 0x56058fb36460 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 10 client.16941 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 20 client.16941 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.968+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb42070 0x56058ff73b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6e00c91740 4 client.16941 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56058fe5d850 con 0x56058fb42070 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb42070 0x56058ff73b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6dd37fe640 10 client.16941 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6df37fe640 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb42070 0x56058ff73b90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf0d8758262e3a3f server_cookie=d3cdfb19210bc9f9 in_seq=0 out_seq=0 2024-09-21T03:41:27.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6dd37fe640 1 -- 172.21.15.102:0/2474811900 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x56058fe5d850 con 0x56058fb42070 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.969+0000 7f6dd37fe640 10 client.16941 handle_command_reply: tid=0 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 client.16941 shutdown 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 msgr2=0x56058fef9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6dec005e30 tx=0x7f6dec005d80 comp rx=0 tx=0).stop 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 shutdown_connections 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56058fb42070 0x56058ff73b90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56058fb36460 0x56058fef9190 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56058fb21390 0x56058fef8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 --2- 172.21.15.102:0/2474811900 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56058fb191b0 0x56058fefd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 >> 172.21.15.102:0/2474811900 conn(0x56058ff07390 msgr2=0x56058fef68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6dd37fe640 0 client.16941 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 shutdown_connections 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 1 -- 172.21.15.102:0/2474811900 wait complete. 2024-09-21T03:41:27.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.970+0000 7f6e00c91740 20 client.16941 trim_cache size 0 max 16384 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.978 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.979 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:41:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.981 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.982 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.983 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:27.984 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:27.985 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 msgr2=0x7f6ddc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 0x7f6ddc0b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6de40e4b80 tx=0x7f6de40ec040 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 msgr2=0x7f6df4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f6de400d950 tx=0x7f6de400de10 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 shutdown_connections 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6ddc0b6680 0x7f6ddc0b8b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6df4109e40 0x7f6df4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6df41094f0 0x7f6df4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 --2- 172.21.15.102:0/358145176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6df4103bb0 0x7f6df4075710 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 >> 172.21.15.102:0/358145176 conn(0x7f6df40ff600 msgr2=0x7f6df4106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 shutdown_connections 2024-09-21T03:41:27.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:27.971+0000 7f6dfa71d640 1 -- 172.21.15.102:0/358145176 wait complete. 2024-09-21T03:41:28.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:28 smithi102 ceph-mon[31392]: pgmap v565: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:41:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:28 smithi148 ceph-mon[34651]: pgmap v565: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:41:28.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:41:28.746 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:41:28.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:28 smithi121 ceph-mon[34316]: pgmap v565: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:41:28.990 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:29.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 -- 172.21.15.102:0/2532221063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 msgr2=0x7f158c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 --2- 172.21.15.102:0/2532221063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c10d930 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f1588009900 tx=0x7f158802a410 comp rx=0 tx=0).stop 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 -- 172.21.15.102:0/2532221063 shutdown_connections 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 --2- 172.21.15.102:0/2532221063 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c10d930 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 --2- 172.21.15.102:0/2532221063 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 0x7f158c110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 --2- 172.21.15.102:0/2532221063 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 -- 172.21.15.102:0/2532221063 >> 172.21.15.102:0/2532221063 conn(0x7f158c079770 msgr2=0x7f158c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 -- 172.21.15.102:0/2532221063 shutdown_connections 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.453+0000 7f15937a5640 1 -- 172.21.15.102:0/2532221063 wait complete. 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 Processor -- start 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 -- start start 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 0x7f158c19ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f158c113cf0 con 0x7f158c1052f0 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f158c113b70 con 0x7f158c1048c0 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.454+0000 7f15937a5640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f158c113e70 con 0x7f158c10de70 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34340/0 (socket says 172.21.15.102:34340) 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 -- 172.21.15.102:0/4054292960 learned_addr learned my addr 172.21.15.102:0/4054292960 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1591541640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 -- 172.21.15.102:0/4054292960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 msgr2=0x7f158c19ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1591d42640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 0x7f158c19ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 0x7f158c19ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 -- 172.21.15.102:0/4054292960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 msgr2=0x7f158c19a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c19a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 -- 172.21.15.102:0/4054292960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c1a0670 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1591541640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f1590d40640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1588005940 tx=0x7f1588004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158803f030 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1588003cd0 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1a0900 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588035070 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.455+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1a70c0 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.456+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f158c06c200 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.458+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1588042030 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.459+0000 7f157e7fc640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 0x7f15780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.459+0000 7f1591541640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 0x7f15780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.459+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f1588108130 con 0x7f158c1052f0 2024-09-21T03:41:29.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.459+0000 7f1591541640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 0x7f15780b8b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:29.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.462+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15880ce640 con 0x7f158c1052f0 2024-09-21T03:41:29.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.676+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f158c19b830 con 0x7f158c1052f0 2024-09-21T03:41:29.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.676+0000 7f157e7fc640 1 -- 172.21.15.102:0/4054292960 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f15880d2a20 con 0x7f158c1052f0 2024-09-21T03:41:29.679 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:41:29.679 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:41:29.679 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:41:29.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 msgr2=0x7f15780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 0x7f15780b8b90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1580006fd0 tx=0x7f1580008040 comp rx=0 tx=0).stop 2024-09-21T03:41:29.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 msgr2=0x7f158c19aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1588005940 tx=0x7f1588004360 comp rx=0 tx=0).stop 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 shutdown_connections 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f15780b6680 0x7f15780b8b90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f158c1052f0 0x7f158c19aca0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f158c10de70 0x7f158c19ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 --2- 172.21.15.102:0/4054292960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f158c1048c0 0x7f158c19a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 >> 172.21.15.102:0/4054292960 conn(0x7f158c079770 msgr2=0x7f158c107a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 shutdown_connections 2024-09-21T03:41:29.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:29.679+0000 7f15937a5640 1 -- 172.21.15.102:0/4054292960 wait complete. 2024-09-21T03:41:29.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:29 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/4054292960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:29.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:29 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/4054292960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:30.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:29 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/4054292960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:41:30.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:41:30.604 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:30.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:30 smithi148 ceph-mon[34651]: pgmap v566: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:31.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:30 smithi121 ceph-mon[34316]: pgmap v566: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:31.061 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:30 smithi102 ceph-mon[31392]: pgmap v566: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:31.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 -- 172.21.15.102:0/1392562681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c1094d0 msgr2=0x7f304c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 --2- 172.21.15.102:0/1392562681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c1094d0 0x7f304c1098e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f3040009900 tx=0x7f304002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 -- 172.21.15.102:0/1392562681 shutdown_connections 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 --2- 172.21.15.102:0/1392562681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c1094d0 0x7f304c1098e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 --2- 172.21.15.102:0/1392562681 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c109e20 0x7f304c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 --2- 172.21.15.102:0/1392562681 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 0x7f304c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 -- 172.21.15.102:0/1392562681 >> 172.21.15.102:0/1392562681 conn(0x7f304c0ff5e0 msgr2=0x7f304c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 -- 172.21.15.102:0/1392562681 shutdown_connections 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.150+0000 7f3051f74640 1 -- 172.21.15.102:0/1392562681 wait complete. 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 Processor -- start 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 -- start start 2024-09-21T03:41:31.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 0x7f304c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c1094d0 0x7f304c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f304c113c00 con 0x7f304c109e20 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f304c113a80 con 0x7f304c1094d0 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.151+0000 7f3051f74640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f304c113d80 con 0x7f304c103b90 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34368/0 (socket says 172.21.15.102:34368) 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 -- 172.21.15.102:0/1450216679 learned_addr learned my addr 172.21.15.102:0/1450216679 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304b7fe640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 0x7f304c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304affd640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c1094d0 0x7f304c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 -- 172.21.15.102:0/1450216679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 msgr2=0x7f304c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 0x7f304c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 -- 172.21.15.102:0/1450216679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c1094d0 msgr2=0x7f304c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c1094d0 0x7f304c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 -- 172.21.15.102:0/1450216679 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f304c1a0500 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f304bfff640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f304400eb10 tx=0x7f304400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f3048ff9640 1 -- 172.21.15.102:0/1450216679 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044004b20 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f3048ff9640 1 -- 172.21.15.102:0/1450216679 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3044004cc0 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f304c1a07f0 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f3048ff9640 1 -- 172.21.15.102:0/1450216679 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044010720 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.152+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f304c1a6f50 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.155+0000 7f30584e8740 1 Processor -- start 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.155+0000 7f3048ff9640 1 -- 172.21.15.102:0/1450216679 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f30440108e0 con 0x7f304c109e20 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.155+0000 7f30584e8740 1 -- start start 2024-09-21T03:41:31.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8b8070 0x55b81ec5f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b81ebd5ea0 con 0x55b81e897390 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b81ebc52d0 con 0x55b81e8b8070 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f30584e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b81ebc90e0 con 0x55b81e88f1b0 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34370/0 (socket says 172.21.15.102:34370) 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 -- 172.21.15.102:0/2191354191 learned_addr learned my addr 172.21.15.102:0/2191354191 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8b8070 0x55b81ec5f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304b7fe640 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f3048ff9640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 0x7f30340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 -- 172.21.15.102:0/2191354191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 msgr2=0x55b81ec5f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 -- 172.21.15.102:0/2191354191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8b8070 msgr2=0x55b81ec5f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8b8070 0x55b81ec5f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304affd640 1 -- 172.21.15.102:0/2191354191 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81e923650 con 0x55b81e897390 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.156+0000 7f304bfff640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 0x7f30340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.157+0000 7f304affd640 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3040000c00 tx=0x7f304002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c126c2c62ae2f5d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.157+0000 7f3048ff9640 1 -- 172.21.15.102:0/1450216679 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f30440e7e60 con 0x7f304c109e20 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.157+0000 7f3031ffb640 1 -- 172.21.15.102:0/2191354191 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040035040 con 0x55b81e897390 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.157+0000 7f3031ffb640 1 -- 172.21.15.102:0/2191354191 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3040031930 con 0x55b81e897390 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.157+0000 7f3031ffb640 1 -- 172.21.15.102:0/2191354191 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040003c10 con 0x55b81e897390 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- 172.21.15.102:0/2191354191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 msgr2=0x55b81ec5fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f304bfff640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 0x7f30340b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f30440e5b70 tx=0x7f304407a920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3040000c00 tx=0x7f304002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- 172.21.15.102:0/2191354191 shutdown_connections 2024-09-21T03:41:31.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5fd40 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 --2- 172.21.15.102:0/2191354191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8b8070 0x55b81ec5f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- 172.21.15.102:0/2191354191 >> 172.21.15.102:0/2191354191 conn(0x55b81e8ac460 msgr2=0x55b81ec5d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- 172.21.15.102:0/2191354191 shutdown_connections 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- 172.21.15.102:0/2191354191 wait complete. 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 -- start start 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.158+0000 7f30584e8740 1 Processor -- start 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec6a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e897390 0x55b81ec6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b81ea26700 con 0x55b81e8b8070 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b81eb60160 con 0x55b81e88f1b0 2024-09-21T03:41:31.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b81ec6da40 con 0x55b81e897390 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f30584e8740 10 client.0 _ll_register_callbacks cb 0x55b81eb799e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34386/0 (socket says 172.21.15.102:34386) 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 -- 172.21.15.102:0/2148255560 learned_addr learned my addr 172.21.15.102:0/2148255560 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec6a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304b7fe640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e897390 0x55b81ec6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 -- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e897390 msgr2=0x55b81ec6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e897390 0x55b81ec6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 -- 172.21.15.102:0/2148255560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 msgr2=0x55b81ec6a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec6a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 -- 172.21.15.102:0/2148255560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81eb8dc90 con 0x55b81e8b8070 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.159+0000 7f304affd640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3040031670 tx=0x7f3040032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553120044396ecc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040035070 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f3040005220 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b81ebd7df0 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3040005420 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 10 client.16959 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b81ec79740 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x55b81ebd7df0 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f304003a040 con 0x55b81e8b8070 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 10 client.16959 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 10 client.16959 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 20 client.16959 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8769f0 0x55b81ec7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 4 client.16959 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:31.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.160+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b81ebd38a0 con 0x55b81e8769f0 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.161+0000 7f304b7fe640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8769f0 0x55b81ec7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.161+0000 7f302affd640 10 client.16959 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.161+0000 7f304b7fe640 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8769f0 0x55b81ec7caa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9237c11b4bf145fa server_cookie=7c9244235b27a4c9 in_seq=0 out_seq=0 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f302affd640 1 -- 172.21.15.102:0/2148255560 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b81ebd38a0 con 0x55b81e8769f0 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f302affd640 10 client.16959 handle_command_reply: tid=0 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f30584e8740 1 client.16959 shutdown 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 msgr2=0x55b81ec76d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3040031670 tx=0x7f3040032db0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 shutdown_connections 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.162+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8769f0 0x55b81ec7caa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e8b8070 0x55b81ec76d60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e897390 0x55b81ec6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f302affd640 0 client.16959 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 --2- 172.21.15.102:0/2148255560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec6a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 >> 172.21.15.102:0/2148255560 conn(0x55b81e8ac460 msgr2=0x55b81ec62450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 shutdown_connections 2024-09-21T03:41:31.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 1 -- 172.21.15.102:0/2148255560 wait complete. 2024-09-21T03:41:31.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.163+0000 7f30584e8740 20 client.16959 trim_cache size 0 max 16384 2024-09-21T03:41:31.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 Processor -- start 2024-09-21T03:41:31.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 -- start start 2024-09-21T03:41:31.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8769f0 0x55b81ec60a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1b22a0 con 0x55b81e897390 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1afb70 con 0x55b81e8769f0 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f30584e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1ad9e0 con 0x55b81e88f1b0 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34394/0 (socket says 172.21.15.102:34394) 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.176+0000 7f304affd640 1 -- 172.21.15.102:0/769294859 learned_addr learned my addr 172.21.15.102:0/769294859 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8769f0 0x55b81ec60a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304b7fe640 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 -- 172.21.15.102:0/769294859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 msgr2=0x55b81ec5c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 -- 172.21.15.102:0/769294859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8769f0 msgr2=0x55b81ec60a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8769f0 0x55b81ec60a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 -- 172.21.15.102:0/769294859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b81ec57460 con 0x55b81e897390 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f304affd640 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3040004a30 tx=0x7f3040040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec74dcf8a6dece03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f30317fa640 1 -- 172.21.15.102:0/769294859 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040035030 con 0x55b81e897390 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f30317fa640 1 -- 172.21.15.102:0/769294859 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f304003dd90 con 0x55b81e897390 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.177+0000 7f30317fa640 1 -- 172.21.15.102:0/769294859 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040004f00 con 0x55b81e897390 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- 172.21.15.102:0/769294859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 msgr2=0x55b81ec5cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3040004a30 tx=0x7f3040040040 comp rx=0 tx=0).stop 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- 172.21.15.102:0/769294859 shutdown_connections 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec5cca0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e88f1b0 0x55b81ec5c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 --2- 172.21.15.102:0/769294859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e8769f0 0x55b81ec60a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- 172.21.15.102:0/769294859 >> 172.21.15.102:0/769294859 conn(0x55b81e8ac460 msgr2=0x55b81ec602f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- 172.21.15.102:0/769294859 shutdown_connections 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- 172.21.15.102:0/769294859 wait complete. 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 -- start start 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.178+0000 7f30584e8740 1 Processor -- start 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e8769f0 0x55b81ec80110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec7d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1ae030 con 0x55b81e897390 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1af4a0 con 0x55b81e88f1b0 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f304c1ae700 con 0x55b81e8769f0 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f30584e8740 10 client.0 _ll_register_callbacks cb 0x7f303c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34410/0 (socket says 172.21.15.102:34410) 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 -- 172.21.15.102:0/3143052401 learned_addr learned my addr 172.21.15.102:0/3143052401 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304b7fe640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec7d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e8769f0 0x55b81ec80110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 -- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e8769f0 msgr2=0x55b81ec80110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e8769f0 0x55b81ec80110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 -- 172.21.15.102:0/3143052401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 msgr2=0x55b81ec7d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec7d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 -- 172.21.15.102:0/3143052401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b81ec7e110 con 0x55b81e897390 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304b7fe640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec7d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f304affd640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3040032c70 tx=0x7f3040005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e23a1ba5233e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.179+0000 7f302affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3040035040 con 0x55b81e897390 2024-09-21T03:41:31.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7f304006a070 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f304003dd90 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f30400046c0 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 10 client.16965 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b81ece6f30 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f304003dd90 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f304004a560 con 0x55b81e897390 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 10 client.16965 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 10 client.16965 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 20 client.16965 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8b8070 0x55b81ece9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 4 client.16965 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.180+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b81ebd0cd0 con 0x55b81e8b8070 2024-09-21T03:41:31.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f304b7fe640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8b8070 0x55b81ece9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f302affd640 10 client.16965 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f304b7fe640 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8b8070 0x55b81ece9360 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5719ccaa6131c8ba server_cookie=730fc0a4d223dcf7 in_seq=0 out_seq=0 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f302affd640 1 -- 172.21.15.102:0/3143052401 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b81ebd0cd0 con 0x55b81e8b8070 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f302affd640 10 client.16965 handle_command_reply: tid=0 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.181+0000 7f30584e8740 1 client.16965 shutdown 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 msgr2=0x55b81ec7db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3040032c70 tx=0x7f3040005c90 comp rx=0 tx=0).stop 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 shutdown_connections 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55b81e8b8070 0x55b81ece9360 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b81e897390 0x55b81ec7db20 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b81e88f1b0 0x55b81ec7d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 --2- 172.21.15.102:0/3143052401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b81e8769f0 0x55b81ec80110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f302affd640 0 client.16965 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:41:31.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 >> 172.21.15.102:0/3143052401 conn(0x55b81e8ac460 msgr2=0x55b81ec6bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 shutdown_connections 2024-09-21T03:41:31.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 1 -- 172.21.15.102:0/3143052401 wait complete. 2024-09-21T03:41:31.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f30584e8740 20 client.16965 trim_cache size 0 max 16384 2024-09-21T03:41:31.196 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 msgr2=0x7f30340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 0x7f30340b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f30440e5b70 tx=0x7f304407a920 comp rx=0 tx=0).stop 2024-09-21T03:41:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 msgr2=0x7f304c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f304400eb10 tx=0x7f304400c2d0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 shutdown_connections 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f30340b6680 0x7f30340b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f304c109e20 0x7f304c19fdd0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f304c1094d0 0x7f304c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 --2- 172.21.15.102:0/1450216679 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f304c103b90 0x7f304c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.182+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 >> 172.21.15.102:0/1450216679 conn(0x7f304c0ff5e0 msgr2=0x7f304c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.183+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 shutdown_connections 2024-09-21T03:41:31.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:31.183+0000 7f3051f74640 1 -- 172.21.15.102:0/1450216679 wait complete. 2024-09-21T03:41:31.952 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:41:32.197 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:32.578 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:32 smithi102 ceph-mon[31392]: pgmap v567: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:32.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 -- 172.21.15.102:0/1659926340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb054102a60 msgr2=0x7fb054102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 --2- 172.21.15.102:0/1659926340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb054102a60 0x7fb054102e70 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ca0 tx=0x7fb04402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 -- 172.21.15.102:0/1659926340 shutdown_connections 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 --2- 172.21.15.102:0/1659926340 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054108cf0 0x7fb05410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 --2- 172.21.15.102:0/1659926340 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb0541083a0 0x7fb0541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 --2- 172.21.15.102:0/1659926340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb054102a60 0x7fb054102e70 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 -- 172.21.15.102:0/1659926340 >> 172.21.15.102:0/1659926340 conn(0x7fb054079730 msgr2=0x7fb054079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 -- 172.21.15.102:0/1659926340 shutdown_connections 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.665+0000 7fb05be85640 1 -- 172.21.15.102:0/1659926340 wait complete. 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 Processor -- start 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 -- start start 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 0x7fb05419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb054108cf0 0x7fb05419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb054113b80 con 0x7fb0541083a0 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb054113a00 con 0x7fb054102a60 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05be85640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb054113d00 con 0x7fb054108cf0 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34422/0 (socket says 172.21.15.102:34422) 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb059420640 1 -- 172.21.15.102:0/3626898685 learned_addr learned my addr 172.21.15.102:0/3626898685 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb05a422640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb054108cf0 0x7fb05419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.666+0000 7fb059c21640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 0x7fb05419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 -- 172.21.15.102:0/3626898685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb054108cf0 msgr2=0x7fb05419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb054108cf0 0x7fb05419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 -- 172.21.15.102:0/3626898685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 msgr2=0x7fb05419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 0x7fb05419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 -- 172.21.15.102:0/3626898685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0541a04a0 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059c21640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 0x7fb05419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb059420640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c970 tx=0x7fb04800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb052ffd640 1 -- 172.21.15.102:0/3626898685 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb048007bb0 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0541a0790 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb052ffd640 1 -- 172.21.15.102:0/3626898685 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb048007d50 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb052ffd640 1 -- 172.21.15.102:0/3626898685 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04800f450 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.667+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0541a6ef0 con 0x7fb0541083a0 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.670+0000 7fb0623f9740 1 Processor -- start 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.670+0000 7fb0623f9740 1 -- start start 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3002f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc67390 0x55fd3002fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ffa5ea0 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ff952d0 con 0x55fd2fc67390 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb0623f9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ff990e0 con 0x55fd2fc88070 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb052ffd640 1 -- 172.21.15.102:0/3626898685 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fb048004f60 con 0x7fb0541083a0 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34436/0 (socket says 172.21.15.102:34436) 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 -- 172.21.15.102:0/561376271 learned_addr learned my addr 172.21.15.102:0/561376271 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb05a422640 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3002f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059420640 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc67390 0x55fd3002fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 -- 172.21.15.102:0/561376271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 msgr2=0x55fd3002f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3002f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 -- 172.21.15.102:0/561376271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc67390 msgr2=0x55fd3002fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc67390 0x55fd3002fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 -- 172.21.15.102:0/561376271 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2fcf3650 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.671+0000 7fb059c21640 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb044009a20 tx=0x7fb044031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf6668f0bb626da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb03bfff640 1 -- 172.21.15.102:0/561376271 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044003970 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb03bfff640 1 -- 172.21.15.102:0/561376271 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb044036070 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb03bfff640 1 -- 172.21.15.102:0/561376271 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440043d0 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb052ffd640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 0x7fb03c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb05a422640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 0x7fb03c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb052ffd640 1 -- 172.21.15.102:0/3626898685 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fb0480e74a0 con 0x7fb0541083a0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb0623f9740 1 -- 172.21.15.102:0/561376271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 msgr2=0x55fd3002f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb05a422640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 0x7fb03c0b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cbd0 tx=0x7fb04c00c380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.672+0000 7fb0623f9740 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fb044009a20 tx=0x7fb044031b40 comp rx=0 tx=0).stop 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 -- 172.21.15.102:0/561376271 shutdown_connections 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc5f1b0 0x55fd3002f800 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc67390 0x55fd3002fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 --2- 172.21.15.102:0/561376271 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3002f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 -- 172.21.15.102:0/561376271 >> 172.21.15.102:0/561376271 conn(0x55fd2fc7c460 msgr2=0x55fd3002d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 -- 172.21.15.102:0/561376271 shutdown_connections 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 -- 172.21.15.102:0/561376271 wait complete. 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 -- start start 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.673+0000 7fb0623f9740 1 Processor -- start 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3003b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fd2fdf6700 con 0x55fd2fc67390 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fd2ff30160 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55fd3003da40 con 0x55fd2fc88070 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0623f9740 10 client.0 _ll_register_callbacks cb 0x55fd2ff499e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:32.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34448/0 (socket says 172.21.15.102:34448) 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 -- 172.21.15.102:0/3978883102 learned_addr learned my addr 172.21.15.102:0/3978883102 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb05a422640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3003b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059c21640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 -- 172.21.15.102:0/3978883102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 msgr2=0x55fd3003b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3003b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 -- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 msgr2=0x55fd3003a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 -- 172.21.15.102:0/3978883102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2ff5dc90 con 0x55fd2fc67390 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb059420640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb0480aa520 tx=0x7fb0480a9210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e539c7f6d40cbb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.674+0000 7fb0397fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04801d040 con 0x55fd2fc67390 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fb0480ac710 con 0x55fd2fc67390 2024-09-21T03:41:32.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb044036070 con 0x55fd2fc67390 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb0480aca20 con 0x55fd2fc67390 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 10 client.16977 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fd30049680 con 0x55fd2fc67390 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb044036070 con 0x55fd2fc67390 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb0480abf80 con 0x55fd2fc67390 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 10 client.16977 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 10 client.16977 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 20 client.16977 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc469f0 0x55fd3004cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 4 client.16977 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd2ffa7df0 con 0x55fd2fc469f0 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.675+0000 7fb059c21640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc469f0 0x55fd3004cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.676+0000 7fb0397fa640 10 client.16977 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:32.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.676+0000 7fb059c21640 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc469f0 0x55fd3004cc70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dbd32aa999e2c51e server_cookie=4edfe987e13b70d1 in_seq=0 out_seq=0 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0397fa640 1 -- 172.21.15.102:0/3978883102 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd2ffa7df0 con 0x55fd2fc469f0 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0397fa640 10 client.16977 handle_command_reply: tid=0 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 client.16977 shutdown 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 msgr2=0x55fd3003ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fb0480aa520 tx=0x7fb0480a9210 comp rx=0 tx=0).stop 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 shutdown_connections 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc469f0 0x55fd3004cc70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3003ae20 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0397fa640 0 client.16977 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc88070 0x55fd3003b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 --2- 172.21.15.102:0/3978883102 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 >> 172.21.15.102:0/3978883102 conn(0x55fd2fc7c460 msgr2=0x55fd30032450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 shutdown_connections 2024-09-21T03:41:32.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 1 -- 172.21.15.102:0/3978883102 wait complete. 2024-09-21T03:41:32.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.677+0000 7fb0623f9740 20 client.16977 trim_cache size 0 max 16384 2024-09-21T03:41:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 Processor -- start 2024-09-21T03:41:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 -- start start 2024-09-21T03:41:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 0x55fd3002cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541b21d0 con 0x55fd2fc67390 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541afaa0 con 0x55fd2fc88070 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb0623f9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541ad910 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb059420640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34458/0 (socket says 172.21.15.102:34458) 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.690+0000 7fb059420640 1 -- 172.21.15.102:0/420518951 learned_addr learned my addr 172.21.15.102:0/420518951 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059c21640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb05a422640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 0x55fd3002cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 -- 172.21.15.102:0/420518951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc5f1b0 msgr2=0x55fd3003c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 -- 172.21.15.102:0/420518951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 msgr2=0x55fd3002cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 0x55fd3002cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 -- 172.21.15.102:0/420518951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd3003bba0 con 0x55fd2fc67390 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb05a422640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 0x55fd3002cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb059420640 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb04800afd0 tx=0x7fb048007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ba52a34225e2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb03b7fe640 1 -- 172.21.15.102:0/420518951 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04805c030 con 0x55fd2fc67390 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb03b7fe640 1 -- 172.21.15.102:0/420518951 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0480acdc0 con 0x55fd2fc67390 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.691+0000 7fb03b7fe640 1 -- 172.21.15.102:0/420518951 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04801d040 con 0x55fd2fc67390 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- 172.21.15.102:0/420518951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 msgr2=0x55fd3002c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb04800afd0 tx=0x7fb048007f90 comp rx=0 tx=0).stop 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- 172.21.15.102:0/420518951 shutdown_connections 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc67390 0x55fd3002c760 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc88070 0x55fd3002cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 --2- 172.21.15.102:0/420518951 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- 172.21.15.102:0/420518951 >> 172.21.15.102:0/420518951 conn(0x55fd2fc7c460 msgr2=0x55fd30046610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- 172.21.15.102:0/420518951 shutdown_connections 2024-09-21T03:41:32.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- 172.21.15.102:0/420518951 wait complete. 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 -- start start 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.692+0000 7fb0623f9740 1 Processor -- start 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc67390 0x55fd3003f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541adf60 con 0x55fd2fc88070 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541af3d0 con 0x55fd2fc5f1b0 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541ae630 con 0x55fd2fc67390 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb0623f9740 10 client.0 _ll_register_callbacks cb 0x7fb04800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:34460/0 (socket says 172.21.15.102:34460) 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 -- 172.21.15.102:0/4039412198 learned_addr learned my addr 172.21.15.102:0/4039412198 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:32.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb059c21640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb059420640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc67390 0x55fd3003f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 -- 172.21.15.102:0/4039412198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc67390 msgr2=0x55fd3003f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc67390 0x55fd3003f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 -- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 msgr2=0x55fd3003f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.693+0000 7fb05a422640 1 -- 172.21.15.102:0/4039412198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd300b6b70 con 0x55fd2fc88070 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb05a422640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb04c01aee0 tx=0x7fb04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722d3d2da763b503 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c027420 con 0x55fd2fc88070 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fb04c01b3f0 con 0x55fd2fc88070 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0480acdc0 con 0x55fd2fc88070 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb04c01b5f0 con 0x55fd2fc88070 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 10 client.16983 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:32.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55fd300b7dc0 con 0x55fd2fc88070 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fb0480acdc0 con 0x55fd2fc88070 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fb04c02d030 con 0x55fd2fc88070 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 10 client.16983 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 10 client.16983 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 20 client.16983 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc1bda0 0x55fd300ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 4 client.16983 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.694+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd2ffa38a0 con 0x55fd2fc1bda0 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb059c21640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc1bda0 0x55fd300ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb059c21640 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc1bda0 0x55fd300ba600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e38e55a89cfdb7c2 server_cookie=b9f4cbbf05086e25 in_seq=0 out_seq=0 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0397fa640 10 client.16983 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0397fa640 1 -- 172.21.15.102:0/4039412198 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd2ffa38a0 con 0x55fd2fc1bda0 2024-09-21T03:41:32.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0397fa640 10 client.16983 handle_command_reply: tid=0 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 client.16983 shutdown 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 msgr2=0x55fd300b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb04c01aee0 tx=0x7fb04c0046c0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 shutdown_connections 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55fd2fc1bda0 0x55fd300ba600 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fd2fc88070 0x55fd300b6630 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55fd2fc67390 0x55fd3003f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0397fa640 0 client.16983 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 --2- 172.21.15.102:0/4039412198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fd2fc5f1b0 0x55fd3003f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.695+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 >> 172.21.15.102:0/4039412198 conn(0x55fd2fc7c460 msgr2=0x55fd300343d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 shutdown_connections 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb0623f9740 1 -- 172.21.15.102:0/4039412198 wait complete. 2024-09-21T03:41:32.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb0623f9740 20 client.16983 trim_cache size 0 max 16384 2024-09-21T03:41:32.707 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 msgr2=0x7fb03c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 0x7fb03c0b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cbd0 tx=0x7fb04c00c380 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 msgr2=0x7fb05419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb04800c970 tx=0x7fb04800ce30 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 shutdown_connections 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fb03c0b6680 0x7fb03c0b8b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0541083a0 0x7fb05419aad0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fb054108cf0 0x7fb05419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 --2- 172.21.15.102:0/3626898685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb054102a60 0x7fb05419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 >> 172.21.15.102:0/3626898685 conn(0x7fb054079730 msgr2=0x7fb054101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 shutdown_connections 2024-09-21T03:41:32.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:32.696+0000 7fb05be85640 1 -- 172.21.15.102:0/3626898685 wait complete. 2024-09-21T03:41:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:32 smithi148 ceph-mon[34651]: pgmap v567: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:32 smithi121 ceph-mon[34316]: pgmap v567: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:33.488 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:41:33.736 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 -- 172.21.15.102:0/1563490634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 msgr2=0x7ff76c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 --2- 172.21.15.102:0/1563490634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c103f70 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009900 tx=0x7ff75c02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 -- 172.21.15.102:0/1563490634 shutdown_connections 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 --2- 172.21.15.102:0/1563490634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 --2- 172.21.15.102:0/1563490634 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 0x7ff76c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 --2- 172.21.15.102:0/1563490634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c103f70 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 -- 172.21.15.102:0/1563490634 >> 172.21.15.102:0/1563490634 conn(0x7ff76c0ff5d0 msgr2=0x7ff76c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 -- 172.21.15.102:0/1563490634 shutdown_connections 2024-09-21T03:41:34.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.235+0000 7ff772201640 1 -- 172.21.15.102:0/1563490634 wait complete. 2024-09-21T03:41:34.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 Processor -- start 2024-09-21T03:41:34.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 -- start start 2024-09-21T03:41:34.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 0x7ff76c19ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c19ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c113cb0 con 0x7ff76c103b60 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c113b30 con 0x7ff76c109df0 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff772201640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c113e30 con 0x7ff76c1094a0 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38232/0 (socket says 172.21.15.102:38232) 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.236+0000 7ff76b7fe640 1 -- 172.21.15.102:0/674272975 learned_addr learned my addr 172.21.15.102:0/674272975 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76affd640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 0x7ff76c19ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76bfff640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c19ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 -- 172.21.15.102:0/674272975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 msgr2=0x7ff76c19ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 0x7ff76c19ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 -- 172.21.15.102:0/674272975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 msgr2=0x7ff76c19ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c19ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 -- 172.21.15.102:0/674272975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c1a06b0 con 0x7ff76c103b60 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76bfff640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff75c006010 tx=0x7ff75c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff768ff9640 1 -- 172.21.15.102:0/674272975 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c03f070 con 0x7ff76c103b60 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c1a0940 con 0x7ff76c103b60 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff768ff9640 1 -- 172.21.15.102:0/674272975 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff75c031e10 con 0x7ff76c103b60 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff768ff9640 1 -- 172.21.15.102:0/674272975 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c035030 con 0x7ff76c103b60 2024-09-21T03:41:34.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.237+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1a7100 con 0x7ff76c103b60 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 Processor -- start 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 -- start start 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff768ff9640 1 -- 172.21.15.102:0/674272975 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ff75c042070 con 0x7ff76c103b60 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39dabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e9d3950ea0 con 0x55e9d3612390 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e9d39402d0 con 0x55e9d3633070 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff778775740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e9d39440e0 con 0x55e9d360a1b0 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff76affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff76affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38244/0 (socket says 172.21.15.102:38244) 2024-09-21T03:41:34.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff76affd640 1 -- 172.21.15.102:0/3217285825 learned_addr learned my addr 172.21.15.102:0/3217285825 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff76bfff640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.240+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39dabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 -- 172.21.15.102:0/3217285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 msgr2=0x55e9d39dabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39dabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 -- 172.21.15.102:0/3217285825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 msgr2=0x55e9d39da6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39da6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 -- 172.21.15.102:0/3217285825 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d369e650 con 0x55e9d3612390 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39dabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff768ff9640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 0x7ff7580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76affd640 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff75400b790 tx=0x7ff75400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee34e14feab1b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff76bfff640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 0x7ff7580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff768ff9640 1 -- 172.21.15.102:0/674272975 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7ff75c108230 con 0x7ff76c103b60 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff761ffb640 1 -- 172.21.15.102:0/3217285825 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75400d950 con 0x55e9d3612390 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff761ffb640 1 -- 172.21.15.102:0/3217285825 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff754018070 con 0x55e9d3612390 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.241+0000 7ff761ffb640 1 -- 172.21.15.102:0/3217285825 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540123e0 con 0x55e9d3612390 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- 172.21.15.102:0/3217285825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 msgr2=0x55e9d39db120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff76bfff640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 0x7ff7580b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff76400f4c0 tx=0x7ff764007740 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff75400b790 tx=0x7ff75400bc50 comp rx=0 tx=0).stop 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- 172.21.15.102:0/3217285825 shutdown_connections 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39db120 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39dabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 --2- 172.21.15.102:0/3217285825 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- 172.21.15.102:0/3217285825 >> 172.21.15.102:0/3217285825 conn(0x55e9d3627460 msgr2=0x55e9d39d8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- 172.21.15.102:0/3217285825 shutdown_connections 2024-09-21T03:41:34.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- 172.21.15.102:0/3217285825 wait complete. 2024-09-21T03:41:34.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.242+0000 7ff778775740 1 -- start start 2024-09-21T03:41:34.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 Processor -- start 2024-09-21T03:41:34.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39f2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e9d37a1700 con 0x55e9d3612390 2024-09-21T03:41:34.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55e9d38db160 con 0x55e9d3633070 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55e9d39e8e80 con 0x55e9d360a1b0 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff778775740 10 client.0 _ll_register_callbacks cb 0x55e9d38f49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff76affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff76affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38256/0 (socket says 172.21.15.102:38256) 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff76affd640 1 -- 172.21.15.102:0/2946220006 learned_addr learned my addr 172.21.15.102:0/2946220006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff76bfff640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.243+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 -- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 msgr2=0x55e9d39e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 -- 172.21.15.102:0/2946220006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 msgr2=0x55e9d39f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 -- 172.21.15.102:0/2946220006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9d3908c90 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff76affd640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff754006a70 tx=0x7ff754013480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46a89f52b670612 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff74affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75400db50 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7ff75400dcf0 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff754018070 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff754013880 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff778775740 10 client.16995 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e9d39f4b60 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.244+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff754018070 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff754024540 con 0x55e9d3612390 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 10 client.16995 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:34.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 10 client.16995 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 20 client.16995 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35f19f0 0x55e9d39f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 4 client.16995 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9d3952df0 con 0x55e9d35f19f0 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35f19f0 0x55e9d39f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff74affd640 10 client.16995 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.245+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35f19f0 0x55e9d39f7fd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6974e44f4cd5b8d server_cookie=86b1a92258e99f88 in_seq=0 out_seq=0 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.246+0000 7ff74affd640 1 -- 172.21.15.102:0/2946220006 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9d3952df0 con 0x55e9d35f19f0 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.246+0000 7ff74affd640 10 client.16995 handle_command_reply: tid=0 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.246+0000 7ff778775740 1 client.16995 shutdown 2024-09-21T03:41:34.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 msgr2=0x55e9d39e6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff754006a70 tx=0x7ff754013480 comp rx=0 tx=0).stop 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 shutdown_connections 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35f19f0 0x55e9d39f7fd0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3612390 0x55e9d39e6270 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d3633070 0x55e9d39f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 --2- 172.21.15.102:0/2946220006 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d360a1b0 0x55e9d39e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 >> 172.21.15.102:0/2946220006 conn(0x55e9d3627460 msgr2=0x55e9d39dd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff74affd640 0 client.16995 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 shutdown_connections 2024-09-21T03:41:34.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 1 -- 172.21.15.102:0/2946220006 wait complete. 2024-09-21T03:41:34.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.247+0000 7ff778775740 20 client.16995 trim_cache size 0 max 16384 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 Processor -- start 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 -- start start 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39e61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1b22f0 con 0x55e9d3633070 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1afbc0 con 0x55e9d360a1b0 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff778775740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ada30 con 0x55e9d3612390 2024-09-21T03:41:34.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38268/0 (socket says 172.21.15.102:38268) 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 -- 172.21.15.102:0/3343638257 learned_addr learned my addr 172.21.15.102:0/3343638257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76affd640 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39e61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 -- 172.21.15.102:0/3343638257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 msgr2=0x55e9d39f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 -- 172.21.15.102:0/3343638257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 msgr2=0x55e9d39e61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39e61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.260+0000 7ff76bfff640 1 -- 172.21.15.102:0/3343638257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9d39e4230 con 0x55e9d3633070 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.261+0000 7ff76bfff640 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff7640109d0 tx=0x7ff764012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8a19997506bbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.261+0000 7ff7617fa640 1 -- 172.21.15.102:0/3343638257 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76401edc0 con 0x55e9d3633070 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.261+0000 7ff7617fa640 1 -- 172.21.15.102:0/3343638257 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff7640268b0 con 0x55e9d3633070 2024-09-21T03:41:34.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.261+0000 7ff7617fa640 1 -- 172.21.15.102:0/3343638257 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764019940 con 0x55e9d3633070 2024-09-21T03:41:34.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- 172.21.15.102:0/3343638257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 msgr2=0x55e9d39e2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff7640109d0 tx=0x7ff764012000 comp rx=0 tx=0).stop 2024-09-21T03:41:34.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- 172.21.15.102:0/3343638257 shutdown_connections 2024-09-21T03:41:34.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d39e2f20 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 --2- 172.21.15.102:0/3343638257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39e61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- 172.21.15.102:0/3343638257 >> 172.21.15.102:0/3343638257 conn(0x55e9d3627460 msgr2=0x55e9d39e5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- 172.21.15.102:0/3343638257 shutdown_connections 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- 172.21.15.102:0/3343638257 wait complete. 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 -- start start 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.262+0000 7ff778775740 1 Processor -- start 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ae080 con 0x55e9d3633070 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1af4f0 con 0x55e9d360a1b0 2024-09-21T03:41:34.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1ae750 con 0x55e9d3612390 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff778775740 10 client.0 _ll_register_callbacks cb 0x7ff7640075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38284/0 (socket says 172.21.15.102:38284) 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76b7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 -- 172.21.15.102:0/2089316198 learned_addr learned my addr 172.21.15.102:0/2089316198 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76affd640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 -- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 msgr2=0x55e9d39f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 -- 172.21.15.102:0/2089316198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 msgr2=0x55e9d39f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 -- 172.21.15.102:0/2089316198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9d3a59de0 con 0x55e9d3633070 2024-09-21T03:41:34.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff76bfff640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff7640193e0 tx=0x7ff764010790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d7c8839dfcfe8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.263+0000 7ff74affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764036020 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7ff764026a60 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7640268b0 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff764041050 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 10 client.17001 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55e9d3a622e0 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff7640268b0 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ff764025070 con 0x55e9d3633070 2024-09-21T03:41:34.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 10 client.17001 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 20 client.17001 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35c6da0 0x55e9d3a64a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 4 client.17001 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.264+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e9d394e8a0 con 0x55e9d35c6da0 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35c6da0 0x55e9d3a64a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff76b7fe640 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35c6da0 0x55e9d3a64a00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31bfeb7816f92f04 server_cookie=a9d29983db71a78b in_seq=0 out_seq=0 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff74affd640 10 client.17001 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff74affd640 1 -- 172.21.15.102:0/2089316198 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e9d394e8a0 con 0x55e9d35c6da0 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff74affd640 10 client.17001 handle_command_reply: tid=0 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.265+0000 7ff778775740 1 client.17001 shutdown 2024-09-21T03:41:34.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 msgr2=0x55e9d3a59770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7ff7640193e0 tx=0x7ff764010790 comp rx=0 tx=0).stop 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 shutdown_connections 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55e9d35c6da0 0x55e9d3a64a00 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e9d3633070 0x55e9d3a59770 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55e9d3612390 0x55e9d39f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 --2- 172.21.15.102:0/2089316198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55e9d360a1b0 0x55e9d39f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff74affd640 0 client.17001 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 >> 172.21.15.102:0/2089316198 conn(0x55e9d3627460 msgr2=0x55e9d39e45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 shutdown_connections 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 1 -- 172.21.15.102:0/2089316198 wait complete. 2024-09-21T03:41:34.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff778775740 20 client.17001 trim_cache size 0 max 16384 2024-09-21T03:41:34.274 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:41:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 msgr2=0x7ff7580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 0x7ff7580b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff76400f4c0 tx=0x7ff764007740 comp rx=0 tx=0).stop 2024-09-21T03:41:34.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 msgr2=0x7ff76c19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff75c006010 tx=0x7ff75c004430 comp rx=0 tx=0).stop 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 shutdown_connections 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff7580b6680 0x7ff7580b8b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.266+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff76c109df0 0x7ff76c19ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.267+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff76c1094a0 0x7ff76c19ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.267+0000 7ff772201640 1 --2- 172.21.15.102:0/674272975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff76c103b60 0x7ff76c19a740 secure :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff75c006010 tx=0x7ff75c004430 comp rx=0 tx=0).stop 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.267+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 >> 172.21.15.102:0/674272975 conn(0x7ff76c0ff5d0 msgr2=0x7ff76c1019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.267+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 shutdown_connections 2024-09-21T03:41:34.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:34.267+0000 7ff772201640 1 -- 172.21.15.102:0/674272975 wait complete. 2024-09-21T03:41:34.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:34 smithi102 ceph-mon[31392]: pgmap v568: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:34 smithi148 ceph-mon[34651]: pgmap v568: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:34.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:34 smithi121 ceph-mon[34316]: pgmap v568: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:35.957 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:41:35.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:41:36.214 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:36.598 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:36 smithi102 ceph-mon[31392]: pgmap v569: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 -- 172.21.15.102:0/3729536344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 msgr2=0x7fee80104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 --2- 172.21.15.102:0/3729536344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee80104a70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009900 tx=0x7fee7c02a410 comp rx=0 tx=0).stop 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 -- 172.21.15.102:0/3729536344 shutdown_connections 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 --2- 172.21.15.102:0/3729536344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80102890 0x7fee80112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 --2- 172.21.15.102:0/3729536344 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80101d70 0x7fee80102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 --2- 172.21.15.102:0/3729536344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee80104a70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 -- 172.21.15.102:0/3729536344 >> 172.21.15.102:0/3729536344 conn(0x7fee80077c60 msgr2=0x7fee800780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 -- 172.21.15.102:0/3729536344 shutdown_connections 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.693+0000 7fee8771b640 1 -- 172.21.15.102:0/3729536344 wait complete. 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 Processor -- start 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 -- start start 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 0x7fee8019c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 0x7fee8019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee80115dd0 con 0x7fee80104660 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee80115c50 con 0x7fee80101d70 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee8771b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee80115f50 con 0x7fee80102890 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee854b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 0x7fee8019c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38304/0 (socket says 172.21.15.102:38304) 2024-09-21T03:41:36.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 -- 172.21.15.102:0/719397657 learned_addr learned my addr 172.21.15.102:0/719397657 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee854b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 0x7fee8019c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:34946/0 (socket says 172.21.15.102:34946) 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee84cb6640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 0x7fee8019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 -- 172.21.15.102:0/719397657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 msgr2=0x7fee8019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 0x7fee8019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 -- 172.21.15.102:0/719397657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 msgr2=0x7fee8019c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 0x7fee8019c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee85cb8640 1 -- 172.21.15.102:0/719397657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee801a26d0 con 0x7fee80104660 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.694+0000 7fee84cb6640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 0x7fee8019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee85cb8640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fee7800eaa0 tx=0x7fee7800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee767fc640 1 -- 172.21.15.102:0/719397657 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7800cdb0 con 0x7fee80104660 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee801a29c0 con 0x7fee80104660 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee767fc640 1 -- 172.21.15.102:0/719397657 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee78005020 con 0x7fee80104660 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee767fc640 1 -- 172.21.15.102:0/719397657 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee780116d0 con 0x7fee80104660 2024-09-21T03:41:36.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.695+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee801a9120 con 0x7fee80104660 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 Processor -- start 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee767fc640 1 -- 172.21.15.102:0/719397657 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fee780051d0 con 0x7fee80104660 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 -- start start 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065e2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f306558e60 con 0x55f30623b350 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f306548290 con 0x55f306212490 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.699+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f30654c0a0 con 0x55f30621a670 2024-09-21T03:41:36.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38320/0 (socket says 172.21.15.102:38320) 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 -- 172.21.15.102:0/1579323468 learned_addr learned my addr 172.21.15.102:0/1579323468 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee854b7640 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065e2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 -- 172.21.15.102:0/1579323468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 msgr2=0x55f3065e2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065e2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 -- 172.21.15.102:0/1579323468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 msgr2=0x55f3065e2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee767fc640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 0x7fee6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065e2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 -- 172.21.15.102:0/1579323468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3062a6930 con 0x55f30623b350 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee85cb8640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 0x7fee6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee84cb6640 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fee7000cf70 tx=0x7fee7000c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ad0c18d9386158 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.700+0000 7fee767fc640 1 -- 172.21.15.102:0/719397657 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fee780e7980 con 0x7fee80104660 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.701+0000 7fee6b7fe640 1 -- 172.21.15.102:0/1579323468 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70018030 con 0x55f30623b350 2024-09-21T03:41:36.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.701+0000 7fee6b7fe640 1 -- 172.21.15.102:0/1579323468 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee700054f0 con 0x55f30623b350 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.701+0000 7fee6b7fe640 1 -- 172.21.15.102:0/1579323468 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee700108a0 con 0x55f30623b350 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- 172.21.15.102:0/1579323468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 msgr2=0x55f3065e2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fee7000cf70 tx=0x7fee7000c600 comp rx=0 tx=0).stop 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee85cb8640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 0x7fee6c0b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee780a9d60 tx=0x7fee780a1ff0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- 172.21.15.102:0/1579323468 shutdown_connections 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065e2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065e2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/1579323468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30623b350 0x55f3065e2430 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- 172.21.15.102:0/1579323468 >> 172.21.15.102:0/1579323468 conn(0x55f30622f740 msgr2=0x55f3065e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- 172.21.15.102:0/1579323468 shutdown_connections 2024-09-21T03:41:36.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- 172.21.15.102:0/1579323468 wait complete. 2024-09-21T03:41:36.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 -- start start 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.702+0000 7fee8dc8f740 1 Processor -- start 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30623b350 0x55f3065f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f3063a9890 con 0x55f306212490 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f3064e2d40 con 0x55f30623b350 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f3065f0c10 con 0x55f30621a670 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee8dc8f740 10 client.0 _ll_register_callbacks cb 0x55f306546c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38332/0 (socket says 172.21.15.102:38332) 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 -- 172.21.15.102:0/2861015222 learned_addr learned my addr 172.21.15.102:0/2861015222 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee854b7640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30623b350 0x55f3065f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 -- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 msgr2=0x55f3065ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.703+0000 7fee84cb6640 1 -- 172.21.15.102:0/2861015222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30623b350 msgr2=0x55f3065f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee84cb6640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30623b350 0x55f3065f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee84cb6640 1 -- 172.21.15.102:0/2861015222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3065fa570 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee84cb6640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c430 tx=0x7fee70005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e24e87ed9a458d6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70018050 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fee70010840 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee700054f0 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fee70033050 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee8dc8f740 10 client.17013 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.704+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f3065fce80 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee700054f0 con 0x55f306212490 2024-09-21T03:41:36.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fee7001d8b0 con 0x55f306212490 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 10 client.17013 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 10 client.17013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 20 client.17013 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061f9cd0 0x55f3066001e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 4 client.17013 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f30655adb0 con 0x55f3061f9cd0 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.705+0000 7fee854b7640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061f9cd0 0x55f3066001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.706+0000 7fee68ff9640 10 client.17013 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.706+0000 7fee854b7640 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061f9cd0 0x55f3066001e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34201f89016cf15e server_cookie=333527d800c1c443 in_seq=0 out_seq=0 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.706+0000 7fee68ff9640 1 -- 172.21.15.102:0/2861015222 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f30655adb0 con 0x55f3061f9cd0 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.706+0000 7fee68ff9640 10 client.17013 handle_command_reply: tid=0 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.706+0000 7fee8dc8f740 1 client.17013 shutdown 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 msgr2=0x55f3065ee0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c430 tx=0x7fee70005d20 comp rx=0 tx=0).stop 2024-09-21T03:41:36.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 shutdown_connections 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30623b350 0x55f3065f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30621a670 0x55f3065ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061f9cd0 0x55f3066001e0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/2861015222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ee0d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 >> 172.21.15.102:0/2861015222 conn(0x55f30622f740 msgr2=0x55f3065e5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee68ff9640 0 client.17013 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 shutdown_connections 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 1 -- 172.21.15.102:0/2861015222 wait complete. 2024-09-21T03:41:36.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.707+0000 7fee8dc8f740 20 client.17013 trim_cache size 0 max 16384 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.724+0000 7fee8dc8f740 1 Processor -- start 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.724+0000 7fee8dc8f740 1 -- start start 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30621a670 0x55f3065efb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065e76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee801b43e0 con 0x55f306212490 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee801b1cb0 con 0x55f30621a670 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee801afb20 con 0x55f30623b350 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38348/0 (socket says 172.21.15.102:38348) 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 -- 172.21.15.102:0/671187376 learned_addr learned my addr 172.21.15.102:0/671187376 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:36.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee854b7640 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30621a670 0x55f3065efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065e76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 -- 172.21.15.102:0/671187376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 msgr2=0x55f3065e76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065e76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 -- 172.21.15.102:0/671187376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30621a670 msgr2=0x55f3065efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30621a670 0x55f3065efb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 -- 172.21.15.102:0/671187376 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3065e0f20 con 0x55f306212490 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.725+0000 7fee84cb6640 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c7b0 tx=0x7fee7000c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e701042a641c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.726+0000 7fee6affd640 1 -- 172.21.15.102:0/671187376 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70021030 con 0x55f306212490 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.726+0000 7fee6affd640 1 -- 172.21.15.102:0/671187376 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee70019040 con 0x55f306212490 2024-09-21T03:41:36.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.726+0000 7fee6affd640 1 -- 172.21.15.102:0/671187376 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee70018040 con 0x55f306212490 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- 172.21.15.102:0/671187376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 msgr2=0x55f3065ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fee7000c7b0 tx=0x7fee7000c460 comp rx=0 tx=0).stop 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- 172.21.15.102:0/671187376 shutdown_connections 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065e76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f30621a670 0x55f3065efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/671187376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f306212490 0x55f3065ed760 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- 172.21.15.102:0/671187376 >> 172.21.15.102:0/671187376 conn(0x55f30622f740 msgr2=0x55f3065ef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- 172.21.15.102:0/671187376 shutdown_connections 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- 172.21.15.102:0/671187376 wait complete. 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 -- start start 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.727+0000 7fee8dc8f740 1 Processor -- start 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fee801b0170 con 0x55f30621a670 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fee801b15e0 con 0x55f306212490 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fee801b0840 con 0x55f30623b350 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee8dc8f740 10 client.0 _ll_register_callbacks cb 0x7fee7c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38362/0 (socket says 172.21.15.102:38362) 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 -- 172.21.15.102:0/4080966226 learned_addr learned my addr 172.21.15.102:0/4080966226 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee84cb6640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee84cb6640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 -- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 msgr2=0x55f3065f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 -- 172.21.15.102:0/4080966226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 msgr2=0x55f3065f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 -- 172.21.15.102:0/4080966226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3065f69f0 con 0x55f30621a670 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee84cb6640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee854b7640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009850 tx=0x7fee7c031730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b747acdcaa501 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee68ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.728+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c035040 con 0x55f30621a670 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fee7c004240 con 0x55f30621a670 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee70019040 con 0x55f30621a670 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fee7c004440 con 0x55f30621a670 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 10 client.17019 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:36.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f30666ae40 con 0x55f30621a670 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fee70019040 con 0x55f30621a670 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fee7c054030 con 0x55f30621a670 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 10 client.17019 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 20 client.17019 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061cf080 0x55f30666d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 4 client.17019 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.729+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f306556860 con 0x55f3061cf080 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.730+0000 7fee84cb6640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061cf080 0x55f30666d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.730+0000 7fee84cb6640 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061cf080 0x55f30666d630 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace6e991a447b71a server_cookie=a1a4ebf41e6cc387 in_seq=0 out_seq=0 2024-09-21T03:41:36.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.730+0000 7fee68ff9640 10 client.17019 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee68ff9640 1 -- 172.21.15.102:0/4080966226 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f306556860 con 0x55f3061cf080 2024-09-21T03:41:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee68ff9640 10 client.17019 handle_command_reply: tid=0 2024-09-21T03:41:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 client.17019 shutdown 2024-09-21T03:41:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 msgr2=0x55f3065f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009850 tx=0x7fee7c031730 comp rx=0 tx=0).stop 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 shutdown_connections 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f3061cf080 0x55f30666d630 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f30621a670 0x55f3065f63b0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f30623b350 0x55f3065f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee68ff9640 0 client.17019 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 --2- 172.21.15.102:0/4080966226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f306212490 0x55f3065f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 >> 172.21.15.102:0/4080966226 conn(0x55f30622f740 msgr2=0x55f3065efb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 shutdown_connections 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 1 -- 172.21.15.102:0/4080966226 wait complete. 2024-09-21T03:41:36.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.732+0000 7fee8dc8f740 20 client.17019 trim_cache size 0 max 16384 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "3715d1a9-82d4-4c4f-a5de-443e1c7a0723", 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:36.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 msgr2=0x7fee6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 0x7fee6c0b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fee780a9d60 tx=0x7fee780a1ff0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 msgr2=0x7fee801a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fee7800eaa0 tx=0x7fee7800ef60 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 shutdown_connections 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee6c0b6680 0x7fee6c0b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fee80104660 0x7fee801a1fa0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fee80102890 0x7fee8019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 --2- 172.21.15.102:0/719397657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fee80101d70 0x7fee8019c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 >> 172.21.15.102:0/719397657 conn(0x7fee80077c60 msgr2=0x7fee80100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 shutdown_connections 2024-09-21T03:41:36.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:36.733+0000 7fee8771b640 1 -- 172.21.15.102:0/719397657 wait complete. 2024-09-21T03:41:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:36 smithi148 ceph-mon[34651]: pgmap v569: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:36 smithi121 ceph-mon[34316]: pgmap v569: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:37.656 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:41:37.879 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:37 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:41:37.879 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:37 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:37.879 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:37 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:41:37.879 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:37 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:37.909 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:41:37.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:37 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:41:37.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:37 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:37.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:37 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:41:37.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:37 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:38.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:37 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:41:38.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:37 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:38.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:37 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:41:38.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:37 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 -- 172.21.15.102:0/1329010671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc41062d0 msgr2=0x7fafc41066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/1329010671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc41062d0 0x7fafc41066e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009900 tx=0x7fafc002a410 comp rx=0 tx=0).stop 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 -- 172.21.15.102:0/1329010671 shutdown_connections 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/1329010671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc41062d0 0x7fafc41066e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/1329010671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc4106c20 0x7fafc4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/1329010671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc4101ff0 0x7fafc4102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 -- 172.21.15.102:0/1329010671 >> 172.21.15.102:0/1329010671 conn(0x7fafc4079e30 msgr2=0x7fafc407a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 -- 172.21.15.102:0/1329010671 shutdown_connections 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.408+0000 7fafcb4e4640 1 -- 172.21.15.102:0/1329010671 wait complete. 2024-09-21T03:41:38.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.409+0000 7fafcb4e4640 1 Processor -- start 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.409+0000 7fafcb4e4640 1 -- start start 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 0x7fafc419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc4106c20 0x7fafc419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fafc4113be0 con 0x7fafc4101ff0 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fafc4113a60 con 0x7fafc41062d0 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafc4113d60 con 0x7fafc4106c20 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38380/0 (socket says 172.21.15.102:38380) 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 -- 172.21.15.102:0/3614467936 learned_addr learned my addr 172.21.15.102:0/3614467936 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 0x7fafc419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 -- 172.21.15.102:0/3614467936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc4106c20 msgr2=0x7fafc419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc4106c20 0x7fafc419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 -- 172.21.15.102:0/3614467936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 msgr2=0x7fafc419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 0x7fafc419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 -- 172.21.15.102:0/3614467936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc41a03c0 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 0x7fafc419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafc9280640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c920 tx=0x7fafb800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafb67fc640 1 -- 172.21.15.102:0/3614467936 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8007c70 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc41a06b0 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafb67fc640 1 -- 172.21.15.102:0/3614467936 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafb8007e10 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafb67fc640 1 -- 172.21.15.102:0/3614467936 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80188c0 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.410+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc41a6ed0 con 0x7fafc4101ff0 2024-09-21T03:41:38.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.414+0000 7fafb67fc640 1 -- 172.21.15.102:0/3614467936 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fafb8018a60 con 0x7fafc4101ff0 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.414+0000 7fafd1a58740 1 Processor -- start 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.414+0000 7fafd1a58740 1 -- start start 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.414+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089eaa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.414+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 0x558089eaa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafd1a58740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558089e20e50 con 0x558089ae2390 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafd1a58740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558089e10280 con 0x558089ada1b0 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafd1a58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558089e14090 con 0x558089b03070 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38384/0 (socket says 172.21.15.102:38384) 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 -- 172.21.15.102:0/2974766917 learned_addr learned my addr 172.21.15.102:0/2974766917 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc9a81640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089eaa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafb67fc640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 0x7fafb00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc9280640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 0x558089eaa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 -- 172.21.15.102:0/2974766917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 msgr2=0x558089eaa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089eaa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 -- 172.21.15.102:0/2974766917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 msgr2=0x558089eaa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc9a81640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 0x7fafb00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 0x558089eaa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 -- 172.21.15.102:0/2974766917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558089b6e650 con 0x558089ae2390 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafb67fc640 1 -- 172.21.15.102:0/3614467936 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fafb80e7940 con 0x7fafc4101ff0 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc9280640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 0x558089eaa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.415+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009900 tx=0x7fafc0032ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7005f5a16ea6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafaf7fe640 1 -- 172.21.15.102:0/2974766917 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc003f070 con 0x558089ae2390 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafc9a81640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 0x7fafb00b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009270 tx=0x7fafbc009200 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafaf7fe640 1 -- 172.21.15.102:0/2974766917 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafc0031710 con 0x558089ae2390 2024-09-21T03:41:38.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafaf7fe640 1 -- 172.21.15.102:0/2974766917 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0035070 con 0x558089ae2390 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafd1a58740 1 -- 172.21.15.102:0/2974766917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 msgr2=0x558089eaacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.416+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009900 tx=0x7fafc0032ea0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- 172.21.15.102:0/2974766917 shutdown_connections 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eaacf0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ada1b0 0x558089eaa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2974766917 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089eaa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- 172.21.15.102:0/2974766917 >> 172.21.15.102:0/2974766917 conn(0x558089af7460 msgr2=0x558089ea8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- 172.21.15.102:0/2974766917 shutdown_connections 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- 172.21.15.102:0/2974766917 wait complete. 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- start start 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 Processor -- start 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089eb5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ec1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558089c71700 con 0x558089ada1b0 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558089dab110 con 0x558089ae2390 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.417+0000 7fafd1a58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558089eb89f0 con 0x558089b03070 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafd1a58740 10 client.0 _ll_register_callbacks cb 0x558089dc4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38396/0 (socket says 172.21.15.102:38396) 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 -- 172.21.15.102:0/1258071147 learned_addr learned my addr 172.21.15.102:0/1258071147 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089eb5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 -- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 msgr2=0x558089ec1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9a81640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ec1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ec1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 -- 172.21.15.102:0/1258071147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 msgr2=0x558089eb5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089eb5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 -- 172.21.15.102:0/1258071147 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558089dd8c40 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9a81640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ec1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089eb5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafc9280640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fafb80ad6e0 tx=0x7fafb80ad160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21dd6a021769dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafacff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80ade50 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fafb8018d50 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.418+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc0031710 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fafb80b2230 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 10 client.17031 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558089ec4700 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafc0031710 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fafb80a90a0 con 0x558089ada1b0 2024-09-21T03:41:38.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 10 client.17031 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 20 client.17031 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089ac19f0 0x558089ec7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 4 client.17031 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558089e22da0 con 0x558089ac19f0 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.419+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089ac19f0 0x558089ec7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.420+0000 7fafacff9640 10 client.17031 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.420+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089ac19f0 0x558089ec7bd0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174c398abd7d6ba server_cookie=bbc24a3e322a3f5a in_seq=0 out_seq=0 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafacff9640 1 -- 172.21.15.102:0/1258071147 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558089e22da0 con 0x558089ac19f0 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafacff9640 10 client.17031 handle_command_reply: tid=0 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 client.17031 shutdown 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 msgr2=0x558089eb5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fafb80ad6e0 tx=0x7fafb80ad160 comp rx=0 tx=0).stop 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 shutdown_connections 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ec1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089eb5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089ac19f0 0x558089ec7bd0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 --2- 172.21.15.102:0/1258071147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb5930 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafacff9640 0 client.17031 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 >> 172.21.15.102:0/1258071147 conn(0x558089af7460 msgr2=0x558089ead400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 shutdown_connections 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 1 -- 172.21.15.102:0/1258071147 wait complete. 2024-09-21T03:41:38.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.421+0000 7fafd1a58740 20 client.17031 trim_cache size 0 max 16384 2024-09-21T03:41:38.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.438+0000 7fafd1a58740 1 Processor -- start 2024-09-21T03:41:38.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 -- start start 2024-09-21T03:41:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089ea7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ea7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41b1fc0 con 0x558089ada1b0 2024-09-21T03:41:38.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41af890 con 0x558089ae2390 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafd1a58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41ad700 con 0x558089b03070 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38402/0 (socket says 172.21.15.102:38402) 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 -- 172.21.15.102:0/2375963121 learned_addr learned my addr 172.21.15.102:0/2375963121 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089ea7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9a81640 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ea7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 -- 172.21.15.102:0/2375963121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 msgr2=0x558089ea7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ea7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 -- 172.21.15.102:0/2375963121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 msgr2=0x558089ea7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089ea7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.439+0000 7fafc9280640 1 -- 172.21.15.102:0/2375963121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558089eb7d00 con 0x558089ada1b0 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.440+0000 7fafc9280640 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fafb8007590 tx=0x7fafb80ad1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6e8d8d2066cecb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.440+0000 7fafaeffd640 1 -- 172.21.15.102:0/2375963121 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80ade50 con 0x558089ada1b0 2024-09-21T03:41:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.440+0000 7fafaeffd640 1 -- 172.21.15.102:0/2375963121 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafb80a7e50 con 0x558089ada1b0 2024-09-21T03:41:38.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.440+0000 7fafaeffd640 1 -- 172.21.15.102:0/2375963121 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80b6ce0 con 0x558089ada1b0 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- 172.21.15.102:0/2375963121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 msgr2=0x558089eb6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fafb8007590 tx=0x7fafb80ad1d0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- 172.21.15.102:0/2375963121 shutdown_connections 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089b03070 0x558089ea7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089ae2390 0x558089ea7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 --2- 172.21.15.102:0/2375963121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ada1b0 0x558089eb6e50 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- 172.21.15.102:0/2375963121 >> 172.21.15.102:0/2375963121 conn(0x558089af7460 msgr2=0x558089eabc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- 172.21.15.102:0/2375963121 shutdown_connections 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- 172.21.15.102:0/2375963121 wait complete. 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 -- start start 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.441+0000 7fafd1a58740 1 Processor -- start 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 0x558089eb9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089b03070 0x558089f31540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41add50 con 0x558089ae2390 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41af1c0 con 0x558089b03070 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fafc41ae420 con 0x558089ada1b0 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafd1a58740 10 client.0 _ll_register_callbacks cb 0x7fafb800cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:41:38.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:38418/0 (socket says 172.21.15.102:38418) 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 -- 172.21.15.102:0/71059780 learned_addr learned my addr 172.21.15.102:0/71059780 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc9a81640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089b03070 0x558089f31540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc9280640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 0x558089eb9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 -- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 msgr2=0x558089eb9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 0x558089eb9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 -- 172.21.15.102:0/71059780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089b03070 msgr2=0x558089f31540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089b03070 0x558089f31540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 -- 172.21.15.102:0/71059780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558089f31a80 con 0x558089ae2390 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc9280640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 0x558089eb9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafc8a7f640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fafc0004620 tx=0x7fafc0032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b07fa3d8594a6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.442+0000 7fafacff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc003f040 con 0x558089ae2390 2024-09-21T03:41:38.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8586+0+0 (secure 0 0 0) 0x7fafc00316b0 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb80a7e50 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fafc0035040 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 10 client.17037 fetch_fsmap learned FSMap version 35 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558089f32b80 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fafb80a7e50 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fafc005bae0 con 0x558089ae2390 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 10 client.17037 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 20 client.17037 populate_metadata read hostname 'smithi102' 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089a96da0 0x558089f34ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 4 client.17037 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.443+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558089e1e850 con 0x558089a96da0 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafc9280640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089a96da0 0x558089f34ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:41:38.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafc9280640 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089a96da0 0x558089f34ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec03559cedc9da9c server_cookie=84fe455e8f01bcc7 in_seq=0 out_seq=0 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafacff9640 10 client.17037 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafacff9640 1 -- 172.21.15.102:0/71059780 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x558089e1e850 con 0x558089a96da0 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafacff9640 10 client.17037 handle_command_reply: tid=0 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.444+0000 7fafd1a58740 1 client.17037 shutdown 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 msgr2=0x558089eba510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fafc0004620 tx=0x7fafc0032f90 comp rx=0 tx=0).stop 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 shutdown_connections 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x558089a96da0 0x558089f34ed0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558089ae2390 0x558089eba510 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558089b03070 0x558089f31540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 --2- 172.21.15.102:0/71059780 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558089ada1b0 0x558089eb9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 >> 172.21.15.102:0/71059780 conn(0x558089af7460 msgr2=0x558089eabb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafacff9640 0 client.17037 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 shutdown_connections 2024-09-21T03:41:38.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 1 -- 172.21.15.102:0/71059780 wait complete. 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafd1a58740 20 client.17037 trim_cache size 0 max 16384 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "3715d1a9-82d4-4c4f-a5de-443e1c7a0723", 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:41:38.452 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.453 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:41:38.454 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.455 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.456 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:41:38.457 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.458 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.459 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:41:38.460 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:41:38.461 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:41:38.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 msgr2=0x7fafb00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 0x7fafb00b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009270 tx=0x7fafbc009200 comp rx=0 tx=0).stop 2024-09-21T03:41:38.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 msgr2=0x7fafc419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:41:38.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.445+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c920 tx=0x7fafb800cde0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 shutdown_connections 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fafb00b66b0 0x7fafb00b8bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fafc4106c20 0x7fafc419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fafc41062d0 0x7fafc419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 --2- 172.21.15.102:0/3614467936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fafc4101ff0 0x7fafc419a510 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 >> 172.21.15.102:0/3614467936 conn(0x7fafc4079e30 msgr2=0x7fafc41074e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 shutdown_connections 2024-09-21T03:41:38.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:41:38.446+0000 7fafcb4e4640 1 -- 172.21.15.102:0/3614467936 wait complete. 2024-09-21T03:41:38.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:38 smithi148 ceph-mon[34651]: pgmap v570: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:39.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:38 smithi121 ceph-mon[34316]: pgmap v570: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:39.115 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:38 smithi102 ceph-mon[31392]: pgmap v570: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:39.142 INFO:tasks.cephfs.filesystem:scrub status for tag:3715d1a9-82d4-4c4f-a5de-443e1c7a0723 - {'path': '/', 'tag': '3715d1a9-82d4-4c4f-a5de-443e1c7a0723', 'options': 'recursive,force'} 2024-09-21T03:41:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:40 smithi148 ceph-mon[34651]: pgmap v571: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:40.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:40 smithi121 ceph-mon[34316]: pgmap v571: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:40 smithi102 ceph-mon[31392]: pgmap v571: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-09-21T03:41:41.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:41 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:41:42.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:41 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:41:42.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:41 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:41:42.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:42 smithi148 ceph-mon[34651]: pgmap v572: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:43.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:42 smithi121 ceph-mon[34316]: pgmap v572: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:43.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:42 smithi102 ceph-mon[31392]: pgmap v572: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T03:41:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:44 smithi148 ceph-mon[34651]: pgmap v573: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:44 smithi121 ceph-mon[34316]: pgmap v573: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:44 smithi102 ceph-mon[31392]: pgmap v573: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:41:46.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:46 smithi148 ceph-mon[34651]: pgmap v574: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:46 smithi121 ceph-mon[34316]: pgmap v574: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:46.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:46 smithi102 ceph-mon[31392]: pgmap v574: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:41:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:48 smithi148 ceph-mon[34651]: pgmap v575: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:48 smithi121 ceph-mon[34316]: pgmap v575: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:48 smithi102 ceph-mon[31392]: pgmap v575: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:41:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:50 smithi148 ceph-mon[34651]: pgmap v576: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:41:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:50 smithi121 ceph-mon[34316]: pgmap v576: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:41:50.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:50 smithi102 ceph-mon[31392]: pgmap v576: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:41:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:52 smithi148 ceph-mon[34651]: pgmap v577: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:41:52.755 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:52 smithi102 ceph-mon[31392]: pgmap v577: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:41:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:52 smithi121 ceph-mon[34316]: pgmap v577: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:41:54.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:54 smithi148 ceph-mon[34651]: pgmap v578: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:41:54.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:54 smithi121 ceph-mon[34316]: pgmap v578: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:41:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:54 smithi102 ceph-mon[31392]: pgmap v578: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:41:56.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:56 smithi148 ceph-mon[34651]: pgmap v579: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:41:56.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:56 smithi121 ceph-mon[34316]: pgmap v579: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:41:56.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:56 smithi102 ceph-mon[31392]: pgmap v579: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:41:58.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:41:58 smithi148 ceph-mon[34651]: pgmap v580: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:41:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:41:58 smithi121 ceph-mon[34316]: pgmap v580: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:41:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:41:58 smithi102 ceph-mon[31392]: pgmap v580: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:00.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:00 smithi148 ceph-mon[34651]: pgmap v581: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:42:00.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:00 smithi121 ceph-mon[34316]: pgmap v581: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:42:00.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:00 smithi102 ceph-mon[31392]: pgmap v581: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:42:02.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:02 smithi148 ceph-mon[34651]: pgmap v582: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:42:02.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:02 smithi121 ceph-mon[34316]: pgmap v582: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:42:02.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:02 smithi102 ceph-mon[31392]: pgmap v582: 97 pgs: 97 active+clean; 174 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:42:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:03.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:42:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:03.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:42:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:42:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:42:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:42:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:42:04.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:04 smithi121 ceph-mon[34316]: pgmap v583: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:04 smithi102 ceph-mon[31392]: pgmap v583: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:04.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:04 smithi148 ceph-mon[34651]: pgmap v583: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:06.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:06 smithi148 ceph-mon[34651]: pgmap v584: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:06.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:06 smithi121 ceph-mon[34316]: pgmap v584: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:06.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:06 smithi102 ceph-mon[31392]: pgmap v584: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:42:08.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:08 smithi121 ceph-mon[34316]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:42:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:08 smithi121 ceph-mon[34316]: pgmap v586: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:08 smithi102 ceph-mon[31392]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:42:08.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:08 smithi102 ceph-mon[31392]: pgmap v586: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:08 smithi148 ceph-mon[34651]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T03:42:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:08 smithi148 ceph-mon[34651]: pgmap v586: 97 pgs: 97 active+clean; 174 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:09.143 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:42:09.391 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 -- 172.21.15.102:0/2978940533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8102a60 msgr2=0x7fe1d8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 --2- 172.21.15.102:0/2978940533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8102a60 0x7fe1d8102e70 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009900 tx=0x7fe1cc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 -- 172.21.15.102:0/2978940533 shutdown_connections 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 --2- 172.21.15.102:0/2978940533 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d8108cf0 0x7fe1d810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 --2- 172.21.15.102:0/2978940533 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d81083a0 0x7fe1d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 --2- 172.21.15.102:0/2978940533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8102a60 0x7fe1d8102e70 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 -- 172.21.15.102:0/2978940533 >> 172.21.15.102:0/2978940533 conn(0x7fe1d8079730 msgr2=0x7fe1d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 -- 172.21.15.102:0/2978940533 shutdown_connections 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.979+0000 7fe1df74a640 1 -- 172.21.15.102:0/2978940533 wait complete. 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.980+0000 7fe1df74a640 1 Processor -- start 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.980+0000 7fe1df74a640 1 -- start start 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d8102a60 0x7fe1d819b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 0x7fe1d819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8112a80 con 0x7fe1d8108cf0 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8112900 con 0x7fe1d81083a0 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1df74a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d8112c00 con 0x7fe1d8102a60 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51340/0 (socket says 172.21.15.102:51340) 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 -- 172.21.15.102:0/4183452255 learned_addr learned my addr 172.21.15.102:0/4183452255 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d8102a60 0x7fe1d819b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 0x7fe1d819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 -- 172.21.15.102:0/4183452255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d8102a60 msgr2=0x7fe1d819b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d8102a60 0x7fe1d819b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 -- 172.21.15.102:0/4183452255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 msgr2=0x7fe1d819b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 0x7fe1d819b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 -- 172.21.15.102:0/4183452255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d81a65c0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 0x7fe1d819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ddce7640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000eaa0 tx=0x7fe1d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.981+0000 7fe1ca7fc640 1 -- 172.21.15.102:0/4183452255 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000cdb0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.982+0000 7fe1ca7fc640 1 -- 172.21.15.102:0/4183452255 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d0005020 con 0x7fe1d8108cf0 2024-09-21T03:42:10.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.982+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d81a68b0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.982+0000 7fe1ca7fc640 1 -- 172.21.15.102:0/4183452255 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00116d0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.982+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d81a6df0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.984+0000 7fe1e5cbe740 1 Processor -- start 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.984+0000 7fe1ca7fc640 1 -- 172.21.15.102:0/4183452255 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe1d00051d0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 -- start start 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace34b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca6c390 0x5625ace350d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5625acdaae50 con 0x5625aca8d070 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5625acd9a280 con 0x5625aca641b0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5625acd9e090 con 0x5625aca6c390 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51342/0 (socket says 172.21.15.102:51342) 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3582850960 learned_addr learned my addr 172.21.15.102:0/3582850960 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace34b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca6c390 0x5625ace350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1ca7fc640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 0x7fe1c40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3582850960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca6c390 msgr2=0x5625ace350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca6c390 0x5625ace350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3582850960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 msgr2=0x5625ace34b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace34b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.985+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3582850960 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625acaf8650 con 0x5625aca8d070 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1ddce7640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 0x7fe1c40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4015550 tx=0x7fe1d40095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3f22a678fda371 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1ca7fc640 1 -- 172.21.15.102:0/4183452255 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fe1d00e79f0 con 0x7fe1d8108cf0 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1c37fe640 1 -- 172.21.15.102:0/3582850960 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40150f0 con 0x5625aca8d070 2024-09-21T03:42:10.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1c37fe640 1 -- 172.21.15.102:0/3582850960 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d4005020 con 0x5625aca8d070 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.986+0000 7fe1c37fe640 1 -- 172.21.15.102:0/3582850960 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4004a00 con 0x5625aca8d070 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1ddce7640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 0x7fe1c40b8c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00e5180 tx=0x7fe1d0097040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3582850960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 msgr2=0x5625ace34650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4015550 tx=0x7fe1d40095d0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3582850960 shutdown_connections 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca6c390 0x5625ace350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace34b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3582850960 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca8d070 0x5625ace34650 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3582850960 >> 172.21.15.102:0/3582850960 conn(0x5625aca81460 msgr2=0x5625ace32540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3582850960 shutdown_connections 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.987+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3582850960 wait complete. 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 -- start start 2024-09-21T03:42:10.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 Processor -- start 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace44130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5625acbfb700 con 0x5625aca6c390 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5625acd35110 con 0x5625aca641b0 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5625ace47160 con 0x5625aca8d070 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1e5cbe740 10 client.0 _ll_register_callbacks cb 0x5625acd4e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.988+0000 7fe1dd4e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51354/0 (socket says 172.21.15.102:51354) 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4118656646 learned_addr learned my addr 172.21.15.102:0/4118656646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace44130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 msgr2=0x5625ace50490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4118656646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 msgr2=0x5625ace44130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace44130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4118656646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625acd62c40 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009900 tx=0x7fe1cc031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191ae20c83721884 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc035070 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fe1cc004240 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d4005020 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.989+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe1cc031930 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 10 client.17049 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5625ace52ec0 con 0x5625aca6c390 2024-09-21T03:42:10.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d4005020 con 0x5625aca6c390 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe1cc004ad0 con 0x5625aca6c390 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 10 client.17049 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 20 client.17049 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625aca4b9f0 0x5625ace563f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 4 client.17049 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5625acdacda0 con 0x5625aca4b9f0 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.990+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625aca4b9f0 0x5625ace563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.991+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625aca4b9f0 0x5625ace563f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f0a06679a2e7a26 server_cookie=fb2333a39b9ce84 in_seq=0 out_seq=0 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.991+0000 7fe1c0ff9640 10 client.17049 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4118656646 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5625acdacda0 con 0x5625aca4b9f0 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1c0ff9640 10 client.17049 handle_command_reply: tid=0 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 client.17049 shutdown 2024-09-21T03:42:10.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 msgr2=0x5625ace44670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc009900 tx=0x7fe1cc031740 comp rx=0 tx=0).stop 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 shutdown_connections 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625aca4b9f0 0x5625ace563f0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca6c390 0x5625ace44670 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4118656646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace44130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 >> 172.21.15.102:0/4118656646 conn(0x5625aca81460 msgr2=0x5625ace377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1c0ff9640 0 client.17049 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 shutdown_connections 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4118656646 wait complete. 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:09.992+0000 7fe1e5cbe740 20 client.17049 trim_cache size 0 max 16384 2024-09-21T03:42:10.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 Processor -- start 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 -- start start 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace430c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81affc0 con 0x5625aca20da0 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ad890 con 0x5625aca641b0 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ab700 con 0x5625aca8d070 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51368/0 (socket says 172.21.15.102:51368) 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3077495249 learned_addr learned my addr 172.21.15.102:0/3077495249 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3077495249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 msgr2=0x5625ace50390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3077495249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 msgr2=0x5625ace430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.010+0000 7fe1dcce5640 1 -- 172.21.15.102:0/3077495249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625ace46c60 con 0x5625aca20da0 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.011+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4015fd0 tx=0x7fe1d4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356a5e54df057da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.011+0000 7fe1c2ffd640 1 -- 172.21.15.102:0/3077495249 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40053c0 con 0x5625aca20da0 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.011+0000 7fe1c2ffd640 1 -- 172.21.15.102:0/3077495249 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d4005560 con 0x5625aca20da0 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.011+0000 7fe1c2ffd640 1 -- 172.21.15.102:0/3077495249 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4003b40 con 0x5625aca20da0 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3077495249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 msgr2=0x5625ace41320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4015fd0 tx=0x7fe1d4009850 comp rx=0 tx=0).stop 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3077495249 shutdown_connections 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca20da0 0x5625ace41320 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca8d070 0x5625ace50390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/3077495249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca641b0 0x5625ace430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3077495249 >> 172.21.15.102:0/3077495249 conn(0x5625aca81460 msgr2=0x5625ace429b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3077495249 shutdown_connections 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/3077495249 wait complete. 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 -- start start 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.012+0000 7fe1e5cbe740 1 Processor -- start 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca20da0 0x5625ace48530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca8d070 0x5625ace48fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81abd50 con 0x5625aca641b0 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ad1c0 con 0x5625aca8d070 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d81ac420 con 0x5625aca20da0 2024-09-21T03:42:10.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1e5cbe740 10 client.0 _ll_register_callbacks cb 0x7fe1cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51382/0 (socket says 172.21.15.102:51382) 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4096353075 learned_addr learned my addr 172.21.15.102:0/4096353075 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca20da0 0x5625ace48530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca8d070 0x5625ace48fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca20da0 msgr2=0x5625ace48530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca20da0 0x5625ace48530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4096353075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca8d070 msgr2=0x5625ace48fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca8d070 0x5625ace48fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 -- 172.21.15.102:0/4096353075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625acebff10 con 0x5625aca641b0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1dd4e6640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc003640 tx=0x7fe1cc02aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1eca8c6c8ca0658 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.013+0000 7fe1c0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:10.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc035070 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fe1cc0051a0 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1d4005560 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe1cc05b050 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 10 client.17055 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5625acec11a0 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe1d4005560 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fe1cc053070 con 0x5625aca641b0 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 10 client.17055 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 20 client.17055 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625acec1860 0x5625acec3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 4 client.17055 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5625acda8850 con 0x5625acec1860 2024-09-21T03:42:10.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.014+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625acec1860 0x5625acec3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1c0ff9640 10 client.17055 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1dcce5640 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625acec1860 0x5625acec3c80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92510147bf4f51f server_cookie=a32666f4cfcb94b7 in_seq=0 out_seq=0 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1c0ff9640 1 -- 172.21.15.102:0/4096353075 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x5625acda8850 con 0x5625acec1860 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1c0ff9640 10 client.17055 handle_command_reply: tid=0 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 client.17055 shutdown 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 msgr2=0x5625ace48a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc003640 tx=0x7fe1cc02aa90 comp rx=0 tx=0).stop 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 shutdown_connections 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5625acec1860 0x5625acec3c80 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.127 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.129 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:42:10.130 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.131 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.132 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.133 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.134 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:42:10.135 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:10.136 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:10.137 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5625aca641b0 0x5625ace48a70 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5625aca8d070 0x5625ace48fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 --2- 172.21.15.102:0/4096353075 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5625aca20da0 0x5625ace48530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 >> 172.21.15.102:0/4096353075 conn(0x5625aca81460 msgr2=0x5625ace35680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.015+0000 7fe1c0ff9640 0 client.17055 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 shutdown_connections 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1e5cbe740 1 -- 172.21.15.102:0/4096353075 wait complete. 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1e5cbe740 20 client.17055 trim_cache size 0 max 16384 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 msgr2=0x7fe1c40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 0x7fe1c40b8c40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00e5180 tx=0x7fe1d0097040 comp rx=0 tx=0).stop 2024-09-21T03:42:10.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 msgr2=0x7fe1d819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000eaa0 tx=0x7fe1d000ef60 comp rx=0 tx=0).stop 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 shutdown_connections 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe1c40b6730 0x7fe1c40b8c40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe1d8108cf0 0x7fe1d819bdb0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe1d81083a0 0x7fe1d819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 --2- 172.21.15.102:0/4183452255 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe1d8102a60 0x7fe1d819b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 >> 172.21.15.102:0/4183452255 conn(0x7fe1d8079730 msgr2=0x7fe1d8101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 shutdown_connections 2024-09-21T03:42:10.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:10.016+0000 7fe1df74a640 1 -- 172.21.15.102:0/4183452255 wait complete. 2024-09-21T03:42:10.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:10 smithi148 ceph-mon[34651]: pgmap v587: 97 pgs: 97 active+clean; 163 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:10 smithi121 ceph-mon[34316]: pgmap v587: 97 pgs: 97 active+clean; 163 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:10.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:10 smithi102 ceph-mon[31392]: pgmap v587: 97 pgs: 97 active+clean; 163 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:42:11.044 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:42:11.045 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:11.294 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 -- 172.21.15.102:0/1573032746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96881094c0 msgr2=0x7f96881098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 --2- 172.21.15.102:0/1573032746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96881094c0 0x7f96881098d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f9670009900 tx=0x7f967002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 -- 172.21.15.102:0/1573032746 shutdown_connections 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 --2- 172.21.15.102:0/1573032746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f96881094c0 0x7f96881098d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 --2- 172.21.15.102:0/1573032746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9688109e10 0x7f9688110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 --2- 172.21.15.102:0/1573032746 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688103b80 0x7f9688103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 -- 172.21.15.102:0/1573032746 >> 172.21.15.102:0/1573032746 conn(0x7f96880ff590 msgr2=0x7f96881019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 -- 172.21.15.102:0/1573032746 shutdown_connections 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.777+0000 7f968d347640 1 -- 172.21.15.102:0/1573032746 wait complete. 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 Processor -- start 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 -- start start 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 0x7f968819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 0x7f968819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9688113bf0 con 0x7f9688103b80 2024-09-21T03:42:11.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9688113a70 con 0x7f96881094c0 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f968d347640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9688113d70 con 0x7f9688109e10 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.778+0000 7f9686ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51398/0 (socket says 172.21.15.102:51398) 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 -- 172.21.15.102:0/815537010 learned_addr learned my addr 172.21.15.102:0/815537010 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f96867fc640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 0x7f968819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f96877fe640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 0x7f968819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 -- 172.21.15.102:0/815537010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 msgr2=0x7f968819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 0x7f968819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 -- 172.21.15.102:0/815537010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 msgr2=0x7f968819aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 0x7f968819aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 -- 172.21.15.102:0/815537010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96881a03d0 con 0x7f9688103b80 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f96877fe640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 0x7f968819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f96867fc640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 0x7f968819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f9686ffd640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f967800c920 tx=0x7f967800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678007c70 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96881a06c0 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9678007e10 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96780188c0 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.779+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96881a6ee0 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.780+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688103f90 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.782+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f9678018a60 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.783+0000 7f967ffff640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 0x7f96740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.783+0000 7f96867fc640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 0x7f96740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.783+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7f96780e7c50 con 0x7f9688103b80 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.784+0000 7f96867fc640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 0x7f96740b8bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9670000c00 tx=0x7f9670032d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:11.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:11.786+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9678014030 con 0x7f9688103b80 2024-09-21T03:42:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.007+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f968819b650 con 0x7f9688103b80 2024-09-21T03:42:12.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.007+0000 7f967ffff640 1 -- 172.21.15.102:0/815537010 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f96780ae160 con 0x7f9688103b80 2024-09-21T03:42:12.010 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:42:12.010 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:42:12.010 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.009+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 msgr2=0x7f96740b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.009+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 0x7f96740b8bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9670000c00 tx=0x7f9670032d50 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.009+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 msgr2=0x7f968819a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.009+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f967800c920 tx=0x7f967800cde0 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 shutdown_connections 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96740b66b0 0x7f96740b8bc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9688109e10 0x7f968819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f96881094c0 0x7f968819aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 --2- 172.21.15.102:0/815537010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688103b80 0x7f968819a520 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 >> 172.21.15.102:0/815537010 conn(0x7f96880ff590 msgr2=0x7f9688106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:12.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 shutdown_connections 2024-09-21T03:42:12.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:12.010+0000 7f968d347640 1 -- 172.21.15.102:0/815537010 wait complete. 2024-09-21T03:42:12.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:42:12.989 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:13.110 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:12 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/815537010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:13.110 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:12 smithi102 ceph-mon[31392]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:42:13.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:12 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/815537010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:13.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:12 smithi148 ceph-mon[34651]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:42:13.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:12 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/815537010' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:13.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:12 smithi121 ceph-mon[34316]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 -- 172.21.15.102:0/3011530546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0103b80 msgr2=0x7f72b0103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 --2- 172.21.15.102:0/3011530546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0103b80 0x7f72b0103f90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 -- 172.21.15.102:0/3011530546 shutdown_connections 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 --2- 172.21.15.102:0/3011530546 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b0109e10 0x7f72b0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 --2- 172.21.15.102:0/3011530546 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b01094c0 0x7f72b01098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 --2- 172.21.15.102:0/3011530546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0103b80 0x7f72b0103f90 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 -- 172.21.15.102:0/3011530546 >> 172.21.15.102:0/3011530546 conn(0x7f72b00ff5b0 msgr2=0x7f72b0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 -- 172.21.15.102:0/3011530546 shutdown_connections 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.513+0000 7f72b6160640 1 -- 172.21.15.102:0/3011530546 wait complete. 2024-09-21T03:42:13.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 Processor -- start 2024-09-21T03:42:13.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 -- start start 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b0103b80 0x7f72b019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 0x7f72b019ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0113c10 con 0x7f72b0109e10 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0113a90 con 0x7f72b01094c0 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72b6160640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72b0113d90 con 0x7f72b0103b80 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72affff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72affff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51422/0 (socket says 172.21.15.102:51422) 2024-09-21T03:42:13.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.514+0000 7f72affff640 1 -- 172.21.15.102:0/1386009436 learned_addr learned my addr 172.21.15.102:0/1386009436 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72af7fe640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b0103b80 0x7f72b019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72aeffd640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 0x7f72b019ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 -- 172.21.15.102:0/1386009436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b0103b80 msgr2=0x7f72b019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b0103b80 0x7f72b019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 -- 172.21.15.102:0/1386009436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 msgr2=0x7f72b019ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 0x7f72b019ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 -- 172.21.15.102:0/1386009436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b01a05f0 con 0x7f72b0109e10 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72aeffd640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 0x7f72b019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72affff640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009fd0 tx=0x7f72a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72acff9640 1 -- 172.21.15.102:0/1386009436 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8017070 con 0x7f72b0109e10 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72acff9640 1 -- 172.21.15.102:0/1386009436 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a8003e40 con 0x7f72b0109e10 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72acff9640 1 -- 172.21.15.102:0/1386009436 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8004820 con 0x7f72b0109e10 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b01a08e0 con 0x7f72b0109e10 2024-09-21T03:42:13.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.515+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b01a7040 con 0x7f72b0109e10 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 Processor -- start 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72acff9640 1 -- 172.21.15.102:0/1386009436 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f72a8003970 con 0x7f72b0109e10 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 -- start start 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d5370e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d53705cea0 con 0x55d536d161b0 2024-09-21T03:42:13.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d53704c2d0 con 0x55d536d1e390 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d5370500e0 con 0x55d536d3f070 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51426/0 (socket says 172.21.15.102:51426) 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72af7fe640 1 -- 172.21.15.102:0/3015630944 learned_addr learned my addr 172.21.15.102:0/3015630944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.518+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d5370e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72acff9640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 0x7f729c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 -- 172.21.15.102:0/3015630944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 msgr2=0x55d5370e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72affff640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 0x7f729c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 -- 172.21.15.102:0/3015630944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 msgr2=0x55d5370e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d5370e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 -- 172.21.15.102:0/3015630944 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d536daa650 con 0x55d536d161b0 2024-09-21T03:42:13.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72acff9640 1 -- 172.21.15.102:0/1386009436 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7f72a80e7520 con 0x7f72b0109e10 2024-09-21T03:42:13.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a0031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39d69faf8bed8fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72a5ffb640 1 -- 172.21.15.102:0/3015630944 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0040070 con 0x55d536d161b0 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72a5ffb640 1 -- 172.21.15.102:0/3015630944 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a0031710 con 0x55d536d161b0 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.519+0000 7f72a5ffb640 1 -- 172.21.15.102:0/3015630944 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0035040 con 0x55d536d161b0 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3015630944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 msgr2=0x55d5370e6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72affff640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 0x7f729c0b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f72a80ad290 tx=0x7f72a8079fb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009900 tx=0x7f72a0031bc0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3015630944 shutdown_connections 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d5370e6be0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d5370e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3015630944 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3015630944 >> 172.21.15.102:0/3015630944 conn(0x55d536d33460 msgr2=0x55d5370e4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3015630944 shutdown_connections 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.520+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3015630944 wait complete. 2024-09-21T03:42:13.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 -- start start 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 Processor -- start 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d161b0 0x55d5370f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 0x55d5370fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d536ead700 con 0x55d536d1e390 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d536fe7160 con 0x55d536d3f070 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d5370f4e20 con 0x55d536d161b0 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72bc6d4740 10 client.0 _ll_register_callbacks cb 0x55d5370009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51428/0 (socket says 172.21.15.102:51428) 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.521+0000 7f72af7fe640 1 -- 172.21.15.102:0/51534259 learned_addr learned my addr 172.21.15.102:0/51534259 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72aeffd640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d161b0 0x55d5370f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72aeffd640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 0x55d5370fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 -- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d161b0 msgr2=0x55d5370f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d161b0 0x55d5370f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 -- 172.21.15.102:0/51534259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 msgr2=0x55d5370fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 0x55d5370fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 -- 172.21.15.102:0/51534259 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d537014c90 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72aeffd640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 0x55d5370fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72af7fe640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f72a0006010 tx=0x7f72a0005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68c02c4c9e61253 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f728effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a004c070 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7f72a0004030 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a0031710 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f72a0055050 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72bc6d4740 10 client.17073 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.522+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d537100b30 con 0x55d536d1e390 2024-09-21T03:42:13.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a0031710 con 0x55d536d1e390 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f72a004f020 con 0x55d536d1e390 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 10 client.17073 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 10 client.17073 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 20 client.17073 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cfd9f0 0x55d537103e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 4 client.17073 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d53705edf0 con 0x55d536cfd9f0 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.523+0000 7f72aeffd640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cfd9f0 0x55d537103e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f728effd640 10 client.17073 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:13.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f72aeffd640 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cfd9f0 0x55d537103e90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=193471ca1f63df8b server_cookie=b3a5dc25cd9bda73 in_seq=0 out_seq=0 2024-09-21T03:42:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f728effd640 1 -- 172.21.15.102:0/51534259 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d53705edf0 con 0x55d536cfd9f0 2024-09-21T03:42:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f728effd640 10 client.17073 handle_command_reply: tid=0 2024-09-21T03:42:13.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f72bc6d4740 1 client.17073 shutdown 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 msgr2=0x55d5370f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.524+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f72a0006010 tx=0x7f72a0005d50 comp rx=0 tx=0).stop 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 shutdown_connections 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cfd9f0 0x55d537103e90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370f22d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d3f070 0x55d5370fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/51534259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d161b0 0x55d5370f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f728effd640 0 client.17073 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 >> 172.21.15.102:0/51534259 conn(0x55d536d33460 msgr2=0x55d5370e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 shutdown_connections 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 1 -- 172.21.15.102:0/51534259 wait complete. 2024-09-21T03:42:13.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.525+0000 7f72bc6d4740 20 client.17073 trim_cache size 0 max 16384 2024-09-21T03:42:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.537+0000 7f72bc6d4740 1 Processor -- start 2024-09-21T03:42:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.537+0000 7f72bc6d4740 1 -- start start 2024-09-21T03:42:13.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d161b0 0x55d5370f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01b23f0 con 0x55d536d1e390 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01afcc0 con 0x55d536d161b0 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01adb30 con 0x55d536d3f070 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51444/0 (socket says 172.21.15.102:51444) 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 -- 172.21.15.102:0/1331809163 learned_addr learned my addr 172.21.15.102:0/1331809163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 -- 172.21.15.102:0/1331809163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 msgr2=0x55d5370eef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 -- 172.21.15.102:0/1331809163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d161b0 msgr2=0x55d5370f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d161b0 0x55d5370f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 -- 172.21.15.102:0/1331809163 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5370e9500 con 0x55d536d1e390 2024-09-21T03:42:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72af7fe640 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005f70 tx=0x7f72a0031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3c22006ef4d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72a57fa640 1 -- 172.21.15.102:0/1331809163 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a005e070 con 0x55d536d1e390 2024-09-21T03:42:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72a57fa640 1 -- 172.21.15.102:0/1331809163 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a0009520 con 0x55d536d1e390 2024-09-21T03:42:13.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.538+0000 7f72a57fa640 1 -- 172.21.15.102:0/1331809163 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a004c070 con 0x55d536d1e390 2024-09-21T03:42:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 -- 172.21.15.102:0/1331809163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 msgr2=0x55d5370fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005f70 tx=0x7f72a0031b40 comp rx=0 tx=0).stop 2024-09-21T03:42:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 -- 172.21.15.102:0/1331809163 shutdown_connections 2024-09-21T03:42:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d1e390 0x55d5370fe0b0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d5370eef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/1331809163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d161b0 0x55d5370f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 -- 172.21.15.102:0/1331809163 >> 172.21.15.102:0/1331809163 conn(0x55d536d33460 msgr2=0x55d5370f1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 -- 172.21.15.102:0/1331809163 shutdown_connections 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.539+0000 7f72bc6d4740 1 -- 172.21.15.102:0/1331809163 wait complete. 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 -- start start 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 Processor -- start 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d537105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d537105970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01ae180 con 0x55d536d161b0 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01af5f0 con 0x55d536d1e390 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f72b01ae850 con 0x55d536d3f070 2024-09-21T03:42:13.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72bc6d4740 10 client.0 _ll_register_callbacks cb 0x7f729800cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51446/0 (socket says 172.21.15.102:51446) 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72aeffd640 1 -- 172.21.15.102:0/3148616694 learned_addr learned my addr 172.21.15.102:0/3148616694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d537105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.540+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d537105970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 -- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 msgr2=0x55d537105970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d537105970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 -- 172.21.15.102:0/3148616694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 msgr2=0x55d537105430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d537105430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 -- 172.21.15.102:0/3148616694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d53716d640 con 0x55d536d161b0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72aeffd640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f72b006c730 tx=0x7f729800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e269704b66ff97f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729802e060 con 0x55d536d161b0 2024-09-21T03:42:13.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7f7298012d30 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a0009520 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f7298020480 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72bc6d4740 10 client.17079 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d537172d60 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f72a0009520 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.541+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f7298028040 con 0x55d536d161b0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 10 client.17079 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 10 client.17079 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 20 client.17079 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cd2da0 0x55d537175500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 4 client.17079 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d53705a8a0 con 0x55d536cd2da0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cd2da0 0x55d537175500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:13.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f728effd640 10 client.17079 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.542+0000 7f72af7fe640 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cd2da0 0x55d537175500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b87ee03ac16dcc7e server_cookie=89bb141b8b603b45 in_seq=0 out_seq=0 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f728effd640 1 -- 172.21.15.102:0/3148616694 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d53705a8a0 con 0x55d536cd2da0 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f728effd640 10 client.17079 handle_command_reply: tid=0 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 client.17079 shutdown 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 msgr2=0x55d537104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f72b006c730 tx=0x7f729800cc10 comp rx=0 tx=0).stop 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 shutdown_connections 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55d536cd2da0 0x55d537175500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d536d3f070 0x55d537105970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d536d1e390 0x55d537105430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f728effd640 0 client.17079 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 --2- 172.21.15.102:0/3148616694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d536d161b0 0x55d537104ef0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 >> 172.21.15.102:0/3148616694 conn(0x55d536d33460 msgr2=0x55d5370f31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 shutdown_connections 2024-09-21T03:42:13.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 1 -- 172.21.15.102:0/3148616694 wait complete. 2024-09-21T03:42:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72bc6d4740 20 client.17079 trim_cache size 0 max 16384 2024-09-21T03:42:13.550 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.543+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 msgr2=0x7f729c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 0x7f729c0b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f72a80ad290 tx=0x7f72a8079fb0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 msgr2=0x7f72b019fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009fd0 tx=0x7f72a800b260 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 shutdown_connections 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f729c0b6680 0x7f729c0b8b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f72b0109e10 0x7f72b019fec0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f72b01094c0 0x7f72b019ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 --2- 172.21.15.102:0/1386009436 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f72b0103b80 0x7f72b019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 >> 172.21.15.102:0/1386009436 conn(0x7f72b00ff5b0 msgr2=0x7f72b0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 shutdown_connections 2024-09-21T03:42:13.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:13.544+0000 7f72b6160640 1 -- 172.21.15.102:0/1386009436 wait complete. 2024-09-21T03:42:14.164 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:42:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:14.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:14 smithi148 ceph-mon[34651]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:14.782 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:14 smithi102 ceph-mon[31392]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:14.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:14 smithi121 ceph-mon[34316]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:15.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 -- 172.21.15.102:0/2221244174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba94102a60 msgr2=0x7fba94102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 --2- 172.21.15.102:0/2221244174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba94102a60 0x7fba94102e70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fba84009900 tx=0x7fba8402a410 comp rx=0 tx=0).stop 2024-09-21T03:42:15.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 -- 172.21.15.102:0/2221244174 shutdown_connections 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 --2- 172.21.15.102:0/2221244174 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94108cf0 0x7fba9410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 --2- 172.21.15.102:0/2221244174 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba941083a0 0x7fba941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 --2- 172.21.15.102:0/2221244174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba94102a60 0x7fba94102e70 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 -- 172.21.15.102:0/2221244174 >> 172.21.15.102:0/2221244174 conn(0x7fba94079730 msgr2=0x7fba94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 -- 172.21.15.102:0/2221244174 shutdown_connections 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.022+0000 7fba9a055640 1 -- 172.21.15.102:0/2221244174 wait complete. 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 Processor -- start 2024-09-21T03:42:15.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 -- start start 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 0x7fba9419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 0x7fba941a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112a80 con 0x7fba941083a0 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112900 con 0x7fba94108cf0 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba9a055640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba94112c00 con 0x7fba94102a60 2024-09-21T03:42:15.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.023+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60982/0 (socket says 172.21.15.102:60982) 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 -- 172.21.15.102:0/409387570 learned_addr learned my addr 172.21.15.102:0/409387570 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba937fe640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 0x7fba9419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba93fff640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 0x7fba941a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 -- 172.21.15.102:0/409387570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 msgr2=0x7fba9419c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 0x7fba9419c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 -- 172.21.15.102:0/409387570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 msgr2=0x7fba941a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 0x7fba941a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 -- 172.21.15.102:0/409387570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba941a2640 con 0x7fba941083a0 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba937fe640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 0x7fba9419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba93fff640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 0x7fba941a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:15.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba8affd640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00d770 tx=0x7fba7c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba917fa640 1 -- 172.21.15.102:0/409387570 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c017070 con 0x7fba941083a0 2024-09-21T03:42:15.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba917fa640 1 -- 172.21.15.102:0/409387570 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba7c009c30 con 0x7fba941083a0 2024-09-21T03:42:15.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba941a2930 con 0x7fba941083a0 2024-09-21T03:42:15.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba917fa640 1 -- 172.21.15.102:0/409387570 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00f620 con 0x7fba941083a0 2024-09-21T03:42:15.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.024+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba941a9090 con 0x7fba941083a0 2024-09-21T03:42:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 Processor -- start 2024-09-21T03:42:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 -- start start 2024-09-21T03:42:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fba917fa640 1 -- 172.21.15.102:0/409387570 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fba7c01a070 con 0x7fba941083a0 2024-09-21T03:42:15.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf337070 0x55d7bf6de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf654ea0 con 0x55d7bf316390 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf6442d0 con 0x55d7bf30e1b0 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf6480e0 con 0x55d7bf337070 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fba93fff640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf337070 0x55d7bf6de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60984/0 (socket says 172.21.15.102:60984) 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.027+0000 7fba8affd640 1 -- 172.21.15.102:0/3683067993 learned_addr learned my addr 172.21.15.102:0/3683067993 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba937fe640 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 -- 172.21.15.102:0/3683067993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf337070 msgr2=0x55d7bf6de2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf337070 0x55d7bf6de2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 -- 172.21.15.102:0/3683067993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 msgr2=0x55d7bf6de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6de800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 -- 172.21.15.102:0/3683067993 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7bf3a2650 con 0x55d7bf316390 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba937fe640 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba917fa640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 0x7fba800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba8affd640 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0e48c0 tx=0x7fba7c0ef970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b14800e519185c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba93fff640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 0x7fba800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba917fa640 1 -- 172.21.15.102:0/409387570 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fba7c0e7270 con 0x7fba941083a0 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba89ffb640 1 -- 172.21.15.102:0/3683067993 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0a96a0 con 0x55d7bf316390 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba89ffb640 1 -- 172.21.15.102:0/3683067993 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba7c0acb60 con 0x55d7bf316390 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.028+0000 7fba89ffb640 1 -- 172.21.15.102:0/3683067993 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0ac7c0 con 0x55d7bf316390 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3683067993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 msgr2=0x55d7bf6ded40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fba93fff640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 0x7fba800b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005fd0 tx=0x7fba8c009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0e48c0 tx=0x7fba7c0ef970 comp rx=0 tx=0).stop 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3683067993 shutdown_connections 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6ded40 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3683067993 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf337070 0x55d7bf6de2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3683067993 >> 172.21.15.102:0/3683067993 conn(0x55d7bf32b460 msgr2=0x55d7bf6dc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3683067993 shutdown_connections 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.029+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3683067993 wait complete. 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 -- start start 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 Processor -- start 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6e99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 0x55d7bf6f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf4a5700 con 0x55d7bf316390 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf5df160 con 0x55d7bf337070 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55d7bf6ecaa0 con 0x55d7bf30e1b0 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fbaa05c9740 10 client.0 _ll_register_callbacks cb 0x55d7bf5f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.030+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60990/0 (socket says 172.21.15.102:60990) 2024-09-21T03:42:15.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 -- 172.21.15.102:0/3209539078 learned_addr learned my addr 172.21.15.102:0/3209539078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba937fe640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6e99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba93fff640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 0x55d7bf6f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 -- 172.21.15.102:0/3209539078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 msgr2=0x55d7bf6e99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6e99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 -- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 msgr2=0x55d7bf6f5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 0x55d7bf6f5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 -- 172.21.15.102:0/3209539078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7bf60cc90 con 0x55d7bf316390 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba937fe640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6e99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba93fff640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 0x55d7bf6f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba8affd640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0acd50 tx=0x7fba7c0e4e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca54161983bd46e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c021050 con 0x55d7bf316390 2024-09-21T03:42:15.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fba7c0ac2b0 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7c0acb60 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fba7c0ac9a0 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fbaa05c9740 10 client.17091 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.031+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7bf6f8840 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba7c0acb60 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fba7c0abd20 con 0x55d7bf316390 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 10 client.17091 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 10 client.17091 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 20 client.17091 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf2f59f0 0x55d7bf6fbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 4 client.17091 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d7bf656df0 con 0x55d7bf2f59f0 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.032+0000 7fba937fe640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf2f59f0 0x55d7bf6fbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.033+0000 7fba937fe640 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf2f59f0 0x55d7bf6fbba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21931f4a7d8ad0c6 server_cookie=ae4f2c3066825782 in_seq=0 out_seq=0 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.033+0000 7fba72ffd640 10 client.17091 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fba72ffd640 1 -- 172.21.15.102:0/3209539078 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d7bf656df0 con 0x55d7bf2f59f0 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fba72ffd640 10 client.17091 handle_command_reply: tid=0 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 client.17091 shutdown 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 msgr2=0x55d7bf6e9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0acd50 tx=0x7fba7c0e4e60 comp rx=0 tx=0).stop 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 shutdown_connections 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf2f59f0 0x55d7bf6fbba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6e9f10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf337070 0x55d7bf6f5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fba72ffd640 0 client.17091 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/3209539078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6e99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 >> 172.21.15.102:0/3209539078 conn(0x55d7bf32b460 msgr2=0x55d7bf6e1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 shutdown_connections 2024-09-21T03:42:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 1 -- 172.21.15.102:0/3209539078 wait complete. 2024-09-21T03:42:15.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.034+0000 7fbaa05c9740 20 client.17091 trim_cache size 0 max 16384 2024-09-21T03:42:15.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 Processor -- start 2024-09-21T03:42:15.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 -- start start 2024-09-21T03:42:15.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6dfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b4460 con 0x55d7bf316390 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b1d30 con 0x55d7bf2f59f0 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.051+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba941afba0 con 0x55d7bf30e1b0 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32772/0 (socket says 172.21.15.102:32772) 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 -- 172.21.15.102:0/2281649871 learned_addr learned my addr 172.21.15.102:0/2281649871 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba937fe640 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6dfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba8affd640 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 -- 172.21.15.102:0/2281649871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 msgr2=0x55d7bf6db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6db760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 -- 172.21.15.102:0/2281649871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf2f59f0 msgr2=0x55d7bf6dfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6dfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 -- 172.21.15.102:0/2281649871 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7bf6d6460 con 0x55d7bf316390 2024-09-21T03:42:15.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba93fff640 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0106a0 tx=0x7fba8c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac62bf125c5470dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba897fa640 1 -- 172.21.15.102:0/2281649871 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c02b070 con 0x55d7bf316390 2024-09-21T03:42:15.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba897fa640 1 -- 172.21.15.102:0/2281649871 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba8c01ec20 con 0x55d7bf316390 2024-09-21T03:42:15.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.052+0000 7fba897fa640 1 -- 172.21.15.102:0/2281649871 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c01cdf0 con 0x55d7bf316390 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 -- 172.21.15.102:0/2281649871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 msgr2=0x55d7bf6dbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0106a0 tx=0x7fba8c015000 comp rx=0 tx=0).stop 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 -- 172.21.15.102:0/2281649871 shutdown_connections 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf316390 0x55d7bf6dbca0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/2281649871 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6dfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 -- 172.21.15.102:0/2281649871 >> 172.21.15.102:0/2281649871 conn(0x55d7bf32b460 msgr2=0x55d7bf6df2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 -- 172.21.15.102:0/2281649871 shutdown_connections 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.053+0000 7fbaa05c9740 1 -- 172.21.15.102:0/2281649871 wait complete. 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 -- start start 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 Processor -- start 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6fc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf316390 0x55d7bf6fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b01f0 con 0x55d7bf2f59f0 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b1660 con 0x55d7bf30e1b0 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fba941b08c0 con 0x55d7bf316390 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fbaa05c9740 10 client.0 _ll_register_callbacks cb 0x7fba8c0095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fba937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fba937fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32788/0 (socket says 172.21.15.102:32788) 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fba937fe640 1 -- 172.21.15.102:0/815139851 learned_addr learned my addr 172.21.15.102:0/815139851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:15.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.054+0000 7fba8affd640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6fc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba93fff640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf316390 0x55d7bf6fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 -- 172.21.15.102:0/815139851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf316390 msgr2=0x55d7bf6fcca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf316390 0x55d7bf6fcca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 -- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 msgr2=0x55d7bf6fc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6fc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 -- 172.21.15.102:0/815139851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7bf6d75d0 con 0x55d7bf2f59f0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba937fe640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fba8402a930 tx=0x7fba84032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b92ff5011608fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba72ffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84035040 con 0x55d7bf2f59f0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba8c01ec20 con 0x55d7bf2f59f0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fba84005450 con 0x55d7bf2f59f0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fba84005650 con 0x55d7bf2f59f0 2024-09-21T03:42:15.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fbaa05c9740 10 client.17097 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d7bf766010 con 0x55d7bf2f59f0 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.055+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fba8c01ec20 con 0x55d7bf2f59f0 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fba84003920 con 0x55d7bf2f59f0 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 10 client.17097 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 10 client.17097 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 20 client.17097 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf337070 0x55d7bf768800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 4 client.17097 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d7bf6528a0 con 0x55d7bf337070 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fba8affd640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf337070 0x55d7bf768800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fba72ffd640 10 client.17097 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.056+0000 7fba8affd640 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf337070 0x55d7bf768800 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc707e98094f2e6b server_cookie=800cc0378a0e456f in_seq=0 out_seq=0 2024-09-21T03:42:15.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fba72ffd640 1 -- 172.21.15.102:0/815139851 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d7bf6528a0 con 0x55d7bf337070 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fba72ffd640 10 client.17097 handle_command_reply: tid=0 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 client.17097 shutdown 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 msgr2=0x55d7bf6ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fba8402a930 tx=0x7fba84032f90 comp rx=0 tx=0).stop 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 shutdown_connections 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55d7bf337070 0x55d7bf768800 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55d7bf316390 0x55d7bf6fcca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55d7bf30e1b0 0x55d7bf6fc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 --2- 172.21.15.102:0/815139851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d7bf2f59f0 0x55d7bf6ff290 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fba72ffd640 0 client.17097 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 >> 172.21.15.102:0/815139851 conn(0x55d7bf32b460 msgr2=0x55d7bf6df1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 shutdown_connections 2024-09-21T03:42:15.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 1 -- 172.21.15.102:0/815139851 wait complete. 2024-09-21T03:42:15.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.057+0000 7fbaa05c9740 20 client.17097 trim_cache size 0 max 16384 2024-09-21T03:42:15.065 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:15.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 msgr2=0x7fba800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 0x7fba800b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005fd0 tx=0x7fba8c009700 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 msgr2=0x7fba9419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00d770 tx=0x7fba7c00dc30 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 shutdown_connections 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fba800b6700 0x7fba800b8c10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fba941083a0 0x7fba9419cc70 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fba94108cf0 0x7fba941a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 --2- 172.21.15.102:0/409387570 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fba94102a60 0x7fba9419c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 >> 172.21.15.102:0/409387570 conn(0x7fba94079730 msgr2=0x7fba9410e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 shutdown_connections 2024-09-21T03:42:15.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:15.058+0000 7fba9a055640 1 -- 172.21.15.102:0/409387570 wait complete. 2024-09-21T03:42:15.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:42:16.189 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:16.620 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:16 smithi102 ceph-mon[31392]: pgmap v590: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 -- 172.21.15.102:0/578368509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 msgr2=0x7fc530110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 --2- 172.21.15.102:0/578368509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc530110320 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fc528009ca0 tx=0x7fc52802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 -- 172.21.15.102:0/578368509 shutdown_connections 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 --2- 172.21.15.102:0/578368509 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc530110320 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 --2- 172.21.15.102:0/578368509 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 0x7fc53010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 --2- 172.21.15.102:0/578368509 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc530104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 -- 172.21.15.102:0/578368509 >> 172.21.15.102:0/578368509 conn(0x7fc530079740 msgr2=0x7fc530079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 -- 172.21.15.102:0/578368509 shutdown_connections 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.710+0000 7fc5367be640 1 -- 172.21.15.102:0/578368509 wait complete. 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 Processor -- start 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 -- start start 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc53019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 0x7fc53019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc530113bf0 con 0x7fc53010de10 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc530113a70 con 0x7fc530104860 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc5367be640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc530113d70 con 0x7fc530105290 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc534d5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc534d5b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32798/0 (socket says 172.21.15.102:32798) 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.711+0000 7fc534d5b640 1 -- 172.21.15.102:0/3940204401 learned_addr learned my addr 172.21.15.102:0/3940204401 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 0x7fc53019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52ffff640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc53019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 -- 172.21.15.102:0/3940204401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 msgr2=0x7fc53019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 0x7fc53019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 -- 172.21.15.102:0/3940204401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 msgr2=0x7fc53019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc53019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 -- 172.21.15.102:0/3940204401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5301a04d0 con 0x7fc53010de10 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52ffff640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc53019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc534d5b640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc528005e30 tx=0x7fc528003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52d7fa640 1 -- 172.21.15.102:0/3940204401 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc528031650 con 0x7fc53010de10 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52d7fa640 1 -- 172.21.15.102:0/3940204401 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc5280317f0 con 0x7fc53010de10 2024-09-21T03:42:16.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5301a0760 con 0x7fc53010de10 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc52d7fa640 1 -- 172.21.15.102:0/3940204401 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52802fb70 con 0x7fc53010de10 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.712+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5301a6f20 con 0x7fc53010de10 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 Processor -- start 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc52d7fa640 1 -- 172.21.15.102:0/3940204401 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc52802fd70 con 0x7fc53010de10 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 -- start start 2024-09-21T03:42:16.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7bc070 0x56408fb636a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb63be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb64120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56408fad9ea0 con 0x56408f79b390 2024-09-21T03:42:16.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56408fac92d0 con 0x56408f7931b0 2024-09-21T03:42:16.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc53cd32740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56408facd0e0 con 0x56408f7bc070 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb64120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb64120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32802/0 (socket says 172.21.15.102:32802) 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc52f7fe640 1 -- 172.21.15.102:0/4119186372 learned_addr learned my addr 172.21.15.102:0/4119186372 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.715+0000 7fc52ffff640 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb63be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7bc070 0x56408fb636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52d7fa640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 0x7fc5180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 -- 172.21.15.102:0/4119186372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7bc070 msgr2=0x56408fb636a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7bc070 0x56408fb636a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 -- 172.21.15.102:0/4119186372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 msgr2=0x56408fb64120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb64120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 -- 172.21.15.102:0/4119186372 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56408f827650 con 0x56408f7931b0 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc534d5b640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 0x7fc5180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52d7fa640 1 -- 172.21.15.102:0/3940204401 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fc528108bb0 con 0x7fc53010de10 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc52ffff640 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb63be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc520009b80 tx=0x7fc52000e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c119bae6fc179256 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc5167fc640 1 -- 172.21.15.102:0/4119186372 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520016070 con 0x56408f7931b0 2024-09-21T03:42:16.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc534d5b640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 0x7fc5180b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc528106340 tx=0x7fc52809b750 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc5167fc640 1 -- 172.21.15.102:0/4119186372 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc5200054f0 con 0x56408f7931b0 2024-09-21T03:42:16.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.716+0000 7fc5167fc640 1 -- 172.21.15.102:0/4119186372 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520011470 con 0x56408f7931b0 2024-09-21T03:42:16.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 -- 172.21.15.102:0/4119186372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 msgr2=0x56408fb63be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb63be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc520009b80 tx=0x7fc52000e6c0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 -- 172.21.15.102:0/4119186372 shutdown_connections 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb64120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb63be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 --2- 172.21.15.102:0/4119186372 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7bc070 0x56408fb636a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 -- 172.21.15.102:0/4119186372 >> 172.21.15.102:0/4119186372 conn(0x56408f7b0460 msgr2=0x56408fb61590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 -- 172.21.15.102:0/4119186372 shutdown_connections 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.717+0000 7fc53cd32740 1 -- 172.21.15.102:0/4119186372 wait complete. 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 -- start start 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 Processor -- start 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb6f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb7b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56408f92a700 con 0x56408f7931b0 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56408fa64160 con 0x56408f7bc070 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56408fb71e80 con 0x56408f79b390 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc53cd32740 10 client.0 _ll_register_callbacks cb 0x56408fa7d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32808/0 (socket says 172.21.15.102:32808) 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.718+0000 7fc52f7fe640 1 -- 172.21.15.102:0/1614064649 learned_addr learned my addr 172.21.15.102:0/1614064649 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52ffff640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb6f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 -- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 msgr2=0x56408fb6f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb6f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 -- 172.21.15.102:0/1614064649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 msgr2=0x56408fb7b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb7b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 -- 172.21.15.102:0/1614064649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56408fa91c90 con 0x56408f7931b0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc52400e320 tx=0x7fc5240117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6696fc0feaa2be1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc50f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524028060 con 0x56408f7931b0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fc524023a60 con 0x56408f7931b0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5200054f0 con 0x56408f7931b0 2024-09-21T03:42:16.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc524011e20 con 0x56408f7931b0 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc53cd32740 10 client.17109 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.719+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56408fb7dbe0 con 0x56408f7931b0 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc5200054f0 con 0x56408f7931b0 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc52400f040 con 0x56408f7931b0 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 10 client.17109 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:16.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 20 client.17109 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f77a9f0 0x56408fb810b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 4 client.17109 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56408fadbdf0 con 0x56408f77a9f0 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.720+0000 7fc52ffff640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f77a9f0 0x56408fb810b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.721+0000 7fc50f7fe640 10 client.17109 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.721+0000 7fc52ffff640 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f77a9f0 0x56408fb810b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4c92d37b4883a5 server_cookie=930c1b0d3359db22 in_seq=0 out_seq=0 2024-09-21T03:42:16.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.721+0000 7fc50f7fe640 1 -- 172.21.15.102:0/1614064649 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56408fadbdf0 con 0x56408f77a9f0 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.721+0000 7fc50f7fe640 10 client.17109 handle_command_reply: tid=0 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.721+0000 7fc53cd32740 1 client.17109 shutdown 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 msgr2=0x56408fb6ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc52400e320 tx=0x7fc5240117b0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 shutdown_connections 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb7b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb6f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f77a9f0 0x56408fb810b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 --2- 172.21.15.102:0/1614064649 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7931b0 0x56408fb6ed10 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 >> 172.21.15.102:0/1614064649 conn(0x56408f7b0460 msgr2=0x56408fb66830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc50f7fe640 0 client.17109 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 shutdown_connections 2024-09-21T03:42:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 1 -- 172.21.15.102:0/1614064649 wait complete. 2024-09-21T03:42:16.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.722+0000 7fc53cd32740 20 client.17109 trim_cache size 0 max 16384 2024-09-21T03:42:16.745 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:16 smithi148 ceph-mon[34651]: pgmap v590: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:16.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 Processor -- start 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 -- start start 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 0x56408fb6f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb6c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301b0050 con 0x56408f79b390 2024-09-21T03:42:16.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301ad920 con 0x56408f7bc070 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc53cd32740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301ab790 con 0x56408f7931b0 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32814/0 (socket says 172.21.15.102:32814) 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 -- 172.21.15.102:0/3425676653 learned_addr learned my addr 172.21.15.102:0/3425676653 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 0x56408fb6f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 -- 172.21.15.102:0/3425676653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 msgr2=0x56408fb6f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 0x56408fb6f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 -- 172.21.15.102:0/3425676653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 msgr2=0x56408fb6c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb6c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52ffff640 1 -- 172.21.15.102:0/3425676653 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56408fb81610 con 0x56408f79b390 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.735+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 0x56408fb6f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc52ffff640 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc520009ad0 tx=0x7fc520004bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddbef958d30255d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc515ffb640 1 -- 172.21.15.102:0/3425676653 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520016040 con 0x56408f79b390 2024-09-21T03:42:16.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc515ffb640 1 -- 172.21.15.102:0/3425676653 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc520004860 con 0x56408f79b390 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc515ffb640 1 -- 172.21.15.102:0/3425676653 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc520011470 con 0x56408f79b390 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc53cd32740 1 -- 172.21.15.102:0/3425676653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 msgr2=0x56408fb6bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.736+0000 7fc53cd32740 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fc520009ad0 tx=0x7fc520004bf0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 -- 172.21.15.102:0/3425676653 shutdown_connections 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f79b390 0x56408fb6bf00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7bc070 0x56408fb6c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 --2- 172.21.15.102:0/3425676653 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f7931b0 0x56408fb6f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 -- 172.21.15.102:0/3425676653 >> 172.21.15.102:0/3425676653 conn(0x56408f7b0460 msgr2=0x56408fb6eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 -- 172.21.15.102:0/3425676653 shutdown_connections 2024-09-21T03:42:16.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 -- 172.21.15.102:0/3425676653 wait complete. 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 -- start start 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.737+0000 7fc53cd32740 1 Processor -- start 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb77a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb72eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301abde0 con 0x56408f7bc070 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301ad250 con 0x56408f7931b0 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc5301ac4b0 con 0x56408f79b390 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 10 client.0 _ll_register_callbacks cb 0x7fc524019910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32818/0 (socket says 172.21.15.102:32818) 2024-09-21T03:42:16.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 -- 172.21.15.102:0/2225615306 learned_addr learned my addr 172.21.15.102:0/2225615306 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52ffff640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb72eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb77a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 -- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 msgr2=0x56408fb72eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb72eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 -- 172.21.15.102:0/2225615306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 msgr2=0x56408fb77a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb77a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 -- 172.21.15.102:0/2225615306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56408fb73c90 con 0x56408f7bc070 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc52f7fe640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc5240113b0 tx=0x7fc52402b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dc445260a55f1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc50f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524039060 con 0x56408f7bc070 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8630+0+0 (secure 0 0 0) 0x7fc524012650 con 0x56408f7bc070 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.738+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc520004860 con 0x56408f7bc070 2024-09-21T03:42:16.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc524012850 con 0x56408f7bc070 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 10 client.17115 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56408fbeba60 con 0x56408f7bc070 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc520004860 con 0x56408f7bc070 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc524034480 con 0x56408f7bc070 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 10 client.17115 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 20 client.17115 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f74fda0 0x56408fbee1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 4 client.17115 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56408fad78a0 con 0x56408f74fda0 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.739+0000 7fc52ffff640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f74fda0 0x56408fbee1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc50f7fe640 10 client.17115 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc52ffff640 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f74fda0 0x56408fbee1d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d767c211dc50bca5 server_cookie=ff599d222b53eb89 in_seq=0 out_seq=0 2024-09-21T03:42:16.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc50f7fe640 1 -- 172.21.15.102:0/2225615306 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56408fad78a0 con 0x56408f74fda0 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc50f7fe640 10 client.17115 handle_command_reply: tid=0 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 client.17115 shutdown 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 msgr2=0x56408fb73500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fc5240113b0 tx=0x7fc52402b810 comp rx=0 tx=0).stop 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 shutdown_connections 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56408f74fda0 0x56408fbee1d0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56408f7bc070 0x56408fb73500 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56408f79b390 0x56408fb72eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc50f7fe640 0 client.17115 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 --2- 172.21.15.102:0/2225615306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56408f7931b0 0x56408fb77a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 >> 172.21.15.102:0/2225615306 conn(0x56408f7b0460 msgr2=0x56408fb64660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 shutdown_connections 2024-09-21T03:42:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 1 -- 172.21.15.102:0/2225615306 wait complete. 2024-09-21T03:42:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.740+0000 7fc53cd32740 20 client.17115 trim_cache size 0 max 16384 2024-09-21T03:42:16.758 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 msgr2=0x7fc5180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 0x7fc5180b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc528106340 tx=0x7fc52809b750 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 msgr2=0x7fc53019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc528005e30 tx=0x7fc528003f90 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 shutdown_connections 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc5180b6680 0x7fc5180b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc53010de10 0x7fc53019fda0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc530105290 0x7fc53019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 --2- 172.21.15.102:0/3940204401 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc530104860 0x7fc53019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 >> 172.21.15.102:0/3940204401 conn(0x7fc530079740 msgr2=0x7fc530101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 shutdown_connections 2024-09-21T03:42:16.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:16.741+0000 7fc5367be640 1 -- 172.21.15.102:0/3940204401 wait complete. 2024-09-21T03:42:16.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:16 smithi121 ceph-mon[34316]: pgmap v590: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:42:18.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:17 smithi102 ceph-mon[31392]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:42:18.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:17 smithi148 ceph-mon[34651]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:42:18.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:17 smithi121 ceph-mon[34316]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T03:42:18.410 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:42:18.410 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:42:18.665 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:19.120 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:18 smithi102 ceph-mon[31392]: pgmap v592: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 -- 172.21.15.102:0/1588426347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d8109e00 msgr2=0x7fc3d8110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 --2- 172.21.15.102:0/1588426347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d8109e00 0x7fc3d8110630 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009900 tx=0x7fc3d002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 -- 172.21.15.102:0/1588426347 shutdown_connections 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 --2- 172.21.15.102:0/1588426347 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d8109e00 0x7fc3d8110630 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 --2- 172.21.15.102:0/1588426347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d81094b0 0x7fc3d81098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 --2- 172.21.15.102:0/1588426347 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 -- 172.21.15.102:0/1588426347 >> 172.21.15.102:0/1588426347 conn(0x7fc3d8077c60 msgr2=0x7fc3d80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 -- 172.21.15.102:0/1588426347 shutdown_connections 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.211+0000 7fc3e0507640 1 -- 172.21.15.102:0/1588426347 wait complete. 2024-09-21T03:42:19.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 Processor -- start 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 -- start start 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d8109e00 0x7fc3d819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8113c00 con 0x7fc3d81094b0 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8113a80 con 0x7fc3d8109e00 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3e0507640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d8113d80 con 0x7fc3d8101f70 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32826/0 (socket says 172.21.15.102:32826) 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3094950608 learned_addr learned my addr 172.21.15.102:0/3094950608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.212+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d8109e00 0x7fc3d819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3094950608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 msgr2=0x7fc3d819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3094950608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d8109e00 msgr2=0x7fc3d819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d8109e00 0x7fc3d819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3094950608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d81a0440 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00d740 tx=0x7fc3cc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3d77fe640 1 -- 172.21.15.102:0/3094950608 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc017070 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3d77fe640 1 -- 172.21.15.102:0/3094950608 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3cc00de50 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d81a0730 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3d77fe640 1 -- 172.21.15.102:0/3094950608 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00f620 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.213+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d81a6e90 con 0x7fc3d81094b0 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.215+0000 7fc3e6a7b740 1 Processor -- start 2024-09-21T03:42:19.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 -- start start 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3d77fe640 1 -- 172.21.15.102:0/3094950608 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fc3cc01a070 con 0x7fc3d81094b0 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 0x55f27b9cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f27b93de60 con 0x55f27b620350 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f27b92d290 con 0x55f27b5f7490 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f27b9310a0 con 0x55f27b5ff670 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3deaa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3deaa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32838/0 (socket says 172.21.15.102:32838) 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3deaa4640 1 -- 172.21.15.102:0/3098276618 learned_addr learned my addr 172.21.15.102:0/3098276618 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.216+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 0x55f27b9cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 -- 172.21.15.102:0/3098276618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 msgr2=0x55f27b9cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 0x55f27b9cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 -- 172.21.15.102:0/3098276618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 msgr2=0x55f27b9cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 -- 172.21.15.102:0/3098276618 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27b68b930 con 0x55f27b620350 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 0x55f27b9cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0033000 tx=0x7fc3d0032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8995f158ffdaa766 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3d77fe640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 0x7fc3c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3d4ff9640 1 -- 172.21.15.102:0/3098276618 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0040070 con 0x55f27b620350 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 0x7fc3c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3d4ff9640 1 -- 172.21.15.102:0/3098276618 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3d0004030 con 0x55f27b620350 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3d4ff9640 1 -- 172.21.15.102:0/3098276618 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0035040 con 0x55f27b620350 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.217+0000 7fc3d77fe640 1 -- 172.21.15.102:0/3094950608 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fc3cc0e7160 con 0x7fc3d81094b0 2024-09-21T03:42:19.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3098276618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 msgr2=0x55f27b9cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 0x7fc3c00b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55f27b9ca4c0 tx=0x7fc3c8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0033000 tx=0x7fc3d0032c00 comp rx=0 tx=0).stop 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3098276618 shutdown_connections 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5ff670 0x55f27b9cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3098276618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9cb840 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3098276618 >> 172.21.15.102:0/3098276618 conn(0x55f27b614740 msgr2=0x55f27b9c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3098276618 shutdown_connections 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.218+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3098276618 wait complete. 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 -- start start 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 Processor -- start 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9d7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 0x55f27b9d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f27b78e890 con 0x55f27b620350 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f27b8c7d40 con 0x55f27b5ff670 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f27b9d9fc0 con 0x55f27b5f7490 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3e6a7b740 10 client.0 _ll_register_callbacks cb 0x55f27b92bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32854/0 (socket says 172.21.15.102:32854) 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 -- 172.21.15.102:0/2514288023 learned_addr learned my addr 172.21.15.102:0/2514288023 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9d7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 0x55f27b9d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 -- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 msgr2=0x55f27b9d7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9d7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 -- 172.21.15.102:0/2514288023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 msgr2=0x55f27b9d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 0x55f27b9d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3deaa4640 1 -- 172.21.15.102:0/2514288023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27b9e38f0 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.219+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 0x55f27b9d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009850 tx=0x7fc3d0005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f8803d9176ea86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0035070 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fc3d00043e0 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3d0004030 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3d0040040 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 10 client.17127 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f27b9e6220 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3d0004030 con 0x55f27b620350 2024-09-21T03:42:19.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc3d0004720 con 0x55f27b620350 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 10 client.17127 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 20 client.17127 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5decd0 0x55f27b9e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 4 client.17127 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.220+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f27b93fdb0 con 0x55f27b5decd0 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.221+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5decd0 0x55f27b9e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.221+0000 7fc3bdffb640 10 client.17127 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.221+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5decd0 0x55f27b9e9580 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c8f1169375843c server_cookie=c116b7b1709402b6 in_seq=0 out_seq=0 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2514288023 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f27b93fdb0 con 0x55f27b5decd0 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3bdffb640 10 client.17127 handle_command_reply: tid=0 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 client.17127 shutdown 2024-09-21T03:42:19.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 msgr2=0x55f27b9e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0009850 tx=0x7fc3d0005dd0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 shutdown_connections 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5decd0 0x55f27b9e9580 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b620350 0x55f27b9e32e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5ff670 0x55f27b9d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3bdffb640 0 client.17127 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2514288023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9d7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 >> 172.21.15.102:0/2514288023 conn(0x55f27b614740 msgr2=0x55f27b9cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 shutdown_connections 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2514288023 wait complete. 2024-09-21T03:42:19.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.222+0000 7fc3e6a7b740 20 client.17127 trim_cache size 0 max 16384 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 Processor -- start 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 -- start start 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9e3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 0x55f27b9d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81aff80 con 0x55f27b5ff670 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ad850 con 0x55f27b620350 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ab6c0 con 0x55f27b5f7490 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32870/0 (socket says 172.21.15.102:32870) 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3051125144 learned_addr learned my addr 172.21.15.102:0/3051125144 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3051125144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 msgr2=0x55f27b9e3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.240+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9e3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9e3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 0x55f27b9d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3051125144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 msgr2=0x55f27b9d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 0x55f27b9d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/3051125144 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27b9d8550 con 0x55f27b5ff670 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 0x55f27b9d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:19.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0e4e70 tx=0x7fc3cc005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b542b9f40a7463a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3bffff640 1 -- 172.21.15.102:0/3051125144 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc021050 con 0x55f27b5ff670 2024-09-21T03:42:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3bffff640 1 -- 172.21.15.102:0/3051125144 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3cc0ad670 con 0x55f27b5ff670 2024-09-21T03:42:19.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.241+0000 7fc3bffff640 1 -- 172.21.15.102:0/3051125144 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc094340 con 0x55f27b5ff670 2024-09-21T03:42:19.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:18 smithi148 ceph-mon[34651]: pgmap v592: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3051125144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 msgr2=0x55f27b9d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0e4e70 tx=0x7fc3cc005cc0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3051125144 shutdown_connections 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9d0950 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b620350 0x55f27b9d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/3051125144 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b5f7490 0x55f27b9e3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3051125144 >> 172.21.15.102:0/3051125144 conn(0x55f27b614740 msgr2=0x55f27b9d5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3051125144 shutdown_connections 2024-09-21T03:42:19.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/3051125144 wait complete. 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 -- start start 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 Processor -- start 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.242+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9eb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b620350 0x55f27ba4bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81abd10 con 0x55f27b5ff670 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ad180 con 0x55f27b5f7490 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d81ac3e0 con 0x55f27b620350 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 10 client.0 _ll_register_callbacks cb 0x7fc3c8009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32874/0 (socket says 172.21.15.102:32874) 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/2377795675 learned_addr learned my addr 172.21.15.102:0/2377795675 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:19.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b620350 msgr2=0x55f27ba4bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3deaa4640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b620350 0x55f27ba4bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b620350 0x55f27ba4bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/2377795675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 msgr2=0x55f27b9eb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9eb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 -- 172.21.15.102:0/2377795675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27ba4c330 con 0x55f27b5ff670 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9eb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3ddaa2640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0e4920 tx=0x7fc3cc0a9490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fec75d93abd43b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc0942e0 con 0x55f27b5ff670 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fc3cc098250 con 0x55f27b5ff670 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3cc0ad670 con 0x55f27b5ff670 2024-09-21T03:42:19.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc3cc021020 con 0x55f27b5ff670 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 10 client.17133 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.243+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f27ba547c0 con 0x55f27b5ff670 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fc3cc0ad670 con 0x55f27b5ff670 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fc3cc0b0030 con 0x55f27b5ff670 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 10 client.17133 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 10 client.17133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 20 client.17133 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5b4080 0x55f27ba56eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 4 client.17133 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f27b93b860 con 0x55f27b5b4080 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.244+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5b4080 0x55f27ba56eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.245+0000 7fc3bdffb640 10 client.17133 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:19.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.245+0000 7fc3de2a3640 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5b4080 0x55f27ba56eb0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665213d993e3ba92 server_cookie=68b5688798ef4151 in_seq=0 out_seq=0 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3bdffb640 1 -- 172.21.15.102:0/2377795675 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f27b93b860 con 0x55f27b5b4080 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3bdffb640 10 client.17133 handle_command_reply: tid=0 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 client.17133 shutdown 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 msgr2=0x55f27b9eb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0e4920 tx=0x7fc3cc0a9490 comp rx=0 tx=0).stop 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 shutdown_connections 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f27b5b4080 0x55f27ba56eb0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f27b5ff670 0x55f27b9eb620 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f27b620350 0x55f27ba4bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 --2- 172.21.15.102:0/2377795675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f27b5f7490 0x55f27b9eb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 >> 172.21.15.102:0/2377795675 conn(0x55f27b614740 msgr2=0x55f27b9d8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3bdffb640 0 client.17133 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 shutdown_connections 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 1 -- 172.21.15.102:0/2377795675 wait complete. 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.247+0000 7fc3e6a7b740 20 client.17133 trim_cache size 0 max 16384 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "e67f94b1-70d1-4a7a-ac30-82606847f199", 2024-09-21T03:42:19.254 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 msgr2=0x7fc3c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 0x7fc3c00b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x55f27b9ca4c0 tx=0x7fc3c8009500 comp rx=0 tx=0).stop 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 msgr2=0x7fc3d819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00d740 tx=0x7fc3cc00dc00 comp rx=0 tx=0).stop 2024-09-21T03:42:19.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 shutdown_connections 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fc3c00b6680 0x7fc3c00b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc3d81094b0 0x7fc3d819aa70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc3d8109e00 0x7fc3d819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 --2- 172.21.15.102:0/3094950608 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fc3d8101f70 0x7fc3d819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 >> 172.21.15.102:0/3094950608 conn(0x7fc3d8077c60 msgr2=0x7fc3d8105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 shutdown_connections 2024-09-21T03:42:19.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:19.248+0000 7fc3e0507640 1 -- 172.21.15.102:0/3094950608 wait complete. 2024-09-21T03:42:19.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:18 smithi121 ceph-mon[34316]: pgmap v592: 97 pgs: 97 active+clean; 156 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:19.988 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:42:20.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:19 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:42:20.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:19 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:42:20.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:19 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.237 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:20.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:19 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:42:20.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:19 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:42:20.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:19 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:19 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:42:20.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:19 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:42:20.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:19 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:42:20.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 -- 172.21.15.102:0/3630914501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc102a60 msgr2=0x7f12bc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 --2- 172.21.15.102:0/3630914501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc102a60 0x7f12bc102e70 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009900 tx=0x7f12ac02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 -- 172.21.15.102:0/3630914501 shutdown_connections 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 --2- 172.21.15.102:0/3630914501 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 0x7f12bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 --2- 172.21.15.102:0/3630914501 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc1083a0 0x7f12bc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 --2- 172.21.15.102:0/3630914501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc102a60 0x7f12bc102e70 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 -- 172.21.15.102:0/3630914501 >> 172.21.15.102:0/3630914501 conn(0x7f12bc079730 msgr2=0x7f12bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 -- 172.21.15.102:0/3630914501 shutdown_connections 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.762+0000 7f12c1327640 1 -- 172.21.15.102:0/3630914501 wait complete. 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 Processor -- start 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 -- start start 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc102a60 0x7f12bc199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 0x7f12bc19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112b80 con 0x7f12bc1083a0 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112a00 con 0x7f12bc102a60 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12c1327640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112d00 con 0x7f12bc108cf0 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.763+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32882/0 (socket says 172.21.15.102:32882) 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 -- 172.21.15.102:0/4265002122 learned_addr learned my addr 172.21.15.102:0/4265002122 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 0x7f12bc19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12baffd640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc102a60 0x7f12bc199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 -- 172.21.15.102:0/4265002122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 msgr2=0x7f12bc19edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 0x7f12bc19edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 -- 172.21.15.102:0/4265002122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc102a60 msgr2=0x7f12bc199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc102a60 0x7f12bc199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 -- 172.21.15.102:0/4265002122 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc19f4e0 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b3fff640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d920 tx=0x7f12a400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b8ff9640 1 -- 172.21.15.102:0/4265002122 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a401b070 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc19f7d0 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12b8ff9640 1 -- 172.21.15.102:0/4265002122 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12a400edc0 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.764+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc06aee0 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.765+0000 7f12b8ff9640 1 -- 172.21.15.102:0/4265002122 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40147a0 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 Processor -- start 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 -- start start 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12b8ff9640 1 -- 172.21.15.102:0/4265002122 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f12a401e070 con 0x7f12bc1083a0 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda983270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5b31b0 0x561dda9837b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561dda8f9e50 con 0x561dda5bb390 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561dda8e9280 con 0x561dda5b31b0 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.767+0000 7f12c789b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561dda8ed090 con 0x561dda5dc070 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32894/0 (socket says 172.21.15.102:32894) 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 -- 172.21.15.102:0/3376051072 learned_addr learned my addr 172.21.15.102:0/3376051072 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12baffd640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5b31b0 0x561dda9837b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda983270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 -- 172.21.15.102:0/3376051072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 msgr2=0x561dda983270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda983270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 -- 172.21.15.102:0/3376051072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5b31b0 msgr2=0x561dda9837b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5b31b0 0x561dda9837b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 -- 172.21.15.102:0/3376051072 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dda647650 con 0x561dda5bb390 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda983270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:20.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b8ff9640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 0x7f12a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 0x7f12a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b3fff640 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f12a40e6360 tx=0x7f12a40ecd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512b029778c3a026 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b8ff9640 1 -- 172.21.15.102:0/4265002122 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f12a40e8ce0 con 0x7f12bc1083a0 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.768+0000 7f12b17fa640 1 -- 172.21.15.102:0/3376051072 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a4025020 con 0x561dda5bb390 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.769+0000 7f12b17fa640 1 -- 172.21.15.102:0/3376051072 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12a40aa300 con 0x561dda5bb390 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.769+0000 7f12b17fa640 1 -- 172.21.15.102:0/3376051072 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a40aaa40 con 0x561dda5bb390 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.769+0000 7f12c789b740 1 -- 172.21.15.102:0/3376051072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 msgr2=0x561dda983cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.769+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 0x7f12a80b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12b400a5f0 tx=0x7f12b400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.769+0000 7f12c789b740 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f12a40e6360 tx=0x7f12a40ecd70 comp rx=0 tx=0).stop 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- 172.21.15.102:0/3376051072 shutdown_connections 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5bb390 0x561dda983cf0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5b31b0 0x561dda9837b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- 172.21.15.102:0/3376051072 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda983270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- 172.21.15.102:0/3376051072 >> 172.21.15.102:0/3376051072 conn(0x561dda5d0460 msgr2=0x561dda981160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- 172.21.15.102:0/3376051072 shutdown_connections 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- 172.21.15.102:0/3376051072 wait complete. 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- start start 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 Processor -- start 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 0x561dda98ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda98f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561dda74a700 con 0x561dda5b31b0 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561dda884110 con 0x561dda5bb390 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561dda991a50 con 0x561dda5dc070 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12c789b740 10 client.0 _ll_register_callbacks cb 0x561dda89d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:20.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.770+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32902/0 (socket says 172.21.15.102:32902) 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 -- 172.21.15.102:0/563632306 learned_addr learned my addr 172.21.15.102:0/563632306 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12b3fff640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 0x561dda98ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 -- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 msgr2=0x561dda98f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda98f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda98f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 -- 172.21.15.102:0/563632306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 msgr2=0x561dda98ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 0x561dda98ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 -- 172.21.15.102:0/563632306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561dda8b1c40 con 0x561dda5b31b0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12b3fff640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 0x561dda98ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda98f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12baffd640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02a930 tx=0x7f12ac031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d24b6b6561ce5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:20.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac035040 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a40aa300 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f12ac004450 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f12ac031930 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12c789b740 10 client.17145 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.771+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561dda99d6d0 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12a40aa300 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f12ac03d7c0 con 0x561dda5b31b0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 10 client.17145 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 10 client.17145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 20 client.17145 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda59a9f0 0x561dda9a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 4 client.17145 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561dda8fbda0 con 0x561dda59a9f0 2024-09-21T03:42:20.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.772+0000 7f12b3fff640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda59a9f0 0x561dda9a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12a27fc640 10 client.17145 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12b3fff640 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda59a9f0 0x561dda9a0b50 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6752eca6cd134ddb server_cookie=3c0cc72be59dd79d in_seq=0 out_seq=0 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12a27fc640 1 -- 172.21.15.102:0/563632306 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561dda8fbda0 con 0x561dda59a9f0 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12a27fc640 10 client.17145 handle_command_reply: tid=0 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12c789b740 1 client.17145 shutdown 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 msgr2=0x561dda98e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.773+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02a930 tx=0x7f12ac031740 comp rx=0 tx=0).stop 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 shutdown_connections 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5dc070 0x561dda98f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5bb390 0x561dda98ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda59a9f0 0x561dda9a0b50 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 --2- 172.21.15.102:0/563632306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda98e840 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12a27fc640 0 client.17145 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:20.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 >> 172.21.15.102:0/563632306 conn(0x561dda5d0460 msgr2=0x561dda986400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 shutdown_connections 2024-09-21T03:42:20.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 1 -- 172.21.15.102:0/563632306 wait complete. 2024-09-21T03:42:20.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.774+0000 7f12c789b740 20 client.17145 trim_cache size 0 max 16384 2024-09-21T03:42:20.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 Processor -- start 2024-09-21T03:42:20.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 -- start start 2024-09-21T03:42:20.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda990470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561dda980710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1b00e0 con 0x561dda5b31b0 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ad9b0 con 0x561dda5dc070 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12c789b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ab820 con 0x561dda5bb390 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32910/0 (socket says 172.21.15.102:32910) 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.791+0000 7f12baffd640 1 -- 172.21.15.102:0/2951097078 learned_addr learned my addr 172.21.15.102:0/2951097078 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561dda980710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12b3fff640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda990470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 -- 172.21.15.102:0/2951097078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 msgr2=0x561dda990470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda990470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 -- 172.21.15.102:0/2951097078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 msgr2=0x561dda980710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561dda980710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 -- 172.21.15.102:0/2951097078 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561dda97c580 con 0x561dda5b31b0 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12b3fff640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda990470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561dda980710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12baffd640 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f12ac03dbb0 tx=0x7f12ac005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa4af86d96e2530 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12b0ff9640 1 -- 172.21.15.102:0/2951097078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac035030 con 0x561dda5b31b0 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12b0ff9640 1 -- 172.21.15.102:0/2951097078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12ac004250 con 0x561dda5b31b0 2024-09-21T03:42:20.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.792+0000 7f12b0ff9640 1 -- 172.21.15.102:0/2951097078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0478d0 con 0x561dda5b31b0 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 -- 172.21.15.102:0/2951097078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 msgr2=0x561dda984c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f12ac03dbb0 tx=0x7f12ac005a20 comp rx=0 tx=0).stop 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 -- 172.21.15.102:0/2951097078 shutdown_connections 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561dda980710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda990470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 --2- 172.21.15.102:0/2951097078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda984c60 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 -- 172.21.15.102:0/2951097078 >> 172.21.15.102:0/2951097078 conn(0x561dda5d0460 msgr2=0x561dda98fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 -- 172.21.15.102:0/2951097078 shutdown_connections 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.793+0000 7f12c789b740 1 -- 172.21.15.102:0/2951097078 wait complete. 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 -- start start 2024-09-21T03:42:20.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 Processor -- start 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda993910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561ddaa0a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1abe70 con 0x561dda5b31b0 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ad2e0 con 0x561dda5dc070 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ac540 con 0x561dda5bb390 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12c789b740 10 client.0 _ll_register_callbacks cb 0x7f12ac009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:32916/0 (socket says 172.21.15.102:32916) 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 -- 172.21.15.102:0/299257351 learned_addr learned my addr 172.21.15.102:0/299257351 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12b3fff640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda993910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561ddaa0a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 -- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 msgr2=0x561dda993910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda993910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 -- 172.21.15.102:0/299257351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 msgr2=0x561ddaa0a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561ddaa0a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.794+0000 7f12baffd640 1 -- 172.21.15.102:0/299257351 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ddaa0ab10 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12bb7fe640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561ddaa0a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12baffd640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f12ac03dd20 tx=0x7f12ac032d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b1d2ba183cd431 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac035070 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ac004250 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f12ac03d860 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f12ac0035f0 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12c789b740 10 client.17151 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561ddaa0bc80 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f12ac004250 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.795+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f12ac05e020 con 0x561dda5b31b0 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 10 client.17151 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:20.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 10 client.17151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 20 client.17151 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda56fda0 0x561ddaa0e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 4 client.17151 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561dda8f7850 con 0x561dda56fda0 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12b3fff640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda56fda0 0x561ddaa0e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12b3fff640 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda56fda0 0x561ddaa0e370 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e67a433b33af5b server_cookie=2b31d1e17acdbf4a in_seq=0 out_seq=0 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.796+0000 7f12a27fc640 10 client.17151 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12a27fc640 1 -- 172.21.15.102:0/299257351 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x561dda8f7850 con 0x561dda56fda0 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12a27fc640 10 client.17151 handle_command_reply: tid=0 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 client.17151 shutdown 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 msgr2=0x561dda9933d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f12ac03dd20 tx=0x7f12ac032d40 comp rx=0 tx=0).stop 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 shutdown_connections 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561dda5dc070 0x561ddaa0a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561dda5bb390 0x561dda993910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561dda56fda0 0x561ddaa0e370 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 --2- 172.21.15.102:0/299257351 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561dda5b31b0 0x561dda9933d0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 >> 172.21.15.102:0/299257351 conn(0x561dda5d0460 msgr2=0x561dda984a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12a27fc640 0 client.17151 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 shutdown_connections 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 1 -- 172.21.15.102:0/299257351 wait complete. 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c789b740 20 client.17151 trim_cache size 0 max 16384 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:42:20.804 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "e67f94b1-70d1-4a7a-ac30-82606847f199", 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.805 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.806 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:42:20.807 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.809 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.810 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.811 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.812 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:42:20.813 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 msgr2=0x7f12a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.797+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 0x7f12a80b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12b400a5f0 tx=0x7f12b400d040 comp rx=0 tx=0).stop 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 msgr2=0x7f12bc199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:20.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f12a400d920 tx=0x7f12a400dde0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 shutdown_connections 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f12a80b6680 0x7f12a80b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f12bc1083a0 0x7f12bc199b10 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f12bc108cf0 0x7f12bc19edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 --2- 172.21.15.102:0/4265002122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12bc102a60 0x7f12bc199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 >> 172.21.15.102:0/4265002122 conn(0x7f12bc079730 msgr2=0x7f12bc101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 shutdown_connections 2024-09-21T03:42:20.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:20.798+0000 7f12c1327640 1 -- 172.21.15.102:0/4265002122 wait complete. 2024-09-21T03:42:21.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:20 smithi102 ceph-mon[31392]: pgmap v593: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:21.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:20 smithi148 ceph-mon[34651]: pgmap v593: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:21.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:20 smithi121 ceph-mon[34316]: pgmap v593: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:21.453 INFO:tasks.cephfs.filesystem:scrub status for tag:e67f94b1-70d1-4a7a-ac30-82606847f199 - {'path': '/', 'tag': 'e67f94b1-70d1-4a7a-ac30-82606847f199', 'options': 'recursive,force'} 2024-09-21T03:42:22.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:21 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:42:22.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:21 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:42:22.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:21 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:42:23.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:22 smithi102 ceph-mon[31392]: pgmap v594: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:23.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:22 smithi148 ceph-mon[34651]: pgmap v594: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:23.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:22 smithi121 ceph-mon[34316]: pgmap v594: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:42:24.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:24 smithi148 ceph-mon[34651]: pgmap v595: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:24 smithi121 ceph-mon[34316]: pgmap v595: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:24.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:24 smithi102 ceph-mon[31392]: pgmap v595: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:26.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:26 smithi148 ceph-mon[34651]: pgmap v596: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:26.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:26 smithi121 ceph-mon[34316]: pgmap v596: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:26.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:26 smithi102 ceph-mon[31392]: pgmap v596: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:42:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:28 smithi148 ceph-mon[34651]: pgmap v597: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:42:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:28 smithi121 ceph-mon[34316]: pgmap v597: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:42:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:28 smithi102 ceph-mon[31392]: pgmap v597: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:42:30.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:30 smithi148 ceph-mon[34651]: pgmap v598: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:42:30.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:30 smithi121 ceph-mon[34316]: pgmap v598: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:42:30.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:30 smithi102 ceph-mon[31392]: pgmap v598: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:42:32.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:32 smithi148 ceph-mon[34651]: pgmap v599: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:42:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:32 smithi121 ceph-mon[34316]: pgmap v599: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:42:32.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:32 smithi102 ceph-mon[31392]: pgmap v599: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:42:34.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:34 smithi148 ceph-mon[34651]: pgmap v600: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:34.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:34 smithi121 ceph-mon[34316]: pgmap v600: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:34.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:34 smithi102 ceph-mon[31392]: pgmap v600: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:36.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:36 smithi148 ceph-mon[34651]: pgmap v601: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:36 smithi121 ceph-mon[34316]: pgmap v601: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:36 smithi102 ceph-mon[31392]: pgmap v601: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:38.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:38 smithi148 ceph-mon[34651]: pgmap v602: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:38.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:38 smithi121 ceph-mon[34316]: pgmap v602: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:38 smithi102 ceph-mon[31392]: pgmap v602: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:40.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:40 smithi148 ceph-mon[34651]: pgmap v603: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:40.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:40 smithi121 ceph-mon[34316]: pgmap v603: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:40 smithi102 ceph-mon[31392]: pgmap v603: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:42.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:42 smithi148 ceph-mon[34651]: pgmap v604: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:42.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:42 smithi121 ceph-mon[34316]: pgmap v604: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:42.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:42 smithi102 ceph-mon[31392]: pgmap v604: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:44.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:44 smithi148 ceph-mon[34651]: pgmap v605: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:44 smithi121 ceph-mon[34316]: pgmap v605: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:44 smithi102 ceph-mon[31392]: pgmap v605: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:46.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:46 smithi121 ceph-mon[34316]: pgmap v606: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:46.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:46 smithi102 ceph-mon[31392]: pgmap v606: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:46.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:46 smithi148 ceph-mon[34651]: pgmap v606: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:48.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:48 smithi148 ceph-mon[34651]: pgmap v607: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:48.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:48 smithi121 ceph-mon[34316]: pgmap v607: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:48 smithi102 ceph-mon[31392]: pgmap v607: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:50.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:50 smithi148 ceph-mon[34651]: pgmap v608: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:50 smithi121 ceph-mon[34316]: pgmap v608: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:50.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:50 smithi102 ceph-mon[31392]: pgmap v608: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:42:51.455 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:42:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 -- 172.21.15.102:0/1690285686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102fa0 msgr2=0x7f9d8810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 --2- 172.21.15.102:0/1690285686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102fa0 0x7f9d8810fcc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009900 tx=0x7f9d7c02a480 comp rx=0 tx=0).stop 2024-09-21T03:42:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 -- 172.21.15.102:0/1690285686 shutdown_connections 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 --2- 172.21.15.102:0/1690285686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102fa0 0x7f9d8810fcc0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 --2- 172.21.15.102:0/1690285686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88110200 0x7f9d88112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 --2- 172.21.15.102:0/1690285686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88102650 0x7f9d88102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 -- 172.21.15.102:0/1690285686 >> 172.21.15.102:0/1690285686 conn(0x7f9d88079730 msgr2=0x7f9d88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 -- 172.21.15.102:0/1690285686 shutdown_connections 2024-09-21T03:42:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.320+0000 7f9d8f692640 1 -- 172.21.15.102:0/1690285686 wait complete. 2024-09-21T03:42:52.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 Processor -- start 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 -- start start 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88102fa0 0x7f9d8819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88110200 0x7f9d881a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88115d90 con 0x7f9d88102650 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88115c10 con 0x7f9d88102fa0 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8f692640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d88115f10 con 0x7f9d88110200 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60536/0 (socket says 172.21.15.102:60536) 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 -- 172.21.15.102:0/3799438902 learned_addr learned my addr 172.21.15.102:0/3799438902 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88102fa0 0x7f9d8819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88110200 0x7f9d881a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 -- 172.21.15.102:0/3799438902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88110200 msgr2=0x7f9d881a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88110200 0x7f9d881a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 -- 172.21.15.102:0/3799438902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88102fa0 msgr2=0x7f9d8819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88102fa0 0x7f9d8819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.321+0000 7f9d8d42e640 1 -- 172.21.15.102:0/3799438902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d881a2710 con 0x7f9d88102650 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800db80 tx=0x7f9d7800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d867fc640 1 -- 172.21.15.102:0/3799438902 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78017070 con 0x7f9d88102650 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d881a2a00 con 0x7f9d88102650 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d867fc640 1 -- 172.21.15.102:0/3799438902 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d78003b70 con 0x7f9d88102650 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d867fc640 1 -- 172.21.15.102:0/3799438902 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d780106c0 con 0x7f9d88102650 2024-09-21T03:42:52.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.322+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d881a9160 con 0x7f9d88102650 2024-09-21T03:42:52.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 Processor -- start 2024-09-21T03:42:52.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 -- start start 2024-09-21T03:42:52.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d867fc640 1 -- 172.21.15.102:0/3799438902 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f9d78004020 con 0x7f9d88102650 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec65128e50 con 0x55ec64e0b070 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ec65118280 con 0x55ec64dea390 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d95c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ec6511c090 con 0x55ec64de21b0 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60538/0 (socket says 172.21.15.102:60538) 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3124919844 learned_addr learned my addr 172.21.15.102:0/3124919844 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.325+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3124919844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 msgr2=0x55ec651b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3124919844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 msgr2=0x55ec651b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3124919844 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec64e76650 con 0x55ec64e0b070 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000ab00 tx=0x7f9d8000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4906258b4131132 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d867fc640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 0x7f9d700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d6f7fe640 1 -- 172.21.15.102:0/3124919844 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001d070 con 0x55ec64e0b070 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d6f7fe640 1 -- 172.21.15.102:0/3124919844 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d80018910 con 0x55ec64e0b070 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d6f7fe640 1 -- 172.21.15.102:0/3124919844 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80010ac0 con 0x55ec64e0b070 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 0x7f9d700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.326+0000 7f9d867fc640 1 -- 172.21.15.102:0/3799438902 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9d780e7560 con 0x7f9d88102650 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- 172.21.15.102:0/3124919844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 msgr2=0x55ec651b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000ab00 tx=0x7f9d8000f3c0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d8d42e640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 0x7f9d700b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d780e4d20 tx=0x7f9d78000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- 172.21.15.102:0/3124919844 shutdown_connections 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3124919844 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b2270 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- 172.21.15.102:0/3124919844 >> 172.21.15.102:0/3124919844 conn(0x55ec64dff460 msgr2=0x55ec651b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- 172.21.15.102:0/3124919844 shutdown_connections 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- 172.21.15.102:0/3124919844 wait complete. 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.327+0000 7f9d95c06740 1 -- start start 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 Processor -- start 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651bd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 0x55ec651c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ec64f79700 con 0x55ec64dea390 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ec650b3110 con 0x55ec64e0b070 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ec651c0a50 con 0x55ec64de21b0 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d95c06740 10 client.0 _ll_register_callbacks cb 0x55ec650cc990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d8cc2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d8cc2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60550/0 (socket says 172.21.15.102:60550) 2024-09-21T03:42:52.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d8cc2d640 1 -- 172.21.15.102:0/3204065158 learned_addr learned my addr 172.21.15.102:0/3204065158 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651bd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 -- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 msgr2=0x55ec651bd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.328+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 0x55ec651c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651bd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 -- 172.21.15.102:0/3204065158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 msgr2=0x55ec651c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 0x55ec651c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 -- 172.21.15.102:0/3204065158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec650e0c40 con 0x55ec64dea390 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 0x55ec651c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02a9a0 tx=0x7f9d7c031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b106011f3e6c1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c035040 con 0x55ec64dea390 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9d7c004440 con 0x55ec64dea390 2024-09-21T03:42:52.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d80018910 con 0x55ec64dea390 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d7c031930 con 0x55ec64dea390 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d95c06740 10 client.17163 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ec651cc790 con 0x55ec64dea390 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.329+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d80018910 con 0x55ec64dea390 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d7c0035f0 con 0x55ec64dea390 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 10 client.17163 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 10 client.17163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 20 client.17163 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64dc99f0 0x55ec651cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 4 client.17163 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec6512ada0 con 0x55ec64dc99f0 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.330+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64dc99f0 0x55ec651cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d6cff9640 10 client.17163 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64dc99f0 0x55ec651cfcb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5d70cdddbc2be02 server_cookie=6fcbeff3acbeb1ce in_seq=0 out_seq=0 2024-09-21T03:42:52.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3204065158 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec6512ada0 con 0x55ec64dc99f0 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d6cff9640 10 client.17163 handle_command_reply: tid=0 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d95c06740 1 client.17163 shutdown 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 msgr2=0x55ec651bdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.331+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02a9a0 tx=0x7f9d7c031740 comp rx=0 tx=0).stop 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 shutdown_connections 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64dc99f0 0x55ec651cfcb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64dea390 0x55ec651bdea0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64e0b070 0x55ec651c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3204065158 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651bd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 >> 172.21.15.102:0/3204065158 conn(0x55ec64dff460 msgr2=0x55ec651b5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d6cff9640 0 client.17163 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 shutdown_connections 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 1 -- 172.21.15.102:0/3204065158 wait complete. 2024-09-21T03:42:52.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.332+0000 7f9d95c06740 20 client.17163 trim_cache size 0 max 16384 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 Processor -- start 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 -- start start 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881b4480 con 0x55ec64e0b070 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881b1d50 con 0x55ec64dea390 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d95c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881afbc0 con 0x55ec64de21b0 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60560/0 (socket says 172.21.15.102:60560) 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3769333718 learned_addr learned my addr 172.21.15.102:0/3769333718 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.349+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3769333718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 msgr2=0x55ec651b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3769333718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 msgr2=0x55ec651c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3769333718 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec651ab580 con 0x55ec64e0b070 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000ab00 tx=0x7f9d8000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fddbea1aed75f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d6effd640 1 -- 172.21.15.102:0/3769333718 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001d040 con 0x55ec64e0b070 2024-09-21T03:42:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d6effd640 1 -- 172.21.15.102:0/3769333718 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d800107a0 con 0x55ec64e0b070 2024-09-21T03:42:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.350+0000 7f9d6effd640 1 -- 172.21.15.102:0/3769333718 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d800048e0 con 0x55ec64e0b070 2024-09-21T03:42:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- 172.21.15.102:0/3769333718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 msgr2=0x55ec651b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000ab00 tx=0x7f9d8000f3c0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- 172.21.15.102:0/3769333718 shutdown_connections 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64e0b070 0x55ec651b5370 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3769333718 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64de21b0 0x55ec651b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- 172.21.15.102:0/3769333718 >> 172.21.15.102:0/3769333718 conn(0x55ec64dff460 msgr2=0x55ec651afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- 172.21.15.102:0/3769333718 shutdown_connections 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- 172.21.15.102:0/3769333718 wait complete. 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 -- start start 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.351+0000 7f9d95c06740 1 Processor -- start 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64e0b070 0x55ec651c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881b0210 con 0x55ec64de21b0 2024-09-21T03:42:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881b1680 con 0x55ec64dea390 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d881b08e0 con 0x55ec64e0b070 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d95c06740 10 client.0 _ll_register_callbacks cb 0x7f9d7c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60570/0 (socket says 172.21.15.102:60570) 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3352785921 learned_addr learned my addr 172.21.15.102:0/3352785921 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64e0b070 msgr2=0x55ec651c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64e0b070 0x55ec651c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3352785921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 msgr2=0x55ec651c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.352+0000 7f9d8dc2f640 1 -- 172.21.15.102:0/3352785921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec65239670 con 0x55ec64de21b0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d8dc2f640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a6d0 tx=0x7f9d80010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a72eb23738b7f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8001d040 con 0x55ec64de21b0 2024-09-21T03:42:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9d80010b80 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d800107a0 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d80010d80 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d95c06740 10 client.17169 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ec6523a890 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.353+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d800107a0 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d8003e030 con 0x55ec64de21b0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 10 client.17169 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 10 client.17169 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 20 client.17169 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64d9eda0 0x55ec6523cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 4 client.17169 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ec65126850 con 0x55ec64d9eda0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64d9eda0 0x55ec6523cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d6cff9640 10 client.17169 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.354+0000 7f9d8cc2d640 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64d9eda0 0x55ec6523cee0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=683a3676eab4568e server_cookie=ac3d5584ac8043aa in_seq=0 out_seq=0 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d6cff9640 1 -- 172.21.15.102:0/3352785921 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x55ec65126850 con 0x55ec64d9eda0 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d6cff9640 10 client.17169 handle_command_reply: tid=0 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 client.17169 shutdown 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 msgr2=0x55ec651c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f9d8000a6d0 tx=0x7f9d80010950 comp rx=0 tx=0).stop 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 shutdown_connections 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ec64e0b070 0x55ec651c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ec64dea390 0x55ec651c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ec64d9eda0 0x55ec6523cee0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 --2- 172.21.15.102:0/3352785921 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ec64de21b0 0x55ec651c1c00 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 >> 172.21.15.102:0/3352785921 conn(0x55ec64dff460 msgr2=0x55ec651b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d6cff9640 0 client.17169 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 shutdown_connections 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 1 -- 172.21.15.102:0/3352785921 wait complete. 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.355+0000 7f9d95c06740 20 client.17169 trim_cache size 0 max 16384 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.362 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.363 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.364 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.365 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.366 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.367 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.368 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.369 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:42:52.370 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:42:52.371 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 msgr2=0x7f9d700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 0x7f9d700b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d780e4d20 tx=0x7f9d78000f40 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 msgr2=0x7f9d8819c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800db80 tx=0x7f9d7800b630 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 shutdown_connections 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d700b6680 0x7f9d700b8b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d88110200 0x7f9d881a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d88102fa0 0x7f9d8819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 --2- 172.21.15.102:0/3799438902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d88102650 0x7f9d8819c7a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 >> 172.21.15.102:0/3799438902 conn(0x7f9d88079730 msgr2=0x7f9d88108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 shutdown_connections 2024-09-21T03:42:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:52.356+0000 7f9d8f692640 1 -- 172.21.15.102:0/3799438902 wait complete. 2024-09-21T03:42:52.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:52 smithi102 ceph-mon[31392]: pgmap v609: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:52.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:52 smithi148 ceph-mon[34651]: pgmap v609: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:52.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:52 smithi121 ceph-mon[34316]: pgmap v609: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:42:53.176 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:42:53.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:42:53.425 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:53.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 -- 172.21.15.102:0/3199906096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 msgr2=0x7f80e0104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 --2- 172.21.15.102:0/3199906096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e0104ca0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009900 tx=0x7f80d002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 -- 172.21.15.102:0/3199906096 shutdown_connections 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 --2- 172.21.15.102:0/3199906096 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e010de40 0x7f80e0110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 --2- 172.21.15.102:0/3199906096 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e01052c0 0x7f80e010d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 --2- 172.21.15.102:0/3199906096 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e0104ca0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.911+0000 7f80e48c8640 1 -- 172.21.15.102:0/3199906096 >> 172.21.15.102:0/3199906096 conn(0x7f80e0079710 msgr2=0x7f80e0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.912+0000 7f80e48c8640 1 -- 172.21.15.102:0/3199906096 shutdown_connections 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.912+0000 7f80e48c8640 1 -- 172.21.15.102:0/3199906096 wait complete. 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.912+0000 7f80e48c8640 1 Processor -- start 2024-09-21T03:42:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.912+0000 7f80e48c8640 1 -- start start 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e01052c0 0x7f80e0102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 0x7f80e0103220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113ba0 con 0x7f80e0104890 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113a20 con 0x7f80e010de40 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113d20 con 0x7f80e01052c0 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:60602/0 (socket says 172.21.15.102:60602) 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 -- 172.21.15.102:0/848502926 learned_addr learned my addr 172.21.15.102:0/848502926 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80ded9d640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 0x7f80e0103220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 -- 172.21.15.102:0/848502926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e01052c0 msgr2=0x7f80e0102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80ddd9b640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e01052c0 0x7f80e0102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e01052c0 0x7f80e0102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 -- 172.21.15.102:0/848502926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 msgr2=0x7f80e0103220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 0x7f80e0103220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 -- 172.21.15.102:0/848502926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01a8890 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80ded9d640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 0x7f80e0103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80de59c640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005ab0 tx=0x7f80d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d003f030 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f80d0003cd0 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01a8b20 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.913+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0035070 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.914+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01a9000 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.914+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e006c1e0 con 0x7f80e0104890 2024-09-21T03:42:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.916+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f80d0042030 con 0x7f80e0104890 2024-09-21T03:42:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.917+0000 7f80d77fe640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 0x7f80cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.917+0000 7f80ddd9b640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 0x7f80cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.917+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f80d0107fc0 con 0x7f80e0104890 2024-09-21T03:42:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.917+0000 7f80ddd9b640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 0x7f80cc0b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80c8005fd0 tx=0x7f80c8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:53.920+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80d00ce4d0 con 0x7f80e0104890 2024-09-21T03:42:54.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.134+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80e0104ca0 con 0x7f80e0104890 2024-09-21T03:42:54.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.134+0000 7f80d77fe640 1 -- 172.21.15.102:0/848502926 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f80d00d28b0 con 0x7f80e0104890 2024-09-21T03:42:54.137 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:42:54.137 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:42:54.137 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.136+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 msgr2=0x7f80cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.136+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 0x7f80cc0b8b90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80c8005fd0 tx=0x7f80c8005850 comp rx=0 tx=0).stop 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.136+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 msgr2=0x7f80e01027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.136+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f80d0005ab0 tx=0x7f80d00042f0 comp rx=0 tx=0).stop 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 shutdown_connections 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80cc0b6680 0x7f80cc0b8b90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f80e010de40 0x7f80e0103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80e01052c0 0x7f80e0102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 --2- 172.21.15.102:0/848502926 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80e0104890 0x7f80e01027a0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 >> 172.21.15.102:0/848502926 conn(0x7f80e0079710 msgr2=0x7f80e01079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 shutdown_connections 2024-09-21T03:42:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:54.137+0000 7f80e48c8640 1 -- 172.21.15.102:0/848502926 wait complete. 2024-09-21T03:42:54.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:54 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/848502926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:54.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:54 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/848502926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:54.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:54 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/848502926' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:42:54.859 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:42:55.106 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:55.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:55 smithi102 ceph-mon[31392]: pgmap v610: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:55.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:55 smithi148 ceph-mon[34651]: pgmap v610: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:55.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:55 smithi121 ceph-mon[34316]: pgmap v610: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:42:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.580+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2211332596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc103b60 msgr2=0x7f37cc103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.580+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2211332596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc103b60 0x7f37cc103f70 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009900 tx=0x7f37bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2211332596 shutdown_connections 2024-09-21T03:42:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2211332596 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 0x7f37cc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2211332596 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc1094a0 0x7f37cc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2211332596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc103b60 0x7f37cc103f70 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2211332596 >> 172.21.15.102:0/2211332596 conn(0x7f37cc07b850 msgr2=0x7f37cc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2211332596 shutdown_connections 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2211332596 wait complete. 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 Processor -- start 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.581+0000 7f37d2d9b640 1 -- start start 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 0x7f37cc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 0x7f37cc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc113c50 con 0x7f37cc1094a0 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc113ad0 con 0x7f37cc103b60 2024-09-21T03:42:55.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d2d9b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc113dd0 con 0x7f37cc109df0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:43996/0 (socket says 172.21.15.102:43996) 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 -- 172.21.15.102:0/2415717295 learned_addr learned my addr 172.21.15.102:0/2415717295 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d1338640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 0x7f37cc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d0b37640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 0x7f37cc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 -- 172.21.15.102:0/2415717295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 msgr2=0x7f37cc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 0x7f37cc19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 -- 172.21.15.102:0/2415717295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 msgr2=0x7f37cc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 0x7f37cc19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 -- 172.21.15.102:0/2415717295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc1a04d0 con 0x7f37cc1094a0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37d0b37640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 0x7f37cc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37cbfff640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f37c0006fd0 tx=0x7f37c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.582+0000 7f37c9ffb640 1 -- 172.21.15.102:0/2415717295 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0011830 con 0x7f37cc1094a0 2024-09-21T03:42:55.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.583+0000 7f37c9ffb640 1 -- 172.21.15.102:0/2415717295 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37c0016070 con 0x7f37cc1094a0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.583+0000 7f37c9ffb640 1 -- 172.21.15.102:0/2415717295 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c000f2e0 con 0x7f37cc1094a0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.583+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc1a07c0 con 0x7f37cc1094a0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.583+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc1a6f20 con 0x7f37cc1094a0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.585+0000 7f37d930f740 1 Processor -- start 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.585+0000 7f37d930f740 1 -- start start 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.585+0000 7f37c9ffb640 1 -- 172.21.15.102:0/2415717295 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f37c000f480 con 0x7f37cc1094a0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c01be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c02120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558789b77ea0 con 0x55878985a070 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558789b672d0 con 0x558789839390 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d930f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558789b6b0e0 con 0x5587898311b0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44004/0 (socket says 172.21.15.102:44004) 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 -- 172.21.15.102:0/820213588 learned_addr learned my addr 172.21.15.102:0/820213588 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37cbfff640 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c02120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d0b37640 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c01be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 -- 172.21.15.102:0/820213588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 msgr2=0x558789c01be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c01be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 -- 172.21.15.102:0/820213588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 msgr2=0x558789c02120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c02120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 -- 172.21.15.102:0/820213588 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587898c5650 con 0x55878985a070 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37d1338640 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009ee0 tx=0x7f37c4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e35d62cc831022 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37b2ffd640 1 -- 172.21.15.102:0/820213588 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4016070 con 0x55878985a070 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37b2ffd640 1 -- 172.21.15.102:0/820213588 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37c4004d20 con 0x55878985a070 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.586+0000 7f37b2ffd640 1 -- 172.21.15.102:0/820213588 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4012770 con 0x55878985a070 2024-09-21T03:42:55.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37c9ffb640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 0x7f37b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d0b37640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 0x7f37b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37c9ffb640 1 -- 172.21.15.102:0/2415717295 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f37c00e6e80 con 0x7f37cc1094a0 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 -- 172.21.15.102:0/820213588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 msgr2=0x558789c016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d0b37640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 0x7f37b40b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f37bc005f70 tx=0x7f37bc005f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009ee0 tx=0x7f37c4010740 comp rx=0 tx=0).stop 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 -- 172.21.15.102:0/820213588 shutdown_connections 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c02120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c01be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 --2- 172.21.15.102:0/820213588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c016a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 -- 172.21.15.102:0/820213588 >> 172.21.15.102:0/820213588 conn(0x55878984e460 msgr2=0x558789bff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 -- 172.21.15.102:0/820213588 shutdown_connections 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.587+0000 7f37d930f740 1 -- 172.21.15.102:0/820213588 wait complete. 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 -- start start 2024-09-21T03:42:55.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 Processor -- start 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558789839390 0x558789c0d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878985a070 0x558789c191d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5587899c8700 con 0x5587898311b0 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558789b02160 con 0x55878985a070 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558789c0fe80 con 0x558789839390 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.588+0000 7f37d930f740 10 client.0 _ll_register_callbacks cb 0x558789b1b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44014/0 (socket says 172.21.15.102:44014) 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 -- 172.21.15.102:0/1827529485 learned_addr learned my addr 172.21.15.102:0/1827529485 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37cbfff640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558789839390 0x558789c0d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d1338640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878985a070 0x558789c191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 -- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558789839390 msgr2=0x558789c0d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558789839390 0x558789c0d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 -- 172.21.15.102:0/1827529485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878985a070 msgr2=0x558789c191d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878985a070 0x558789c191d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 -- 172.21.15.102:0/1827529485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558789b2fc90 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f37bc033000 tx=0x7f37bc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c64b206dc6b547 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37abfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc04c070 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f37bc004250 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37c4004d20 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f37bc058050 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d930f740 10 client.17187 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.589+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558789c1bc00 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37c4004d20 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f37bc03c540 con 0x5587898311b0 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 10 client.17187 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:55.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 10 client.17187 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 20 client.17187 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587898189f0 0x558789c1f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 4 client.17187 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558789b79df0 con 0x5587898189f0 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.590+0000 7f37cbfff640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587898189f0 0x558789c1f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.591+0000 7f37cbfff640 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587898189f0 0x558789c1f170 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8df3d6dccf714e7 server_cookie=9b53d4cdcc23586b in_seq=0 out_seq=0 2024-09-21T03:42:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.591+0000 7f37abfff640 10 client.17187 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.591+0000 7f37abfff640 1 -- 172.21.15.102:0/1827529485 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558789b79df0 con 0x5587898189f0 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.591+0000 7f37abfff640 10 client.17187 handle_command_reply: tid=0 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.591+0000 7f37d930f740 1 client.17187 shutdown 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 msgr2=0x558789c0cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f37bc033000 tx=0x7f37bc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 shutdown_connections 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587898189f0 0x558789c1f170 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55878985a070 0x558789c191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558789839390 0x558789c0d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 --2- 172.21.15.102:0/1827529485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5587898311b0 0x558789c0cdd0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37abfff640 0 client.17187 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 >> 172.21.15.102:0/1827529485 conn(0x55878984e460 msgr2=0x558789c04880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 shutdown_connections 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 1 -- 172.21.15.102:0/1827529485 wait complete. 2024-09-21T03:42:55.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.592+0000 7f37d930f740 20 client.17187 trim_cache size 0 max 16384 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 Processor -- start 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 -- start start 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c190d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1b2270 con 0x55878985a070 2024-09-21T03:42:55.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1afb40 con 0x558789839390 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.605+0000 7f37d930f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ad9b0 con 0x5587898311b0 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d1338640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.148:3300/0 says I am v2:172.21.15.102:47226/0 (socket says 172.21.15.102:47226) 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d1338640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44024/0 (socket says 172.21.15.102:44024) 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 -- 172.21.15.102:0/1671375625 learned_addr learned my addr 172.21.15.102:0/1671375625 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 -- 172.21.15.102:0/1671375625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 msgr2=0x558789c190d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c190d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 -- 172.21.15.102:0/1671375625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 msgr2=0x558789c09fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 -- 172.21.15.102:0/1671375625 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558789c053f0 con 0x5587898311b0 2024-09-21T03:42:55.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d1338640 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:42:55.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37d0b37640 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37bc02ac00 tx=0x7f37bc03cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef4fa9c0f0e89c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37b27fc640 1 -- 172.21.15.102:0/1671375625 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc04c040 con 0x5587898311b0 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37b27fc640 1 -- 172.21.15.102:0/1671375625 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37bc004250 con 0x5587898311b0 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.606+0000 7f37b27fc640 1 -- 172.21.15.102:0/1671375625 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc035040 con 0x5587898311b0 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 -- 172.21.15.102:0/1671375625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 msgr2=0x558789c04eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37bc02ac00 tx=0x7f37bc03cd90 comp rx=0 tx=0).stop 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 -- 172.21.15.102:0/1671375625 shutdown_connections 2024-09-21T03:42:55.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55878985a070 0x558789c09fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558789839390 0x558789c190d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 --2- 172.21.15.102:0/1671375625 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5587898311b0 0x558789c04eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 -- 172.21.15.102:0/1671375625 >> 172.21.15.102:0/1671375625 conn(0x55878984e460 msgr2=0x558789c047a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 -- 172.21.15.102:0/1671375625 shutdown_connections 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.607+0000 7f37d930f740 1 -- 172.21.15.102:0/1671375625 wait complete. 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 -- start start 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 Processor -- start 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5587898311b0 0x558789c11460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878985a070 0x558789c88b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ae000 con 0x558789839390 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1af470 con 0x5587898311b0 2024-09-21T03:42:55.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc1ae6d0 con 0x55878985a070 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d930f740 10 client.0 _ll_register_callbacks cb 0x7f37bc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37cbfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44040/0 (socket says 172.21.15.102:44040) 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37cbfff640 1 -- 172.21.15.102:0/3944073061 learned_addr learned my addr 172.21.15.102:0/3944073061 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d0b37640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5587898311b0 0x558789c11460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.608+0000 7f37d1338640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878985a070 0x558789c88b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 -- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878985a070 msgr2=0x558789c88b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878985a070 0x558789c88b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 -- 172.21.15.102:0/3944073061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5587898311b0 msgr2=0x558789c11460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5587898311b0 0x558789c11460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 -- 172.21.15.102:0/3944073061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558789c12240 con 0x558789839390 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37cbfff640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f37c000bde0 tx=0x7f37c00d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58251e227927be7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37abfff640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:55.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c00ac400 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f37c00a8f00 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37bc004250 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f37c00a8400 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37d930f740 10 client.17193 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558789c8a160 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.609+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f37bc004250 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f37c00e4ce0 con 0x558789839390 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 10 client.17193 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 10 client.17193 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 20 client.17193 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587897edda0 0x558789c8c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 4 client.17193 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558789b758a0 con 0x5587897edda0 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d0b37640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587897edda0 0x558789c8c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:55.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37abfff640 10 client.17193 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37d0b37640 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587897edda0 0x558789c8c8f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f1dce9f5f5984d56 server_cookie=242c6accaf7e2d04 in_seq=0 out_seq=0 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.610+0000 7f37abfff640 1 -- 172.21.15.102:0/3944073061 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558789b758a0 con 0x5587897edda0 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37abfff640 10 client.17193 handle_command_reply: tid=0 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 client.17193 shutdown 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 msgr2=0x558789c119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f37c000bde0 tx=0x7f37c00d0040 comp rx=0 tx=0).stop 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 shutdown_connections 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5587897edda0 0x558789c8c8f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558789839390 0x558789c119a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37abfff640 0 client.17193 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55878985a070 0x558789c88b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 --2- 172.21.15.102:0/3944073061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5587898311b0 0x558789c11460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 >> 172.21.15.102:0/3944073061 conn(0x55878984e460 msgr2=0x558789c026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 shutdown_connections 2024-09-21T03:42:55.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 1 -- 172.21.15.102:0/3944073061 wait complete. 2024-09-21T03:42:55.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.611+0000 7f37d930f740 20 client.17193 trim_cache size 0 max 16384 2024-09-21T03:42:55.618 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:55.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 msgr2=0x7f37b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 0x7f37b40b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f37bc005f70 tx=0x7f37bc005f00 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 msgr2=0x7f37cc19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f37c0006fd0 tx=0x7f37c000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 shutdown_connections 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f37b40b6680 0x7f37b40b8b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f37cc1094a0 0x7f37cc19ab00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f37cc109df0 0x7f37cc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 --2- 172.21.15.102:0/2415717295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f37cc103b60 0x7f37cc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 >> 172.21.15.102:0/2415717295 conn(0x7f37cc07b850 msgr2=0x7f37cc107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 shutdown_connections 2024-09-21T03:42:55.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:55.612+0000 7f37d2d9b640 1 -- 172.21.15.102:0/2415717295 wait complete. 2024-09-21T03:42:56.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:42:56.590 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:56.700 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:56 smithi102 ceph-mon[31392]: pgmap v611: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:56.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:56 smithi121 ceph-mon[34316]: pgmap v611: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:56 smithi148 ceph-mon[34651]: pgmap v611: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 -- 172.21.15.102:0/1337383571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30103b60 msgr2=0x7fcb30103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 --2- 172.21.15.102:0/1337383571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30103b60 0x7fcb30103f70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009900 tx=0x7fcb2002a410 comp rx=0 tx=0).stop 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 -- 172.21.15.102:0/1337383571 shutdown_connections 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 --2- 172.21.15.102:0/1337383571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb30109df0 0x7fcb30110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 --2- 172.21.15.102:0/1337383571 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb301094a0 0x7fcb301098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 --2- 172.21.15.102:0/1337383571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30103b60 0x7fcb30103f70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 -- 172.21.15.102:0/1337383571 >> 172.21.15.102:0/1337383571 conn(0x7fcb3007b850 msgr2=0x7fcb3007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 -- 172.21.15.102:0/1337383571 shutdown_connections 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.041+0000 7fcb34e61640 1 -- 172.21.15.102:0/1337383571 wait complete. 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 Processor -- start 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 -- start start 2024-09-21T03:42:57.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb30103b60 0x7fcb30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb301094a0 0x7fcb30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30113bf0 con 0x7fcb30109df0 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30113a70 con 0x7fcb301094a0 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb34e61640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb30113d70 con 0x7fcb30103b60 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb2ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.042+0000 7fcb2ed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44060/0 (socket says 172.21.15.102:44060) 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 -- 172.21.15.102:0/2761175400 learned_addr learned my addr 172.21.15.102:0/2761175400 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2e59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb30103b60 0x7fcb30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb301094a0 0x7fcb30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 -- 172.21.15.102:0/2761175400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb30103b60 msgr2=0x7fcb30075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb30103b60 0x7fcb30075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 -- 172.21.15.102:0/2761175400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb301094a0 msgr2=0x7fcb30075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb301094a0 0x7fcb30075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 -- 172.21.15.102:0/2761175400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb301a88c0 con 0x7fcb30109df0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800cad0 tx=0x7fcb2800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb27fff640 1 -- 172.21.15.102:0/2761175400 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800ae20 con 0x7fcb30109df0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb27fff640 1 -- 172.21.15.102:0/2761175400 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb28005020 con 0x7fcb30109df0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb27fff640 1 -- 172.21.15.102:0/2761175400 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2800f6b0 con 0x7fcb30109df0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb301a8bb0 con 0x7fcb30109df0 2024-09-21T03:42:57.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.043+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb301a90a0 con 0x7fcb30109df0 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.046+0000 7fcb3b3d5740 1 Processor -- start 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.046+0000 7fcb27fff640 1 -- 172.21.15.102:0/2761175400 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fcb280051d0 con 0x7fcb30109df0 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.046+0000 7fcb3b3d5740 1 -- start start 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc741b0 0x558c0d044800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc7c390 0x558c0d044d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558c0cfbaea0 con 0x558c0cc9d070 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c0cfaa2d0 con 0x558c0cc7c390 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558c0cfae0e0 con 0x558c0cc741b0 2024-09-21T03:42:57.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44072/0 (socket says 172.21.15.102:44072) 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 -- 172.21.15.102:0/456427740 learned_addr learned my addr 172.21.15.102:0/456427740 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc741b0 0x558c0d044800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc7c390 0x558c0d044d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 -- 172.21.15.102:0/456427740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc741b0 msgr2=0x558c0d044800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc741b0 0x558c0d044800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 -- 172.21.15.102:0/456427740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc7c390 msgr2=0x558c0d044d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc7c390 0x558c0d044d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb25d9b640 1 -- 172.21.15.102:0/456427740 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0cd08650 con 0x558c0cc9d070 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.047+0000 7fcb27fff640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 0x7fcb1c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcb18013510 tx=0x7fcb1800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdb5353690d94b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb27fff640 1 -- 172.21.15.102:0/2761175400 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fcb280e7720 con 0x7fcb30109df0 2024-09-21T03:42:57.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 0x7fcb1c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb24d99640 1 -- 172.21.15.102:0/456427740 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18019030 con 0x558c0cc9d070 2024-09-21T03:42:57.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb24d99640 1 -- 172.21.15.102:0/456427740 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb180054f0 con 0x558c0cc9d070 2024-09-21T03:42:57.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.048+0000 7fcb24d99640 1 -- 172.21.15.102:0/456427740 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18004d60 con 0x558c0cc9d070 2024-09-21T03:42:57.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/456427740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 msgr2=0x558c0d0442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 0x7fcb1c0b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcb30077160 tx=0x7fcb200058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fcb18013510 tx=0x7fcb1800a6e0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/456427740 shutdown_connections 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc7c390 0x558c0d044d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc741b0 0x558c0d044800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/456427740 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc9d070 0x558c0d0442c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/456427740 >> 172.21.15.102:0/456427740 conn(0x558c0cc91460 msgr2=0x558c0d0421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/456427740 shutdown_connections 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/456427740 wait complete. 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 -- start start 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.049+0000 7fcb3b3d5740 1 Processor -- start 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d04f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d0503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558c0ce0b700 con 0x558c0cc7c390 2024-09-21T03:42:57.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558c0cf45160 con 0x558c0cc741b0 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558c0d052aa0 con 0x558c0cc9d070 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb3b3d5740 10 client.0 _ll_register_callbacks cb 0x558c0cf5e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44074/0 (socket says 172.21.15.102:44074) 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 -- 172.21.15.102:0/3786924729 learned_addr learned my addr 172.21.15.102:0/3786924729 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d04f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d0503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 -- 172.21.15.102:0/3786924729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 msgr2=0x558c0d0503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d0503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 -- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 msgr2=0x558c0d04f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d04f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 -- 172.21.15.102:0/3786924729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0cf72c90 con 0x558c0cc7c390 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d0503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:57.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800a500 tx=0x7fcb18005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0d8328a60860e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.050+0000 7fcb15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb18019040 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fcb18004c60 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb180054f0 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb18004e60 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 10 client.17205 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558c0d05e740 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb180054f0 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcb1802d030 con 0x558c0cc7c390 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 10 client.17205 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 10 client.17205 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 20 client.17205 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc5b9f0 0x558c0d061aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 4 client.17205 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.051+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c0cfbcdf0 con 0x558c0cc5b9f0 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.052+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc5b9f0 0x558c0d061aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.052+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc5b9f0 0x558c0d061aa0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ac57282e6add8a2 server_cookie=86e4e5509f84d0ae in_seq=0 out_seq=0 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.052+0000 7fcb15ffb640 10 client.17205 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb15ffb640 1 -- 172.21.15.102:0/3786924729 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c0cfbcdf0 con 0x558c0cc5b9f0 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb15ffb640 10 client.17205 handle_command_reply: tid=0 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 client.17205 shutdown 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 msgr2=0x558c0d04fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800a500 tx=0x7fcb18005420 comp rx=0 tx=0).stop 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 shutdown_connections 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc5b9f0 0x558c0d061aa0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04fe40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d0503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb15ffb640 0 client.17205 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:57.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/3786924729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d04f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 >> 172.21.15.102:0/3786924729 conn(0x558c0cc91460 msgr2=0x558c0d0474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 shutdown_connections 2024-09-21T03:42:57.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/3786924729 wait complete. 2024-09-21T03:42:57.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.053+0000 7fcb3b3d5740 20 client.17205 trim_cache size 0 max 16384 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 Processor -- start 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 -- start start 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d05b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d04d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301b4410 con 0x558c0cc7c390 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301b1ce0 con 0x558c0cc741b0 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.066+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301afb50 con 0x558c0cc9d070 2024-09-21T03:42:57.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44088/0 (socket says 172.21.15.102:44088) 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 -- 172.21.15.102:0/1016131815 learned_addr learned my addr 172.21.15.102:0/1016131815 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 -- 172.21.15.102:0/1016131815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 msgr2=0x558c0d04d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d04d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 -- 172.21.15.102:0/1016131815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 msgr2=0x558c0d05b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d05b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d05b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 -- 172.21.15.102:0/1016131815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c0d03c460 con 0x558c0cc7c390 2024-09-21T03:42:57.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcb18004950 tx=0x7fcb1800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f98b298e59c1cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb17fff640 1 -- 172.21.15.102:0/1016131815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1801e8e0 con 0x558c0cc7c390 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb17fff640 1 -- 172.21.15.102:0/1016131815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb1800ad50 con 0x558c0cc7c390 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.067+0000 7fcb17fff640 1 -- 172.21.15.102:0/1016131815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb180116b0 con 0x558c0cc7c390 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/1016131815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 msgr2=0x558c0d04caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fcb18004950 tx=0x7fcb1800a360 comp rx=0 tx=0).stop 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/1016131815 shutdown_connections 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc7c390 0x558c0d04caf0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc9d070 0x558c0d04d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/1016131815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc741b0 0x558c0d05b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/1016131815 >> 172.21.15.102:0/1016131815 conn(0x558c0cc91460 msgr2=0x558c0d05ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/1016131815 shutdown_connections 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/1016131815 wait complete. 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 -- start start 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.068+0000 7fcb3b3d5740 1 Processor -- start 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc7c390 0x558c0d0539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 0x558c0d053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301b01a0 con 0x558c0cc741b0 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301b1610 con 0x558c0cc9d070 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcb301b0870 con 0x558c0cc7c390 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb3b3d5740 10 client.0 _ll_register_callbacks cb 0x7fcb20005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44102/0 (socket says 172.21.15.102:44102) 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 -- 172.21.15.102:0/4100932862 learned_addr learned my addr 172.21.15.102:0/4100932862 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 0x558c0d053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc7c390 0x558c0d0539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 -- 172.21.15.102:0/4100932862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc7c390 msgr2=0x558c0d0539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc7c390 0x558c0d0539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 -- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 msgr2=0x558c0d053f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 0x558c0d053f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 -- 172.21.15.102:0/4100932862 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c0d054690 con 0x558c0cc741b0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2ed9d640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 0x558c0d053f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb2e59c640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009900 tx=0x7fcb20009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffe931524dbfe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.069+0000 7fcb15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20043070 con 0x558c0cc741b0 2024-09-21T03:42:57.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fcb200037f0 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb1800ad50 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcb20035040 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 10 client.17211 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558c0d0cc310 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcb1800ad50 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcb20061070 con 0x558c0cc741b0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 10 client.17211 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 10 client.17211 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 20 client.17211 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc30da0 0x558c0d0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 4 client.17211 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c0cfb88a0 con 0x558c0cc30da0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.070+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc30da0 0x558c0d0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:57.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb25d9b640 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc30da0 0x558c0d0ceab0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edbbf56ee6f08514 server_cookie=b714119630cfe1fd in_seq=0 out_seq=0 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb15ffb640 10 client.17211 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb15ffb640 1 -- 172.21.15.102:0/4100932862 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c0cfb88a0 con 0x558c0cc30da0 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb15ffb640 10 client.17211 handle_command_reply: tid=0 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 client.17211 shutdown 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 msgr2=0x558c0d0584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009900 tx=0x7fcb20009260 comp rx=0 tx=0).stop 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 shutdown_connections 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x558c0cc30da0 0x558c0d0ceab0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558c0cc9d070 0x558c0d053f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x558c0cc7c390 0x558c0d0539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 --2- 172.21.15.102:0/4100932862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558c0cc741b0 0x558c0d0584f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 >> 172.21.15.102:0/4100932862 conn(0x558c0cc91460 msgr2=0x558c0d050db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb15ffb640 0 client.17211 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:42:57.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 shutdown_connections 2024-09-21T03:42:57.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 1 -- 172.21.15.102:0/4100932862 wait complete. 2024-09-21T03:42:57.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.071+0000 7fcb3b3d5740 20 client.17211 trim_cache size 0 max 16384 2024-09-21T03:42:57.079 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 msgr2=0x7fcb1c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 0x7fcb1c0b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcb30077160 tx=0x7fcb200058d0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 msgr2=0x7fcb30076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fcb2800cad0 tx=0x7fcb2800cf90 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 shutdown_connections 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcb1c0b6680 0x7fcb1c0b8b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb30109df0 0x7fcb30076190 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcb301094a0 0x7fcb30075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 --2- 172.21.15.102:0/2761175400 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcb30103b60 0x7fcb30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:57.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 >> 172.21.15.102:0/2761175400 conn(0x7fcb3007b850 msgr2=0x7fcb30107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:57.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 shutdown_connections 2024-09-21T03:42:57.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:57.072+0000 7fcb34e61640 1 -- 172.21.15.102:0/2761175400 wait complete. 2024-09-21T03:42:57.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:42:58.101 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- 172.21.15.102:0/3623293652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8107be0 msgr2=0x7feec8107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 --2- 172.21.15.102:0/3623293652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8107be0 0x7feec8107ff0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7feebc009900 tx=0x7feebc02a410 comp rx=0 tx=0).stop 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- 172.21.15.102:0/3623293652 shutdown_connections 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 --2- 172.21.15.102:0/3623293652 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8107be0 0x7feec8107ff0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 --2- 172.21.15.102:0/3623293652 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8108530 0x7feec810ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 --2- 172.21.15.102:0/3623293652 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 0x7feec81026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- 172.21.15.102:0/3623293652 >> 172.21.15.102:0/3623293652 conn(0x7feec8079ec0 msgr2=0x7feec807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- 172.21.15.102:0/3623293652 shutdown_connections 2024-09-21T03:42:58.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- 172.21.15.102:0/3623293652 wait complete. 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 Processor -- start 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.584+0000 7feecf676640 1 -- start start 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 0x7feec819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8107be0 0x7feec819b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feec8112370 con 0x7feec8108530 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feec81121f0 con 0x7feec81022a0 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feec81124f0 con 0x7feec8107be0 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44130/0 (socket says 172.21.15.102:44130) 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 -- 172.21.15.102:0/508939548 learned_addr learned my addr 172.21.15.102:0/508939548 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecd412640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 0x7feec819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feeccc11640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8107be0 0x7feec819b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 -- 172.21.15.102:0/508939548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8107be0 msgr2=0x7feec819b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8107be0 0x7feec819b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 -- 172.21.15.102:0/508939548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 msgr2=0x7feec819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 0x7feec819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 -- 172.21.15.102:0/508939548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec81a6750 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecdc13640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7feec0009fd0 tx=0x7feec000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feec67fc640 1 -- 172.21.15.102:0/508939548 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0011830 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feec67fc640 1 -- 172.21.15.102:0/508939548 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feec0016070 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec81a6a40 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.585+0000 7feec67fc640 1 -- 172.21.15.102:0/508939548 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec000f2e0 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.586+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec81a6f80 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 Processor -- start 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feec67fc640 1 -- 172.21.15.102:0/508939548 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7feec00119d0 con 0x7feec8108530 2024-09-21T03:42:58.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 -- start start 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f41711070 0x561f41ab82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ab8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561f41a2eea0 con 0x561f416f0390 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561f41a1e2d0 con 0x561f416e81b0 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feed5bea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561f41a220e0 con 0x561f41711070 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.589+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44134/0 (socket says 172.21.15.102:44134) 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 -- 172.21.15.102:0/180981211 learned_addr learned my addr 172.21.15.102:0/180981211 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f41711070 0x561f41ab82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feecd412640 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ab8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feec67fc640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 0x7feeb00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 -- 172.21.15.102:0/180981211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f41711070 msgr2=0x561f41ab82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f41711070 0x561f41ab82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 -- 172.21.15.102:0/180981211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 msgr2=0x561f41ab8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ab8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 -- 172.21.15.102:0/180981211 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f4177c650 con 0x561f416f0390 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feecdc13640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 0x7feeb00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feec67fc640 1 -- 172.21.15.102:0/508939548 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7feec00e6da0 con 0x7feec8108530 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeccc11640 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7feebc005ab0 tx=0x7feebc005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec50ffaac241eb52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeaf7fe640 1 -- 172.21.15.102:0/180981211 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc045070 con 0x561f416f0390 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeaf7fe640 1 -- 172.21.15.102:0/180981211 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feebc005040 con 0x561f416f0390 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feecdc13640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 0x7feeb00b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feec00a9e20 tx=0x7feec00a1410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.590+0000 7feeaf7fe640 1 -- 172.21.15.102:0/180981211 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc035050 con 0x561f416f0390 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 -- 172.21.15.102:0/180981211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 msgr2=0x561f41ab8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7feebc005ab0 tx=0x7feebc005a40 comp rx=0 tx=0).stop 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 -- 172.21.15.102:0/180981211 shutdown_connections 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ab8d40 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ab8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 --2- 172.21.15.102:0/180981211 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f41711070 0x561f41ab82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 -- 172.21.15.102:0/180981211 >> 172.21.15.102:0/180981211 conn(0x561f41705460 msgr2=0x561f41ab61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 -- 172.21.15.102:0/180981211 shutdown_connections 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.591+0000 7feed5bea740 1 -- 172.21.15.102:0/180981211 wait complete. 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 -- start start 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 Processor -- start 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416e81b0 0x561f41ac39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41acfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561f4187f700 con 0x561f416f0390 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561f419b9160 con 0x561f41711070 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x561f41ac6a40 con 0x561f416e81b0 2024-09-21T03:42:58.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feed5bea740 10 client.0 _ll_register_callbacks cb 0x561f419d29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feecd412640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feecd412640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44136/0 (socket says 172.21.15.102:44136) 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.592+0000 7feecd412640 1 -- 172.21.15.102:0/3206830837 learned_addr learned my addr 172.21.15.102:0/3206830837 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeccc11640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416e81b0 0x561f41ac39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeccc11640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41acfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 -- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416e81b0 msgr2=0x561f41ac39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416e81b0 0x561f41ac39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 -- 172.21.15.102:0/3206830837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 msgr2=0x561f41acfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41acfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 -- 172.21.15.102:0/3206830837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f419e6c90 con 0x561f416f0390 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeccc11640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41acfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feecd412640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7feeb800afd0 tx=0x7feeb8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf981fc8da676b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeacff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb800fb40 con 0x561f416f0390 2024-09-21T03:42:58.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7feeb800fce0 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feebc005040 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feeb8012450 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feed5bea740 10 client.17223 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561f41ad2810 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.593+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feebc005040 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7feeb801c7a0 con 0x561f416f0390 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 10 client.17223 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 20 client.17223 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416cf9f0 0x561f41ad5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 4 client.17223 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f41a30df0 con 0x561f416cf9f0 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.594+0000 7feeccc11640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416cf9f0 0x561f41ad5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.595+0000 7feeacff9640 10 client.17223 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:58.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.595+0000 7feeccc11640 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416cf9f0 0x561f41ad5d60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d2d6d8f2e6f404 server_cookie=cc2ddf1bfe713405 in_seq=0 out_seq=0 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.595+0000 7feeacff9640 1 -- 172.21.15.102:0/3206830837 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561f41a30df0 con 0x561f416cf9f0 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.595+0000 7feeacff9640 10 client.17223 handle_command_reply: tid=0 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.595+0000 7feed5bea740 1 client.17223 shutdown 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 msgr2=0x561f41ac3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7feeb800afd0 tx=0x7feeb8011b70 comp rx=0 tx=0).stop 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 shutdown_connections 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416cf9f0 0x561f41ad5d60 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416f0390 0x561f41ac3ee0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41acfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 --2- 172.21.15.102:0/3206830837 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416e81b0 0x561f41ac39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 >> 172.21.15.102:0/3206830837 conn(0x561f41705460 msgr2=0x561f41abb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feeacff9640 0 client.17223 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:58.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 shutdown_connections 2024-09-21T03:42:58.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 1 -- 172.21.15.102:0/3206830837 wait complete. 2024-09-21T03:42:58.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.596+0000 7feed5bea740 20 client.17223 trim_cache size 0 max 16384 2024-09-21T03:42:58.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 Processor -- start 2024-09-21T03:42:58.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 -- start start 2024-09-21T03:42:58.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ac3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41acfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feec81b2330 con 0x561f41711070 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feec81afc00 con 0x561f416e81b0 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feed5bea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feec81ada70 con 0x561f416f0390 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44142/0 (socket says 172.21.15.102:44142) 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.609+0000 7feeccc11640 1 -- 172.21.15.102:0/1035673924 learned_addr learned my addr 172.21.15.102:0/1035673924 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ac3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feecd412640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41acfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 -- 172.21.15.102:0/1035673924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 msgr2=0x561f41acfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41acfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 -- 172.21.15.102:0/1035673924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 msgr2=0x561f41ac3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ac3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 -- 172.21.15.102:0/1035673924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f41ad6290 con 0x561f41711070 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feecd412640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41acfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeccc11640 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7feebc033000 tx=0x7feebc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbb9fe0f10d0b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeaeffd640 1 -- 172.21.15.102:0/1035673924 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc045040 con 0x561f41711070 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeaeffd640 1 -- 172.21.15.102:0/1035673924 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feebc046040 con 0x561f41711070 2024-09-21T03:42:58.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.610+0000 7feeaeffd640 1 -- 172.21.15.102:0/1035673924 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc035040 con 0x561f41711070 2024-09-21T03:42:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- 172.21.15.102:0/1035673924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 msgr2=0x561f41ac0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7feebc033000 tx=0x7feebc005fd0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- 172.21.15.102:0/1035673924 shutdown_connections 2024-09-21T03:42:58.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f41711070 0x561f41ac0b90 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41acfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 --2- 172.21.15.102:0/1035673924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f416e81b0 0x561f41ac3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- 172.21.15.102:0/1035673924 >> 172.21.15.102:0/1035673924 conn(0x561f41705460 msgr2=0x561f41ac3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- 172.21.15.102:0/1035673924 shutdown_connections 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- 172.21.15.102:0/1035673924 wait complete. 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 -- start start 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.611+0000 7feed5bea740 1 Processor -- start 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41ac7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41ac82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feec81ae0c0 con 0x561f416e81b0 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feec81af530 con 0x561f41711070 2024-09-21T03:42:58.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feec81ae790 con 0x561f416f0390 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feed5bea740 10 client.0 _ll_register_callbacks cb 0x7feeb800a5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44150/0 (socket says 172.21.15.102:44150) 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 -- 172.21.15.102:0/1024266244 learned_addr learned my addr 172.21.15.102:0/1024266244 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 -- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 msgr2=0x561f41ac7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41ac7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 -- 172.21.15.102:0/1024266244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 msgr2=0x561f41ac82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41ac82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 -- 172.21.15.102:0/1024266244 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f41b3f6e0 con 0x561f416e81b0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeccc11640 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7feebc0057c0 tx=0x7feebc0317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d2ccc715bacbba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.612+0000 7feeacff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc05a020 con 0x561f416e81b0 2024-09-21T03:42:58.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7feebc004300 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feebc046040 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7feebc045030 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 10 client.17229 fetch_fsmap learned FSMap version 35 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x561f41b40780 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feebc046040 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7feebc053610 con 0x561f416e81b0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 10 client.17229 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 10 client.17229 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 20 client.17229 populate_metadata read hostname 'smithi102' 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416a4da0 0x561f41b42960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 4 client.17229 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.613+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f41ab63e0 con 0x561f416a4da0 2024-09-21T03:42:58.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feecd412640 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416a4da0 0x561f41b42960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feeacff9640 10 client.17229 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feecd412640 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416a4da0 0x561f41b42960 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47cf6a9c658436ff server_cookie=1faab39f0142ab18 in_seq=0 out_seq=0 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feeacff9640 1 -- 172.21.15.102:0/1024266244 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f41ab63e0 con 0x561f416a4da0 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feeacff9640 10 client.17229 handle_command_reply: tid=0 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 client.17229 shutdown 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 msgr2=0x561f41acc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7feebc0057c0 tx=0x7feebc0317e0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 shutdown_connections 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561f41711070 0x561f41ac82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x561f416f0390 0x561f41ac7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x561f416a4da0 0x561f41b42960 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 --2- 172.21.15.102:0/1024266244 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561f416e81b0 0x561f41acc690 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.614+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 >> 172.21.15.102:0/1024266244 conn(0x561f41705460 msgr2=0x561f41ab92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feeacff9640 0 client.17229 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:42:58.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 shutdown_connections 2024-09-21T03:42:58.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feed5bea740 1 -- 172.21.15.102:0/1024266244 wait complete. 2024-09-21T03:42:58.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feed5bea740 20 client.17229 trim_cache size 0 max 16384 2024-09-21T03:42:58.622 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:42:58.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 msgr2=0x7feeb00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 0x7feeb00b8b90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feec00a9e20 tx=0x7feec00a1410 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 msgr2=0x7feec819bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7feec0009fd0 tx=0x7feec000b8e0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 shutdown_connections 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feeb00b6680 0x7feeb00b8b90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feec8108530 0x7feec819bec0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feec8107be0 0x7feec819b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 --2- 172.21.15.102:0/508939548 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feec81022a0 0x7feec819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 >> 172.21.15.102:0/508939548 conn(0x7feec8079ec0 msgr2=0x7feec8100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 shutdown_connections 2024-09-21T03:42:58.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:42:58.615+0000 7feecf676640 1 -- 172.21.15.102:0/508939548 wait complete. 2024-09-21T03:42:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:42:58 smithi121 ceph-mon[34316]: pgmap v612: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:42:58 smithi102 ceph-mon[31392]: pgmap v612: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:42:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:42:58 smithi148 ceph-mon[34651]: pgmap v612: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:43:00.389 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:00.389 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:00.640 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:00.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:00 smithi102 ceph-mon[31392]: pgmap v613: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:43:00.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:00 smithi121 ceph-mon[34316]: pgmap v613: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:43:00.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:00 smithi148 ceph-mon[34651]: pgmap v613: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T03:43:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.113+0000 7f9e4cf99640 1 -- 172.21.15.102:0/2025505135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 msgr2=0x7f9e48103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.113+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/2025505135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e48103f70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009900 tx=0x7f9e3802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 -- 172.21.15.102:0/2025505135 shutdown_connections 2024-09-21T03:43:01.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/2025505135 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e48109df0 0x7f9e48110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/2025505135 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e481094a0 0x7f9e481098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/2025505135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e48103f70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 -- 172.21.15.102:0/2025505135 >> 172.21.15.102:0/2025505135 conn(0x7f9e4807b850 msgr2=0x7f9e4807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 -- 172.21.15.102:0/2025505135 shutdown_connections 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 -- 172.21.15.102:0/2025505135 wait complete. 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.114+0000 7f9e4cf99640 1 Processor -- start 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 -- start start 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 0x7f9e4819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 0x7f9e4819ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48113cb0 con 0x7f9e48103b60 2024-09-21T03:43:01.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48113b30 con 0x7f9e481094a0 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4cf99640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e48113e30 con 0x7f9e48109df0 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44160/0 (socket says 172.21.15.102:44160) 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 -- 172.21.15.102:0/3351995984 learned_addr learned my addr 172.21.15.102:0/3351995984 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 0x7f9e4819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 0x7f9e4819ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 -- 172.21.15.102:0/3351995984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 msgr2=0x7f9e4819ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 0x7f9e4819ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 -- 172.21.15.102:0/3351995984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 msgr2=0x7f9e4819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 0x7f9e4819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 -- 172.21.15.102:0/3351995984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e481a0710 con 0x7f9e48103b60 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 0x7f9e4819ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:01.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 0x7f9e4819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.115+0000 7f9e4659c640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9e38006010 tx=0x7f9e38004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.116+0000 7f9e3f7fe640 1 -- 172.21.15.102:0/3351995984 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3803f070 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.116+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e481a09a0 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.116+0000 7f9e3f7fe640 1 -- 172.21.15.102:0/3351995984 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e38031e10 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.116+0000 7f9e3f7fe640 1 -- 172.21.15.102:0/3351995984 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38035030 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.116+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e481a7160 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.118+0000 7f9e3f7fe640 1 -- 172.21.15.102:0/3351995984 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f9e38042070 con 0x7f9e48103b60 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.118+0000 7f9e5350d740 1 Processor -- start 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 -- start start 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1c1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bded490 0x56028c1c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56028c133e60 con 0x56028bdf5670 2024-09-21T03:43:01.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56028c123290 con 0x56028bded490 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e5350d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56028c1270a0 con 0x56028be16350 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44164/0 (socket says 172.21.15.102:44164) 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 -- 172.21.15.102:0/3115943707 learned_addr learned my addr 172.21.15.102:0/3115943707 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e4659c640 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bded490 0x56028c1c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1c1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e3f7fe640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 0x7f9e340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 -- 172.21.15.102:0/3115943707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 msgr2=0x56028c1c1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1c1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.119+0000 7f9e45d9b640 1 -- 172.21.15.102:0/3115943707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bded490 msgr2=0x56028c1c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bded490 0x56028c1c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e45d9b640 1 -- 172.21.15.102:0/3115943707 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028be81930 con 0x56028bdf5670 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 0x7f9e340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e3f7fe640 1 -- 172.21.15.102:0/3351995984 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9e38107ef0 con 0x7f9e48103b60 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9e300077a0 tx=0x7f9e30007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0df275a91dfbc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e3cff9640 1 -- 172.21.15.102:0/3115943707 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000d950 con 0x56028bdf5670 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e3cff9640 1 -- 172.21.15.102:0/3115943707 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e30018070 con 0x56028bdf5670 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.120+0000 7f9e3cff9640 1 -- 172.21.15.102:0/3115943707 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30013e60 con 0x56028bdf5670 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- 172.21.15.102:0/3115943707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 msgr2=0x56028c1c22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 0x7f9e340b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007fb0 tx=0x7f9e40004b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f9e300077a0 tx=0x7f9e30007c60 comp rx=0 tx=0).stop 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- 172.21.15.102:0/3115943707 shutdown_connections 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c22c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bded490 0x56028c1c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 --2- 172.21.15.102:0/3115943707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1c1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- 172.21.15.102:0/3115943707 >> 172.21.15.102:0/3115943707 conn(0x56028be0a740 msgr2=0x56028c1bf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- 172.21.15.102:0/3115943707 shutdown_connections 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- 172.21.15.102:0/3115943707 wait complete. 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 -- start start 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.121+0000 7f9e5350d740 1 Processor -- start 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1d9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56028bf84890 con 0x56028bded490 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56028c0bdd40 con 0x56028bdf5670 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56028c1d0020 con 0x56028be16350 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 10 client.0 _ll_register_callbacks cb 0x56028c121c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44178/0 (socket says 172.21.15.102:44178) 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 -- 172.21.15.102:0/2342575465 learned_addr learned my addr 172.21.15.102:0/2342575465 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 -- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 msgr2=0x56028c1d9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1d9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 -- 172.21.15.102:0/2342575465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 msgr2=0x56028c1cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 -- 172.21.15.102:0/2342575465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028c1d9850 con 0x56028bded490 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e4659c640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9e38005940 tx=0x7f9e3810b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc357881c44a2b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38049030 con 0x56028bded490 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9e380d7290 con 0x56028bded490 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.122+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e30018070 con 0x56028bded490 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e380cdad0 con 0x56028bded490 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 10 client.17241 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:01.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56028c1dc150 con 0x56028bded490 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e30018070 con 0x56028bded490 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e380f10b0 con 0x56028bded490 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 10 client.17241 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 10 client.17241 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 20 client.17241 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028bdd4cd0 0x56028c1df590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 4 client.17241 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56028c135db0 con 0x56028bdd4cd0 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.123+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028bdd4cd0 0x56028c1df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.124+0000 7f9e2dffb640 10 client.17241 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.124+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028bdd4cd0 0x56028c1df590 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea2becf1aaf5d4a5 server_cookie=975363b66a239d05 in_seq=0 out_seq=0 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e2dffb640 1 -- 172.21.15.102:0/2342575465 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56028c135db0 con 0x56028bdd4cd0 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e2dffb640 10 client.17241 handle_command_reply: tid=0 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 client.17241 shutdown 2024-09-21T03:43:01.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 msgr2=0x56028c1cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9e38005940 tx=0x7f9e3810b630 comp rx=0 tx=0).stop 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 shutdown_connections 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028be16350 0x56028c1d9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028bdd4cd0 0x56028c1df590 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e2dffb640 0 client.17241 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 --2- 172.21.15.102:0/2342575465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1cd350 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 >> 172.21.15.102:0/2342575465 conn(0x56028be0a740 msgr2=0x56028c1c49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 shutdown_connections 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 1 -- 172.21.15.102:0/2342575465 wait complete. 2024-09-21T03:43:01.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.125+0000 7f9e5350d740 20 client.17241 trim_cache size 0 max 16384 2024-09-21T03:43:01.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.142+0000 7f9e5350d740 1 Processor -- start 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.142+0000 7f9e5350d740 1 -- start start 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 0x56028c1bf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bded490 0x56028c1d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481b01d0 con 0x56028bdf5670 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481adaa0 con 0x56028bdd4cd0 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e5350d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481ab910 con 0x56028bded490 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44194/0 (socket says 172.21.15.102:44194) 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 -- 172.21.15.102:0/1988718360 learned_addr learned my addr 172.21.15.102:0/1988718360 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bded490 0x56028c1d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 0x56028c1bf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 -- 172.21.15.102:0/1988718360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bded490 msgr2=0x56028c1d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bded490 0x56028c1d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 -- 172.21.15.102:0/1988718360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 msgr2=0x56028c1bf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 0x56028c1bf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 -- 172.21.15.102:0/1988718360 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028c1cb650 con 0x56028bdf5670 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 0x56028c1bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9e40011780 tx=0x7f9e40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8a532d148c45d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.143+0000 7f9e2ffff640 1 -- 172.21.15.102:0/1988718360 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e40022070 con 0x56028bdf5670 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e2ffff640 1 -- 172.21.15.102:0/1988718360 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e40010b40 con 0x56028bdf5670 2024-09-21T03:43:01.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e2ffff640 1 -- 172.21.15.102:0/1988718360 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4001d610 con 0x56028bdf5670 2024-09-21T03:43:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 -- 172.21.15.102:0/1988718360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 msgr2=0x56028c1c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9e40011780 tx=0x7f9e40011000 comp rx=0 tx=0).stop 2024-09-21T03:43:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 -- 172.21.15.102:0/1988718360 shutdown_connections 2024-09-21T03:43:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bdf5670 0x56028c1c7960 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bded490 0x56028c1d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1988718360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdd4cd0 0x56028c1bf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 -- 172.21.15.102:0/1988718360 >> 172.21.15.102:0/1988718360 conn(0x56028be0a740 msgr2=0x56028c1ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 -- 172.21.15.102:0/1988718360 shutdown_connections 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.144+0000 7f9e5350d740 1 -- 172.21.15.102:0/1988718360 wait complete. 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 -- start start 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 Processor -- start 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 0x56028c1d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481abf60 con 0x56028bded490 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481ad3d0 con 0x56028bdf5670 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e481ac630 con 0x56028bdd4cd0 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e5350d740 10 client.0 _ll_register_callbacks cb 0x7f9e3803b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:01.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e45d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44196/0 (socket says 172.21.15.102:44196) 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e45d9b640 1 -- 172.21.15.102:0/1303361221 learned_addr learned my addr 172.21.15.102:0/1303361221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.145+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 0x56028c1d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e46d9d640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 -- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 msgr2=0x56028c1d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 0x56028c1d58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 -- 172.21.15.102:0/1303361221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 msgr2=0x56028c1d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 -- 172.21.15.102:0/1303361221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028c1d0ce0 con 0x56028bded490 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 0x56028c1d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e45d9b640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9e30013a10 tx=0x7f9e300139a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf8213838cf9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30013480 con 0x56028bded490 2024-09-21T03:43:01.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f9e30013620 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e40010b40 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e3000d950 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e5350d740 10 client.17247 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56028c24ac80 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.146+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e40010b40 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e3002da40 con 0x56028bded490 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 10 client.17247 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 10 client.17247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 20 client.17247 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028be16350 0x56028c24d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 4 client.17247 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56028c131860 con 0x56028be16350 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028be16350 0x56028c24d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:01.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.148+0000 7f9e2dffb640 10 client.17247 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:01.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.147+0000 7f9e4659c640 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028be16350 0x56028c24d160 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a1606a0efc2fc02 server_cookie=c8fe31012c910bf2 in_seq=0 out_seq=0 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e2dffb640 1 -- 172.21.15.102:0/1303361221 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56028c131860 con 0x56028be16350 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e2dffb640 10 client.17247 handle_command_reply: tid=0 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 client.17247 shutdown 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 msgr2=0x56028c1d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f9e30013a10 tx=0x7f9e300139a0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 shutdown_connections 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56028be16350 0x56028c24d160 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56028bded490 0x56028c1d0230 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56028bdf5670 0x56028c1d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 --2- 172.21.15.102:0/1303361221 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56028bdd4cd0 0x56028c1d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e2dffb640 0 client.17247 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 >> 172.21.15.102:0/1303361221 conn(0x56028be0a740 msgr2=0x56028c1c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 shutdown_connections 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 1 -- 172.21.15.102:0/1303361221 wait complete. 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.150+0000 7f9e5350d740 20 client.17247 trim_cache size 0 max 16384 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "836ab757-3bc4-42f6-adc1-f62cc07e4d10", 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:43:01.156 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 msgr2=0x7f9e340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 0x7f9e340b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e40007fb0 tx=0x7f9e40004b50 comp rx=0 tx=0).stop 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 msgr2=0x7f9e4819a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f9e38006010 tx=0x7f9e38004430 comp rx=0 tx=0).stop 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 shutdown_connections 2024-09-21T03:43:01.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e340b6680 0x7f9e340b8b90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e48109df0 0x7f9e4819ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e481094a0 0x7f9e4819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 --2- 172.21.15.102:0/3351995984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e48103b60 0x7f9e4819a7a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 >> 172.21.15.102:0/3351995984 conn(0x7f9e4807b850 msgr2=0x7f9e48107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 shutdown_connections 2024-09-21T03:43:01.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:01.151+0000 7f9e4cf99640 1 -- 172.21.15.102:0/3351995984 wait complete. 2024-09-21T03:43:01.899 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:01.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:01 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:43:01.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:01 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:01.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:01 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:43:01.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:01 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:01.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:01 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:43:02.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:01 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:43:02.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:01 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:02.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:01 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:43:02.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:01 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:02.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:01 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:43:02.144 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:02.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:01 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:43:02.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:01 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:02.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:01 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:43:02.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:01 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:02.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:01 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 -- 172.21.15.102:0/1999048168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 msgr2=0x7fd75c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1999048168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c110620 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fd754009900 tx=0x7fd75402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 -- 172.21.15.102:0/1999048168 shutdown_connections 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1999048168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c110620 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1999048168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c1094a0 0x7fd75c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1999048168 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c103b60 0x7fd75c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 -- 172.21.15.102:0/1999048168 >> 172.21.15.102:0/1999048168 conn(0x7fd75c07b850 msgr2=0x7fd75c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 -- 172.21.15.102:0/1999048168 shutdown_connections 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 -- 172.21.15.102:0/1999048168 wait complete. 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.588+0000 7fd7613f3640 1 Processor -- start 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 -- start start 2024-09-21T03:43:02.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 0x7fd75c19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 0x7fd75c19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c113bd0 con 0x7fd75c109df0 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c113a50 con 0x7fd75c103b60 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd7613f3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c113d50 con 0x7fd75c1094a0 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44218/0 (socket says 172.21.15.102:44218) 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75b7fe640 1 -- 172.21.15.102:0/1044871919 learned_addr learned my addr 172.21.15.102:0/1044871919 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75affd640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 0x7fd75c19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 0x7fd75c19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75b7fe640 1 -- 172.21.15.102:0/1044871919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 msgr2=0x7fd75c19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.589+0000 7fd75b7fe640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 0x7fd75c19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75b7fe640 1 -- 172.21.15.102:0/1044871919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 msgr2=0x7fd75c19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75b7fe640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 0x7fd75c19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75b7fe640 1 -- 172.21.15.102:0/1044871919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd75c1a03d0 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 0x7fd75c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75affd640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 0x7fd75c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd75b7fe640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd754005ab0 tx=0x7fd7540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd743fff640 1 -- 172.21.15.102:0/1044871919 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75403f030 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75c1a0660 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd743fff640 1 -- 172.21.15.102:0/1044871919 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd754003cd0 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd743fff640 1 -- 172.21.15.102:0/1044871919 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754035070 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.590+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd75c1a0b90 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.592+0000 7fd767967740 1 Processor -- start 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd743fff640 1 -- 172.21.15.102:0/1044871919 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fd754042030 con 0x7fd75c109df0 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 -- start start 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c840070 0x562b3cbe7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c8171b0 0x562b3cbe77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562b3cb5de50 con 0x562b3c81f390 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562b3cb4d280 con 0x562b3c8171b0 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd767967740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562b3cb51090 con 0x562b3c840070 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd75a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd75a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44230/0 (socket says 172.21.15.102:44230) 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd75a7fc640 1 -- 172.21.15.102:0/275324545 learned_addr learned my addr 172.21.15.102:0/275324545 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c840070 0x562b3cbe7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.593+0000 7fd75affd640 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c8171b0 0x562b3cbe77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd743fff640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 0x7fd7440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 -- 172.21.15.102:0/275324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c840070 msgr2=0x562b3cbe7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c840070 0x562b3cbe7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 -- 172.21.15.102:0/275324545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c8171b0 msgr2=0x562b3cbe77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c8171b0 0x562b3cbe77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 -- 172.21.15.102:0/275324545 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3c8ab650 con 0x562b3c81f390 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75b7fe640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 0x7fd7440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd743fff640 1 -- 172.21.15.102:0/1044871919 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fd754107c20 con 0x7fd75c109df0 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd750012800 tx=0x7fd7500099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d5213d01a13b62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd7417fa640 1 -- 172.21.15.102:0/275324545 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750003b70 con 0x562b3c81f390 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd7417fa640 1 -- 172.21.15.102:0/275324545 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd750010dc0 con 0x562b3c81f390 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.594+0000 7fd7417fa640 1 -- 172.21.15.102:0/275324545 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750004750 con 0x562b3c81f390 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- 172.21.15.102:0/275324545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 msgr2=0x562b3cbe7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd75b7fe640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 0x7fd7440b8bc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd75402f6c0 tx=0x7fd7540c2230 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fd750012800 tx=0x7fd7500099d0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- 172.21.15.102:0/275324545 shutdown_connections 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbe7cf0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c8171b0 0x562b3cbe77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 --2- 172.21.15.102:0/275324545 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c840070 0x562b3cbe7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- 172.21.15.102:0/275324545 >> 172.21.15.102:0/275324545 conn(0x562b3c834460 msgr2=0x562b3cbe5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- 172.21.15.102:0/275324545 shutdown_connections 2024-09-21T03:43:02.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- 172.21.15.102:0/275324545 wait complete. 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.595+0000 7fd767967740 1 -- start start 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 Processor -- start 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbfed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562b3c9ae700 con 0x562b3c81f390 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562b3cae8110 con 0x562b3c840070 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562b3cbf5a50 con 0x562b3c8171b0 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd767967740 10 client.0 _ll_register_callbacks cb 0x562b3cb01990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44234/0 (socket says 172.21.15.102:44234) 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 -- 172.21.15.102:0/1669283295 learned_addr learned my addr 172.21.15.102:0/1669283295 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbfed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 -- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 msgr2=0x562b3cbf28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 -- 172.21.15.102:0/1669283295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 msgr2=0x562b3cbfed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbfed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 -- 172.21.15.102:0/1669283295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3cb15c40 con 0x562b3c81f390 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd75affd640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd74c012c20 tx=0x7fd74c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ff71b85b09fdce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.596+0000 7fd73eff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c01f060 con 0x562b3c81f390 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fd74c00e7c0 con 0x562b3c81f390 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd750010dc0 con 0x562b3c81f390 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd74c00e9c0 con 0x562b3c81f390 2024-09-21T03:43:02.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 10 client.17259 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b3cc017b0 con 0x562b3c81f390 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd750010dc0 con 0x562b3c81f390 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd74c00d340 con 0x562b3c81f390 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 10 client.17259 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 10 client.17259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 20 client.17259 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7fe9f0 0x562b3cc04cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 4 client.17259 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.597+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b3cb5fda0 con 0x562b3c7fe9f0 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.598+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7fe9f0 0x562b3cc04cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.598+0000 7fd73eff5640 10 client.17259 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.598+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7fe9f0 0x562b3cc04cd0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e7deb4b9fcefd6f server_cookie=b90a5af5c9900bf in_seq=0 out_seq=0 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd73eff5640 1 -- 172.21.15.102:0/1669283295 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b3cb5fda0 con 0x562b3c7fe9f0 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd73eff5640 10 client.17259 handle_command_reply: tid=0 2024-09-21T03:43:02.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 client.17259 shutdown 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 msgr2=0x562b3cbf2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fd74c012c20 tx=0x7fd74c0107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 shutdown_connections 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7fe9f0 0x562b3cc04cd0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf2e30 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbfed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 --2- 172.21.15.102:0/1669283295 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 >> 172.21.15.102:0/1669283295 conn(0x562b3c834460 msgr2=0x562b3cbea400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd73eff5640 0 client.17259 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 shutdown_connections 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 1 -- 172.21.15.102:0/1669283295 wait complete. 2024-09-21T03:43:02.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.599+0000 7fd767967740 20 client.17259 trim_cache size 0 max 16384 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 Processor -- start 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 -- start start 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 0x562b3cbfec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1b2140 con 0x562b3c840070 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1afa10 con 0x562b3c81f390 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd767967740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1ad880 con 0x562b3c8171b0 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44244/0 (socket says 172.21.15.102:44244) 2024-09-21T03:43:02.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 -- 172.21.15.102:0/280015784 learned_addr learned my addr 172.21.15.102:0/280015784 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75affd640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 0x562b3cbfec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 -- 172.21.15.102:0/280015784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 msgr2=0x562b3cbf2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 -- 172.21.15.102:0/280015784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 msgr2=0x562b3cbfec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 0x562b3cbfec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75a7fc640 1 -- 172.21.15.102:0/280015784 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b3cbe9560 con 0x562b3c840070 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.617+0000 7fd75affd640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 0x562b3cbfec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.618+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd750010740 tx=0x7fd7500099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc0930e90ee5f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.618+0000 7fd740ff9640 1 -- 172.21.15.102:0/280015784 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750029040 con 0x562b3c840070 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.618+0000 7fd740ff9640 1 -- 172.21.15.102:0/280015784 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd750004790 con 0x562b3c840070 2024-09-21T03:43:02.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.618+0000 7fd740ff9640 1 -- 172.21.15.102:0/280015784 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75001e450 con 0x562b3c840070 2024-09-21T03:43:02.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.618+0000 7fd767967740 1 -- 172.21.15.102:0/280015784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 msgr2=0x562b3cbefae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fd750010740 tx=0x7fd7500099d0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- 172.21.15.102:0/280015784 shutdown_connections 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c840070 0x562b3cbefae0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c81f390 0x562b3cbfec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- 172.21.15.102:0/280015784 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbf2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- 172.21.15.102:0/280015784 >> 172.21.15.102:0/280015784 conn(0x562b3c834460 msgr2=0x562b3cbf26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- 172.21.15.102:0/280015784 shutdown_connections 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- 172.21.15.102:0/280015784 wait complete. 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- start start 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 Processor -- start 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbfb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbf6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1aded0 con 0x562b3c81f390 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1af340 con 0x562b3c840070 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd75c1ae5a0 con 0x562b3c8171b0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd767967740 10 client.0 _ll_register_callbacks cb 0x7fd74c00aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.619+0000 7fd75affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44254/0 (socket says 172.21.15.102:44254) 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 -- 172.21.15.102:0/1305558869 learned_addr learned my addr 172.21.15.102:0/1305558869 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbfb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbf6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 -- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 msgr2=0x562b3cbfb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbfb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 -- 172.21.15.102:0/1305558869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 msgr2=0x562b3cbf6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbf6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 -- 172.21.15.102:0/1305558869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b3cbf7390 con 0x562b3c81f390 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd75affd640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00d7e0 tx=0x7fd74c010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3caeb63a71c15df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:02.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd73eff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74c00e7c0 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fd74c00eb60 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd750004790 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fd74c039050 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd767967740 10 client.17265 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.620+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562b3cc6f490 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd750004790 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fd74c004800 con 0x562b3c81f390 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 10 client.17265 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 10 client.17265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 20 client.17265 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7d3da0 0x562b3cc71ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 4 client.17265 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562b3cb5b850 con 0x562b3c7d3da0 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.621+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7d3da0 0x562b3cc71ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:02.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd73eff5640 10 client.17265 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd75a7fc640 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7d3da0 0x562b3cc71ca0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3044670974805a0e server_cookie=f67bc6d7968b8fc2 in_seq=0 out_seq=0 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd73eff5640 1 -- 172.21.15.102:0/1305558869 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x562b3cb5b850 con 0x562b3c7d3da0 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd73eff5640 10 client.17265 handle_command_reply: tid=0 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 client.17265 shutdown 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 msgr2=0x562b3cbf6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00d7e0 tx=0x7fd74c010ca0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 shutdown_connections 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562b3c7d3da0 0x562b3cc71ca0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562b3c81f390 0x562b3cbf6810 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562b3c840070 0x562b3cbf6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd73eff5640 0 client.17265 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 --2- 172.21.15.102:0/1305558869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562b3c8171b0 0x562b3cbfb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 >> 172.21.15.102:0/1305558869 conn(0x562b3c834460 msgr2=0x562b3cbe82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 shutdown_connections 2024-09-21T03:43:02.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 1 -- 172.21.15.102:0/1305558869 wait complete. 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.622+0000 7fd767967740 20 client.17265 trim_cache size 0 max 16384 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.629 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.630 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.631 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:43:02.632 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.633 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "836ab757-3bc4-42f6-adc1-f62cc07e4d10": { 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:01.147651+0000", 2024-09-21T03:43:02.634 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:43:02.635 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:02.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 msgr2=0x7fd7440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 0x7fd7440b8bc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd75402f6c0 tx=0x7fd7540c2230 comp rx=0 tx=0).stop 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 msgr2=0x7fd75c19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fd754005ab0 tx=0x7fd7540042f0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 shutdown_connections 2024-09-21T03:43:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd7440b66b0 0x7fd7440b8bc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd75c109df0 0x7fd75c19fd60 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd75c1094a0 0x7fd75c19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 --2- 172.21.15.102:0/1044871919 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd75c103b60 0x7fd75c19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 >> 172.21.15.102:0/1044871919 conn(0x7fd75c07b850 msgr2=0x7fd75c107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 shutdown_connections 2024-09-21T03:43:02.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:02.623+0000 7fd7613f3640 1 -- 172.21.15.102:0/1044871919 wait complete. 2024-09-21T03:43:02.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:02 smithi102 ceph-mon[31392]: pgmap v614: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:43:03.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:02 smithi121 ceph-mon[34316]: pgmap v614: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:43:03.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:02 smithi148 ceph-mon[34651]: pgmap v614: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 KiB/s wr, 20 op/s 2024-09-21T03:43:03.387 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:03.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:43:03.642 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:04.019 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:04.019 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:04.019 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:04.019 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:43:04.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:04.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:04.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:04.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 -- 172.21.15.102:0/4250271502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c1052c0 msgr2=0x7fd15c10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 --2- 172.21.15.102:0/4250271502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c1052c0 0x7fd15c10d900 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd144009900 tx=0x7fd14402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 -- 172.21.15.102:0/4250271502 shutdown_connections 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 --2- 172.21.15.102:0/4250271502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c1052c0 0x7fd15c10d900 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 --2- 172.21.15.102:0/4250271502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c10de40 0x7fd15c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 --2- 172.21.15.102:0/4250271502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c104890 0x7fd15c104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 -- 172.21.15.102:0/4250271502 >> 172.21.15.102:0/4250271502 conn(0x7fd15c079730 msgr2=0x7fd15c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 -- 172.21.15.102:0/4250271502 shutdown_connections 2024-09-21T03:43:04.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.106+0000 7fd161558640 1 -- 172.21.15.102:0/4250271502 wait complete. 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 Processor -- start 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 -- start start 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c1052c0 0x7fd15c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c10de40 0x7fd15c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c113c70 con 0x7fd15c104890 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c113af0 con 0x7fd15c1052c0 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd161558640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c113df0 con 0x7fd15c10de40 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd15affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd15affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37140/0 (socket says 172.21.15.102:37140) 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd15affd640 1 -- 172.21.15.102:0/1278596002 learned_addr learned my addr 172.21.15.102:0/1278596002 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd15b7fe640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c10de40 0x7fd15c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.107+0000 7fd15a7fc640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c1052c0 0x7fd15c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 -- 172.21.15.102:0/1278596002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c10de40 msgr2=0x7fd15c19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c10de40 0x7fd15c19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 -- 172.21.15.102:0/1278596002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c1052c0 msgr2=0x7fd15c19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c1052c0 0x7fd15c19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 -- 172.21.15.102:0/1278596002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c1a05b0 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd15affd640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ba50 tx=0x7fd14c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c019070 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15c1a08a0 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fd14c00cbe0 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0076e0 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.108+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15c1a7000 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.109+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15c06c200 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.110+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fd14c01c070 con 0x7fd15c104890 2024-09-21T03:43:04.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.112+0000 7fd153fff640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 0x7fd1480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.112+0000 7fd15a7fc640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 0x7fd1480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.112+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7fd14c0e7520 con 0x7fd15c104890 2024-09-21T03:43:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.112+0000 7fd15a7fc640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 0x7fd1480b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd144006010 tx=0x7fd144000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:04.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.115+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd14c023070 con 0x7fd15c104890 2024-09-21T03:43:04.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:43:04.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:43:04.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:43:04.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:43:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.331+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd15c104ca0 con 0x7fd15c104890 2024-09-21T03:43:04.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.332+0000 7fd153fff640 1 -- 172.21.15.102:0/1278596002 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7fd14c0ad9d0 con 0x7fd15c104890 2024-09-21T03:43:04.335 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:43:04.335 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:43:04.335 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 msgr2=0x7fd1480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 0x7fd1480b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd144006010 tx=0x7fd144000bc0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 msgr2=0x7fd15c19a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00ba50 tx=0x7fd14c00bf10 comp rx=0 tx=0).stop 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 shutdown_connections 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fd1480b6680 0x7fd1480b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fd15c10de40 0x7fd15c19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd15c1052c0 0x7fd15c19abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 --2- 172.21.15.102:0/1278596002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c104890 0x7fd15c19a640 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:04.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 >> 172.21.15.102:0/1278596002 conn(0x7fd15c079730 msgr2=0x7fd15c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:04.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 shutdown_connections 2024-09-21T03:43:04.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:04.335+0000 7fd161558640 1 -- 172.21.15.102:0/1278596002 wait complete. 2024-09-21T03:43:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:04 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1278596002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:04 smithi102 ceph-mon[31392]: pgmap v615: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:04.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:43:05.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:04 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1278596002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:05.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:04 smithi121 ceph-mon[34316]: pgmap v615: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:05.233 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:05.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:04 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1278596002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:05.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:04 smithi148 ceph-mon[34651]: pgmap v615: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 -- 172.21.15.102:0/2466351903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 msgr2=0x7febc01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 --2- 172.21.15.102:0/2466351903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc01098b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7febb4009900 tx=0x7febb402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 -- 172.21.15.102:0/2466351903 shutdown_connections 2024-09-21T03:43:05.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 --2- 172.21.15.102:0/2466351903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc01098b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 --2- 172.21.15.102:0/2466351903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 0x7febc0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 --2- 172.21.15.102:0/2466351903 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 0x7febc0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 -- 172.21.15.102:0/2466351903 >> 172.21.15.102:0/2466351903 conn(0x7febc007b850 msgr2=0x7febc007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 -- 172.21.15.102:0/2466351903 shutdown_connections 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.728+0000 7febc665c640 1 -- 172.21.15.102:0/2466351903 wait complete. 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 Processor -- start 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 -- start start 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 0x7febc0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 0x7febc0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7febc0113c10 con 0x7febc01094a0 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febc0113a90 con 0x7febc0109df0 2024-09-21T03:43:05.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.729+0000 7febc665c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7febc0113d90 con 0x7febc0103b60 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37164/0 (socket says 172.21.15.102:37164) 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 -- 172.21.15.102:0/2125566 learned_addr learned my addr 172.21.15.102:0/2125566 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 0x7febc0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbffff640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 0x7febc0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 -- 172.21.15.102:0/2125566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 msgr2=0x7febc0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 0x7febc0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 -- 172.21.15.102:0/2125566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 msgr2=0x7febc0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 0x7febc0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 -- 172.21.15.102:0/2125566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc01a8940 con 0x7febc01094a0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7febb4005940 tx=0x7febb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbd7fa640 1 -- 172.21.15.102:0/2125566 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb403f030 con 0x7febc01094a0 2024-09-21T03:43:05.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbd7fa640 1 -- 172.21.15.102:0/2125566 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7febb4031910 con 0x7febc01094a0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc01a8bd0 con 0x7febc01094a0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febbd7fa640 1 -- 172.21.15.102:0/2125566 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb4035070 con 0x7febc01094a0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.730+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc01a90b0 con 0x7febc01094a0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.733+0000 7febbd7fa640 1 -- 172.21.15.102:0/2125566 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7febb4042030 con 0x7febc01094a0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.733+0000 7febccbd0740 1 Processor -- start 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.733+0000 7febccbd0740 1 -- start start 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f938be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f939120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e7f8aeea0 con 0x556e7f591070 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556e7f89e2d0 con 0x556e7f570390 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febccbd0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556e7f8a20e0 con 0x556e7f5681b0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37176/0 (socket says 172.21.15.102:37176) 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 -- 172.21.15.102:0/2732058404 learned_addr learned my addr 172.21.15.102:0/2732058404 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febbd7fa640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 0x7feba80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f939120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 0x7feba80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febbffff640 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f938be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 -- 172.21.15.102:0/2732058404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 msgr2=0x556e7f938be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f938be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febbd7fa640 1 -- 172.21.15.102:0/2125566 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7febb4107cb0 con 0x7febc01094a0 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 -- 172.21.15.102:0/2732058404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 msgr2=0x556e7f939120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f939120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 -- 172.21.15.102:0/2732058404 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e7f5fc650 con 0x556e7f591070 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.734+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7febb8005f40 tx=0x7febb8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be506547a713ef38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 0x7feba80b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7febb8012d20 tx=0x7febb801f000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7feba67fc640 1 -- 172.21.15.102:0/2732058404 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8026070 con 0x556e7f591070 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7feba67fc640 1 -- 172.21.15.102:0/2732058404 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7febb8014590 con 0x556e7f591070 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7feba67fc640 1 -- 172.21.15.102:0/2732058404 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8021920 con 0x556e7f591070 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7febccbd0740 1 -- 172.21.15.102:0/2732058404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 msgr2=0x556e7f9386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.735+0000 7febccbd0740 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7febb8005f40 tx=0x7febb8012820 comp rx=0 tx=0).stop 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 -- 172.21.15.102:0/2732058404 shutdown_connections 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f939120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f938be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 --2- 172.21.15.102:0/2732058404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f9386a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 -- 172.21.15.102:0/2732058404 >> 172.21.15.102:0/2732058404 conn(0x556e7f585460 msgr2=0x556e7f936590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 -- 172.21.15.102:0/2732058404 shutdown_connections 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 -- 172.21.15.102:0/2732058404 wait complete. 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 -- start start 2024-09-21T03:43:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.736+0000 7febccbd0740 1 Processor -- start 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f943e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f944360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e7f6ff700 con 0x556e7f591070 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556e7f839160 con 0x556e7f570390 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x556e7f946e20 con 0x556e7f5681b0 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febccbd0740 10 client.0 _ll_register_callbacks cb 0x556e7f8529e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37190/0 (socket says 172.21.15.102:37190) 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 -- 172.21.15.102:0/2359778757 learned_addr learned my addr 172.21.15.102:0/2359778757 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f944360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febbffff640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f943e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 -- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 msgr2=0x556e7f943e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f943e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 -- 172.21.15.102:0/2359778757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 msgr2=0x556e7f944360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f944360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 -- 172.21.15.102:0/2359778757 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e7f866c90 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7febb8014460 tx=0x7febb8009690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e85a29474d4c673 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.737+0000 7feb9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb802f020 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7febb8004ba0 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556e7f8b0df0 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7febb803a050 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 10 client.17283 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556e7f952b40 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x556e7f8b0df0 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7febb800f040 con 0x556e7f591070 2024-09-21T03:43:05.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 10 client.17283 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 10 client.17283 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 20 client.17283 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f54f9f0 0x556e7f9564d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 4 client.17283 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.738+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e7f8ac8a0 con 0x556e7f54f9f0 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.739+0000 7febbffff640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f54f9f0 0x556e7f9564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.739+0000 7feb9f7fe640 10 client.17283 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:05.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.739+0000 7febbffff640 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f54f9f0 0x556e7f9564d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fff96fa9a2421dd8 server_cookie=5a452a537ca9a22 in_seq=0 out_seq=0 2024-09-21T03:43:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2359778757 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e7f8ac8a0 con 0x556e7f54f9f0 2024-09-21T03:43:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7feb9f7fe640 10 client.17283 handle_command_reply: tid=0 2024-09-21T03:43:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 client.17283 shutdown 2024-09-21T03:43:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 msgr2=0x556e7f950140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7febb8014460 tx=0x7febb8009690 comp rx=0 tx=0).stop 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 shutdown_connections 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f54f9f0 0x556e7f9564d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f591070 0x556e7f950140 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f944360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7feb9f7fe640 0 client.17283 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 --2- 172.21.15.102:0/2359778757 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f5681b0 0x556e7f943e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 >> 172.21.15.102:0/2359778757 conn(0x556e7f585460 msgr2=0x556e7f93b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 shutdown_connections 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 1 -- 172.21.15.102:0/2359778757 wait complete. 2024-09-21T03:43:05.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.740+0000 7febccbd0740 20 client.17283 trim_cache size 0 max 16384 2024-09-21T03:43:05.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.753+0000 7febccbd0740 1 Processor -- start 2024-09-21T03:43:05.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.753+0000 7febccbd0740 1 -- start start 2024-09-21T03:43:05.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f570390 0x556e7f950040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f591070 0x556e7f93b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7febc01b44c0 con 0x556e7f5681b0 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febc01b1d90 con 0x556e7f591070 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febccbd0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7febc01afc00 con 0x556e7f570390 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37192/0 (socket says 172.21.15.102:37192) 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 -- 172.21.15.102:0/1509128603 learned_addr learned my addr 172.21.15.102:0/1509128603 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 -- 172.21.15.102:0/1509128603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f570390 msgr2=0x556e7f950040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbf7fe640 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f570390 0x556e7f950040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febc4bf9640 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f591070 0x556e7f93b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f570390 0x556e7f950040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 -- 172.21.15.102:0/1509128603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f591070 msgr2=0x556e7f93b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f591070 0x556e7f93b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 -- 172.21.15.102:0/1509128603 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e7f93abc0 con 0x556e7f5681b0 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7febbffff640 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92d1ae33bcf4d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7feba5ffb640 1 -- 172.21.15.102:0/1509128603 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0017d20 con 0x556e7f5681b0 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7feba5ffb640 1 -- 172.21.15.102:0/1509128603 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7febb0021030 con 0x556e7f5681b0 2024-09-21T03:43:05.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.754+0000 7feba5ffb640 1 -- 172.21.15.102:0/1509128603 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb0015520 con 0x556e7f5681b0 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- 172.21.15.102:0/1509128603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 msgr2=0x556e7f9365e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0008040 comp rx=0 tx=0).stop 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- 172.21.15.102:0/1509128603 shutdown_connections 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f591070 0x556e7f93b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f570390 0x556e7f950040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 --2- 172.21.15.102:0/1509128603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f9365e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- 172.21.15.102:0/1509128603 >> 172.21.15.102:0/1509128603 conn(0x556e7f585460 msgr2=0x556e7f935ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- 172.21.15.102:0/1509128603 shutdown_connections 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- 172.21.15.102:0/1509128603 wait complete. 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.755+0000 7febccbd0740 1 -- start start 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 Processor -- start 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f947db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 0x556e7f9beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7febc01b0250 con 0x556e7f5681b0 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7febc01b16c0 con 0x556e7f570390 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7febc01b0920 con 0x556e7f591070 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febccbd0740 10 client.0 _ll_register_callbacks cb 0x7febb8024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:05.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febbffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febbffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37206/0 (socket says 172.21.15.102:37206) 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febbffff640 1 -- 172.21.15.102:0/2178231605 learned_addr learned my addr 172.21.15.102:0/2178231605 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f947db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.756+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 0x556e7f9beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 -- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 msgr2=0x556e7f9beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 0x556e7f9beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 -- 172.21.15.102:0/2178231605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 msgr2=0x556e7f947db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f947db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 -- 172.21.15.102:0/2178231605 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e7f9bf3e0 con 0x556e7f5681b0 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febc4bf9640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 0x556e7f9beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febbffff640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7febb0015400 tx=0x7febb0015830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acd22a9f809c2c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:05.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7feb9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb002c070 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7febb0015c60 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febb0021030 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7febb0015e60 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febccbd0740 10 client.17289 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556e7f9c05c0 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.757+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7febb0021030 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7febb0025620 con 0x556e7f5681b0 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 10 client.17289 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 10 client.17289 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 20 client.17289 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f524da0 0x556e7f9c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 4 client.17289 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:05.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556e7f8a9cd0 con 0x556e7f524da0 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f524da0 0x556e7f9c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7febbf7fe640 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f524da0 0x556e7f9c2cf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a63d22abd66c7fc8 server_cookie=5f35436e46e871b3 in_seq=0 out_seq=0 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.758+0000 7feb9f7fe640 10 client.17289 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7feb9f7fe640 1 -- 172.21.15.102:0/2178231605 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556e7f8a9cd0 con 0x556e7f524da0 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7feb9f7fe640 10 client.17289 handle_command_reply: tid=0 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 client.17289 shutdown 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 msgr2=0x556e7f947870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7febb0015400 tx=0x7febb0015830 comp rx=0 tx=0).stop 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 shutdown_connections 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x556e7f524da0 0x556e7f9c2cf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x556e7f591070 0x556e7f9beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556e7f570390 0x556e7f947db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 --2- 172.21.15.102:0/2178231605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e7f5681b0 0x556e7f947870 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7feb9f7fe640 0 client.17289 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:05.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 >> 172.21.15.102:0/2178231605 conn(0x556e7f585460 msgr2=0x556e7f935dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 shutdown_connections 2024-09-21T03:43:05.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 1 -- 172.21.15.102:0/2178231605 wait complete. 2024-09-21T03:43:05.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.759+0000 7febccbd0740 20 client.17289 trim_cache size 0 max 16384 2024-09-21T03:43:05.766 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 msgr2=0x7feba80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 0x7feba80b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7febb8012d20 tx=0x7febb801f000 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 msgr2=0x7febc0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7febb4005940 tx=0x7febb40042f0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 shutdown_connections 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7feba80b6680 0x7feba80b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7febc01094a0 0x7febc0075c50 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7febc0109df0 0x7febc0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 --2- 172.21.15.102:0/2125566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7febc0103b60 0x7febc0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 >> 172.21.15.102:0/2125566 conn(0x7febc007b850 msgr2=0x7febc0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 shutdown_connections 2024-09-21T03:43:05.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:05.760+0000 7febc665c640 1 -- 172.21.15.102:0/2125566 wait complete. 2024-09-21T03:43:06.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:43:06.684 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:06.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:06 smithi102 ceph-mon[31392]: pgmap v616: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:06.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:06 smithi121 ceph-mon[34316]: pgmap v616: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:06.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:06 smithi148 ceph-mon[34651]: pgmap v616: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:43:07.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 -- 172.21.15.102:0/217578622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7624102a60 msgr2=0x7f7624102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 --2- 172.21.15.102:0/217578622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7624102a60 0x7f7624102e70 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f7614009900 tx=0x7f761402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 -- 172.21.15.102:0/217578622 shutdown_connections 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 --2- 172.21.15.102:0/217578622 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 0x7f762410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 --2- 172.21.15.102:0/217578622 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f76241083a0 0x7f76241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 --2- 172.21.15.102:0/217578622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7624102a60 0x7f7624102e70 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 -- 172.21.15.102:0/217578622 >> 172.21.15.102:0/217578622 conn(0x7f7624079730 msgr2=0x7f7624079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 -- 172.21.15.102:0/217578622 shutdown_connections 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.203+0000 7f762ba2a640 1 -- 172.21.15.102:0/217578622 wait complete. 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 Processor -- start 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 -- start start 2024-09-21T03:43:07.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624102a60 0x7f762419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 0x7f762419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7624112b00 con 0x7f76241083a0 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7624112980 con 0x7f7624108cf0 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f762ba2a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7624112c80 con 0x7f7624102a60 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37220/0 (socket says 172.21.15.102:37220) 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.204+0000 7f7628fc5640 1 -- 172.21.15.102:0/2149705728 learned_addr learned my addr 172.21.15.102:0/2149705728 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7629fc7640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 0x7f762419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f76297c6640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624102a60 0x7f762419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 -- 172.21.15.102:0/2149705728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624102a60 msgr2=0x7f762419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624102a60 0x7f762419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 -- 172.21.15.102:0/2149705728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 msgr2=0x7f762419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 0x7f762419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 -- 172.21.15.102:0/2149705728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76241a0510 con 0x7f76241083a0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f7628fc5640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f762000b450 tx=0x7f762000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f761a7fc640 1 -- 172.21.15.102:0/2149705728 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7620015020 con 0x7f76241083a0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76241a0800 con 0x7f76241083a0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f761a7fc640 1 -- 172.21.15.102:0/2149705728 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7620011d60 con 0x7f76241083a0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f761a7fc640 1 -- 172.21.15.102:0/2149705728 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762000f340 con 0x7f76241083a0 2024-09-21T03:43:07.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.205+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241a6f60 con 0x7f76241083a0 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 Processor -- start 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 -- start start 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f761a7fc640 1 -- 172.21.15.102:0/2149705728 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7620018020 con 0x7f76241083a0 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c46a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c46abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55557c3e0ea0 con 0x55557c0a2390 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55557c3d02d0 con 0x55557c09a1b0 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7631f9e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55557c3d40e0 con 0x55557c0c3070 2024-09-21T03:43:07.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37224/0 (socket says 172.21.15.102:37224) 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.208+0000 7f7628fc5640 1 -- 172.21.15.102:0/4286447128 learned_addr learned my addr 172.21.15.102:0/4286447128 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7629fc7640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c46a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f76297c6640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c46abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 -- 172.21.15.102:0/4286447128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 msgr2=0x55557c46a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c46a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 -- 172.21.15.102:0/4286447128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 msgr2=0x55557c46abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c46abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 -- 172.21.15.102:0/4286447128 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557c12e650 con 0x55557c0a2390 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f76297c6640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c46abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7628fc5640 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f76200e47a0 tx=0x7f76200ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbf272ade4eb26c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f761a7fc640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 0x7f76100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f7629fc7640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 0x7f76100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f760f7fe640 1 -- 172.21.15.102:0/4286447128 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76200fa070 con 0x55557c0a2390 2024-09-21T03:43:07.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f760f7fe640 1 -- 172.21.15.102:0/4286447128 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f76200aca40 con 0x55557c0a2390 2024-09-21T03:43:07.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f760f7fe640 1 -- 172.21.15.102:0/4286447128 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76200acd00 con 0x55557c0a2390 2024-09-21T03:43:07.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.209+0000 7f761a7fc640 1 -- 172.21.15.102:0/2149705728 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f76200e7120 con 0x7f76241083a0 2024-09-21T03:43:07.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 -- 172.21.15.102:0/4286447128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 msgr2=0x55557c46b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7629fc7640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 0x7f76100b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f76200e47a0 tx=0x7f76200ef910 comp rx=0 tx=0).stop 2024-09-21T03:43:07.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 -- 172.21.15.102:0/4286447128 shutdown_connections 2024-09-21T03:43:07.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c46b120 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c46abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 --2- 172.21.15.102:0/4286447128 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c46a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 -- 172.21.15.102:0/4286447128 >> 172.21.15.102:0/4286447128 conn(0x55557c0b7460 msgr2=0x55557c468590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 -- 172.21.15.102:0/4286447128 shutdown_connections 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.210+0000 7f7631f9e740 1 -- 172.21.15.102:0/4286447128 wait complete. 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 -- start start 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 Processor -- start 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c47aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 0x55557c47b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55557c231700 con 0x55557c0c3070 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55557c36b160 con 0x55557c09a1b0 2024-09-21T03:43:07.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55557c478e80 con 0x55557c0a2390 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7631f9e740 10 client.0 _ll_register_callbacks cb 0x55557c3849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.211+0000 7f7629fc7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37238/0 (socket says 172.21.15.102:37238) 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 -- 172.21.15.102:0/3582779283 learned_addr learned my addr 172.21.15.102:0/3582779283 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7628fc5640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 0x55557c47b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f76297c6640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c47aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 -- 172.21.15.102:0/3582779283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 msgr2=0x55557c47b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 0x55557c47b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 -- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 msgr2=0x55557c47aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c47aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 -- 172.21.15.102:0/3582779283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557c398c90 con 0x55557c0c3070 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7628fc5640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 0x55557c47b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7629fc7640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f761c01d6e0 tx=0x7f761c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed426cb993019d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f760cff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c010870 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76200aca40 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f761c010a10 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f761c010c10 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7631f9e740 10 client.17301 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.212+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55557c488ff0 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f76200aca40 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f761c00f040 con 0x55557c0c3070 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 10 client.17301 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 10 client.17301 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 20 client.17301 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c0819f0 0x55557c48c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 4 client.17301 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55557c3e2df0 con 0x55557c0819f0 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.213+0000 7f76297c6640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c0819f0 0x55557c48c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.214+0000 7f760cff9640 10 client.17301 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.214+0000 7f76297c6640 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c0819f0 0x55557c48c5c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4130b45b445ffcc5 server_cookie=bb9dfd10142d65e9 in_seq=0 out_seq=0 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.214+0000 7f760cff9640 1 -- 172.21.15.102:0/3582779283 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55557c3e2df0 con 0x55557c0819f0 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.214+0000 7f760cff9640 10 client.17301 handle_command_reply: tid=0 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.214+0000 7f7631f9e740 1 client.17301 shutdown 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 msgr2=0x55557c480040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f761c01d6e0 tx=0x7f761c004a40 comp rx=0 tx=0).stop 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 shutdown_connections 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c0819f0 0x55557c48c5c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c480040 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0a2390 0x55557c47b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f760cff9640 0 client.17301 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:07.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 --2- 172.21.15.102:0/3582779283 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c47aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 >> 172.21.15.102:0/3582779283 conn(0x55557c0b7460 msgr2=0x55557c46d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 shutdown_connections 2024-09-21T03:43:07.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 1 -- 172.21.15.102:0/3582779283 wait complete. 2024-09-21T03:43:07.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.215+0000 7f7631f9e740 20 client.17301 trim_cache size 0 max 16384 2024-09-21T03:43:07.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 Processor -- start 2024-09-21T03:43:07.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 -- start start 2024-09-21T03:43:07.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 0x55557c47fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c0a2390 0x55557c486e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76241b0050 con 0x55557c0c3070 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76241ad920 con 0x55557c0a2390 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7631f9e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76241ab790 con 0x55557c09a1b0 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37250/0 (socket says 172.21.15.102:37250) 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 -- 172.21.15.102:0/420193575 learned_addr learned my addr 172.21.15.102:0/420193575 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7628fc5640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c0a2390 0x55557c486e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f76297c6640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 0x55557c47fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 -- 172.21.15.102:0/420193575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 msgr2=0x55557c47fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 0x55557c47fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 -- 172.21.15.102:0/420193575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c0a2390 msgr2=0x55557c486e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c0a2390 0x55557c486e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.228+0000 7f7629fc7640 1 -- 172.21.15.102:0/420193575 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55557c46cc60 con 0x55557c0c3070 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.229+0000 7f76297c6640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 0x55557c47fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.229+0000 7f7629fc7640 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f761c000f80 tx=0x7f761c02f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fefca5a2fde9923 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.229+0000 7f760effd640 1 -- 172.21.15.102:0/420193575 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c004cb0 con 0x55557c0c3070 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.229+0000 7f760effd640 1 -- 172.21.15.102:0/420193575 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f761c004e50 con 0x55557c0c3070 2024-09-21T03:43:07.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.229+0000 7f760effd640 1 -- 172.21.15.102:0/420193575 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c02f840 con 0x55557c0c3070 2024-09-21T03:43:07.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- 172.21.15.102:0/420193575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 msgr2=0x55557c4772e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f761c000f80 tx=0x7f761c02f450 comp rx=0 tx=0).stop 2024-09-21T03:43:07.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- 172.21.15.102:0/420193575 shutdown_connections 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0c3070 0x55557c4772e0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c0a2390 0x55557c486e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 --2- 172.21.15.102:0/420193575 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c09a1b0 0x55557c47fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- 172.21.15.102:0/420193575 >> 172.21.15.102:0/420193575 conn(0x55557c0b7460 msgr2=0x55557c475230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- 172.21.15.102:0/420193575 shutdown_connections 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- 172.21.15.102:0/420193575 wait complete. 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 -- start start 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.230+0000 7f7631f9e740 1 Processor -- start 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c486ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c482b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76241abde0 con 0x55557c0a2390 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76241ad250 con 0x55557c09a1b0 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f76241ac4b0 con 0x55557c0c3070 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 10 client.0 _ll_register_callbacks cb 0x7f761c009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37252/0 (socket says 172.21.15.102:37252) 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 -- 172.21.15.102:0/1725332948 learned_addr learned my addr 172.21.15.102:0/1725332948 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f76297c6640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c486ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7629fc7640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c482b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 -- 172.21.15.102:0/1725332948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 msgr2=0x55557c482b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c482b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 -- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 msgr2=0x55557c486ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c486ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 -- 172.21.15.102:0/1725332948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55557c46e7b0 con 0x55557c0a2390 2024-09-21T03:43:07.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7629fc7640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c482b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7628fc5640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f76200acec0 tx=0x7f7620010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3544b88d104e39b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f760cff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762004ea00 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8586+0+0 (secure 0 0 0) 0x7f76200e4ab0 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.231+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f761c004e50 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f762004d940 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 10 client.17307 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55557c4f6eb0 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f761c004e50 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f76200a91a0 con 0x55557c0a2390 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 10 client.17307 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:07.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 10 client.17307 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 20 client.17307 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c056da0 0x55557c4f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 4 client.17307 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55557c3de8a0 con 0x55557c056da0 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.232+0000 7f76297c6640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c056da0 0x55557c4f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f760cff9640 10 client.17307 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f76297c6640 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c056da0 0x55557c4f9140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c183fd107aac3e2 server_cookie=966083665b25d4ec in_seq=0 out_seq=0 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f760cff9640 1 -- 172.21.15.102:0/1725332948 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55557c3de8a0 con 0x55557c056da0 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f760cff9640 10 client.17307 handle_command_reply: tid=0 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 client.17307 shutdown 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 msgr2=0x55557c482440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f76200acec0 tx=0x7f7620010960 comp rx=0 tx=0).stop 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 shutdown_connections 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55557c056da0 0x55557c4f9140 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55557c0a2390 0x55557c482440 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55557c0c3070 0x55557c482b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 --2- 172.21.15.102:0/1725332948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55557c09a1b0 0x55557c486ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 >> 172.21.15.102:0/1725332948 conn(0x55557c0b7460 msgr2=0x55557c46d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f760cff9640 0 client.17307 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 shutdown_connections 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 1 -- 172.21.15.102:0/1725332948 wait complete. 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.233+0000 7f7631f9e740 20 client.17307 trim_cache size 0 max 16384 2024-09-21T03:43:07.241 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 msgr2=0x7f76100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 0x7f76100b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f761c005fd0 tx=0x7f761c009600 comp rx=0 tx=0).stop 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 msgr2=0x7f762419ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f762000b450 tx=0x7f762000b910 comp rx=0 tx=0).stop 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 shutdown_connections 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f76100b6680 0x7f76100b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f76241083a0 0x7f762419ab40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7624108cf0 0x7f762419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 --2- 172.21.15.102:0/2149705728 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7624102a60 0x7f762419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 >> 172.21.15.102:0/2149705728 conn(0x7f7624079730 msgr2=0x7f7624101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 shutdown_connections 2024-09-21T03:43:07.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:07.234+0000 7f762ba2a640 1 -- 172.21.15.102:0/2149705728 wait complete. 2024-09-21T03:43:07.927 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:43:08.177 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:08.566 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:08 smithi102 ceph-mon[31392]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:43:08.566 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:08 smithi102 ceph-mon[31392]: pgmap v618: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3446191377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b0105250 msgr2=0x7fa7b010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3446191377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b0105250 0x7fa7b010d970 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa798009900 tx=0x7fa79802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3446191377 shutdown_connections 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3446191377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b0105250 0x7fa7b010d970 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3446191377 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b010deb0 0x7fa7b0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3446191377 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0104900 0x7fa7b0104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3446191377 >> 172.21.15.102:0/3446191377 conn(0x7fa7b0079760 msgr2=0x7fa7b0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3446191377 shutdown_connections 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3446191377 wait complete. 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 Processor -- start 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.658+0000 7fa7b5a0f640 1 -- start start 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b0104900 0x7fa7b019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 0x7fa7b019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0113ce0 con 0x7fa7b010deb0 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0113b60 con 0x7fa7b0105250 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7b5a0f640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b0113e60 con 0x7fa7b0104900 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37268/0 (socket says 172.21.15.102:37268) 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 -- 172.21.15.102:0/3643348511 learned_addr learned my addr 172.21.15.102:0/3643348511 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b0104900 0x7fa7b019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 0x7fa7b019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 -- 172.21.15.102:0/3643348511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b0104900 msgr2=0x7fa7b019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b0104900 0x7fa7b019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 -- 172.21.15.102:0/3643348511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 msgr2=0x7fa7b019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 0x7fa7b019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 -- 172.21.15.102:0/3643348511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b01a0740 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 0x7fa7b019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.659+0000 7fa7af7fe640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800b3f0 tx=0x7fa7a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.660+0000 7fa7b4a0d640 1 -- 172.21.15.102:0/3643348511 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8015020 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.660+0000 7fa7b4a0d640 1 -- 172.21.15.102:0/3643348511 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa7a8011d00 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.660+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b01a0a30 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.660+0000 7fa7b4a0d640 1 -- 172.21.15.102:0/3643348511 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a800f2e0 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.660+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b01a7190 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.662+0000 7fa7bbf83740 1 Processor -- start 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.662+0000 7fa7b4a0d640 1 -- 172.21.15.102:0/3643348511 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa7a8018020 con 0x7fa7b010deb0 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 -- start start 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1a2070 0x55ecdf5496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf54a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf4bfea0 con 0x55ecdf1791b0 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf4af2d0 con 0x55ecdf181390 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf4b30e0 con 0x55ecdf1a2070 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37274/0 (socket says 172.21.15.102:37274) 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1712454136 learned_addr learned my addr 172.21.15.102:0/1712454136 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1a2070 0x55ecdf5496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf54a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7b4a0d640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 0x7fa79c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1712454136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1a2070 msgr2=0x55ecdf5496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1a2070 0x55ecdf5496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1712454136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 msgr2=0x55ecdf54a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf54a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1712454136 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecdf20d650 con 0x55ecdf1791b0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf54a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.663+0000 7fa7af7fe640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 0x7fa79c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.664+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f50 tx=0x7fa7a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a972634003dd2b80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.664+0000 7fa7b4a0d640 1 -- 172.21.15.102:0/3643348511 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fa7a80e6f90 con 0x7fa7b010deb0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.664+0000 7fa7a5ffb640 1 -- 172.21.15.102:0/1712454136 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a001a070 con 0x55ecdf1791b0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.664+0000 7fa7a5ffb640 1 -- 172.21.15.102:0/1712454136 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa7a00158e0 con 0x55ecdf1791b0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.664+0000 7fa7a5ffb640 1 -- 172.21.15.102:0/1712454136 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000a8c0 con 0x55ecdf1791b0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1712454136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 msgr2=0x55ecdf549be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7af7fe640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 0x7fa79c0b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80acd00 tx=0x7fa7a8079a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009f50 tx=0x7fa7a000c8b0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1712454136 shutdown_connections 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf549be0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf54a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1712454136 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1a2070 0x55ecdf5496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1712454136 >> 172.21.15.102:0/1712454136 conn(0x55ecdf196460 msgr2=0x55ecdf547590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1712454136 shutdown_connections 2024-09-21T03:43:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1712454136 wait complete. 2024-09-21T03:43:08.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.665+0000 7fa7bbf83740 1 -- start start 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 Processor -- start 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1791b0 0x55ecdf5590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf181390 0x55ecdf559620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf310700 con 0x55ecdf1a2070 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf44a160 con 0x55ecdf1791b0 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ecdf55c1e0 con 0x55ecdf181390 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7bbf83740 10 client.0 _ll_register_callbacks cb 0x55ecdf4639e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:08.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37280/0 (socket says 172.21.15.102:37280) 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/3528026403 learned_addr learned my addr 172.21.15.102:0/3528026403 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1791b0 0x55ecdf5590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf181390 0x55ecdf559620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf181390 msgr2=0x55ecdf559620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.666+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf181390 0x55ecdf559620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/3528026403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1791b0 msgr2=0x55ecdf5590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1791b0 0x55ecdf5590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/3528026403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdf477c90 con 0x55ecdf1a2070 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa798005ab0 tx=0x7fa798009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543eb7f87246b458 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa78effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798035040 con 0x55ecdf1a2070 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fa798004450 con 0x55ecdf1a2070 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7a00158e0 con 0x55ecdf1a2070 2024-09-21T03:43:08.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa798032e50 con 0x55ecdf1a2070 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7bbf83740 10 client.17319 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ecdf567ed0 con 0x55ecdf1a2070 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.667+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa7a00158e0 con 0x55ecdf1a2070 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa79803a030 con 0x55ecdf1a2070 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 10 client.17319 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 10 client.17319 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 20 client.17319 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1609f0 0x55ecdf56b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 4 client.17319 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ecdf4c1df0 con 0x55ecdf1609f0 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1609f0 0x55ecdf56b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1609f0 0x55ecdf56b430 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e663fa5bc47823 server_cookie=1ac19449cad7187d in_seq=0 out_seq=0 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.668+0000 7fa78effd640 10 client.17319 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:08.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa78effd640 1 -- 172.21.15.102:0/3528026403 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ecdf4c1df0 con 0x55ecdf1609f0 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa78effd640 10 client.17319 handle_command_reply: tid=0 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa7bbf83740 1 client.17319 shutdown 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 msgr2=0x55ecdf559b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa798005ab0 tx=0x7fa798009260 comp rx=0 tx=0).stop 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 shutdown_connections 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.669+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1609f0 0x55ecdf56b430 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa78effd640 0 client.17319 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1a2070 0x55ecdf559b60 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf181390 0x55ecdf559620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/3528026403 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1791b0 0x55ecdf5590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 >> 172.21.15.102:0/3528026403 conn(0x55ecdf196460 msgr2=0x55ecdf545bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 shutdown_connections 2024-09-21T03:43:08.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 1 -- 172.21.15.102:0/3528026403 wait complete. 2024-09-21T03:43:08.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.670+0000 7fa7bbf83740 20 client.17319 trim_cache size 0 max 16384 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 Processor -- start 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 -- start start 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1609f0 0x55ecdf54ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1791b0 0x55ecdf570c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01b0350 con 0x55ecdf181390 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01adc20 con 0x55ecdf1609f0 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01aba90 con 0x55ecdf1791b0 2024-09-21T03:43:08.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37284/0 (socket says 172.21.15.102:37284) 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/4142448408 learned_addr learned my addr 172.21.15.102:0/4142448408 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1609f0 0x55ecdf54ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1791b0 0x55ecdf570c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/4142448408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1791b0 msgr2=0x55ecdf570c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1791b0 0x55ecdf570c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/4142448408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1609f0 msgr2=0x55ecdf54ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1609f0 0x55ecdf54ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.683+0000 7fa7ae7fc640 1 -- 172.21.15.102:0/4142448408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ecdf54a490 con 0x55ecdf181390 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.684+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa798004fd0 tx=0x7fa79802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4cfda5900d46591 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.684+0000 7fa7a57fa640 1 -- 172.21.15.102:0/4142448408 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798004450 con 0x55ecdf181390 2024-09-21T03:43:08.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.684+0000 7fa7a57fa640 1 -- 172.21.15.102:0/4142448408 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa798031c70 con 0x55ecdf181390 2024-09-21T03:43:08.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.684+0000 7fa7a57fa640 1 -- 172.21.15.102:0/4142448408 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa798032540 con 0x55ecdf181390 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.684+0000 7fa7bbf83740 1 -- 172.21.15.102:0/4142448408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 msgr2=0x55ecdf571170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa798004fd0 tx=0x7fa79802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 -- 172.21.15.102:0/4142448408 shutdown_connections 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf181390 0x55ecdf571170 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1791b0 0x55ecdf570c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/4142448408 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf1609f0 0x55ecdf54ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 -- 172.21.15.102:0/4142448408 >> 172.21.15.102:0/4142448408 conn(0x55ecdf196460 msgr2=0x55ecdf54e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 -- 172.21.15.102:0/4142448408 shutdown_connections 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 -- 172.21.15.102:0/4142448408 wait complete. 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 -- start start 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 Processor -- start 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 0x55ecdf55d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.685+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf5d4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01ac0e0 con 0x55ecdf1791b0 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01ad550 con 0x55ecdf181390 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b01ac7b0 con 0x55ecdf1609f0 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 10 client.0 _ll_register_callbacks cb 0x7fa798032da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37286/0 (socket says 172.21.15.102:37286) 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1436801060 learned_addr learned my addr 172.21.15.102:0/1436801060 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 0x55ecdf55d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf5d4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 msgr2=0x55ecdf55d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 0x55ecdf55d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1436801060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 msgr2=0x55ecdf5d4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf5d4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 -- 172.21.15.102:0/1436801060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ecdf565b90 con 0x55ecdf1791b0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 0x55ecdf55d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7aeffd640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009d90 tx=0x7fa7a0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2544fc9b136f773 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa78effd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a001a040 con 0x55ecdf1791b0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fa7a0012040 con 0x55ecdf1791b0 2024-09-21T03:43:08.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.686+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa798031c70 con 0x55ecdf1791b0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa7a0035050 con 0x55ecdf1791b0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 10 client.17325 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ecdf5d61d0 con 0x55ecdf1791b0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa798031c70 con 0x55ecdf1791b0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa7a000a820 con 0x55ecdf1791b0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 10 client.17325 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 10 client.17325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 20 client.17325 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1a2070 0x55ecdf5d85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 4 client.17325 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ecdf4bd8a0 con 0x55ecdf1a2070 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.687+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1a2070 0x55ecdf5d85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa78effd640 10 client.17325 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:08.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7ae7fc640 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1a2070 0x55ecdf5d85c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51595205b8cbe021 server_cookie=c331d53bec886e68 in_seq=0 out_seq=0 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa78effd640 1 -- 172.21.15.102:0/1436801060 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ecdf4bd8a0 con 0x55ecdf1a2070 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa78effd640 10 client.17325 handle_command_reply: tid=0 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 client.17325 shutdown 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 msgr2=0x55ecdf55dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009d90 tx=0x7fa7a0000f40 comp rx=0 tx=0).stop 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 shutdown_connections 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55ecdf1a2070 0x55ecdf5d85c0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa78effd640 0 client.17325 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ecdf1791b0 0x55ecdf55dd20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ecdf181390 0x55ecdf5d4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 --2- 172.21.15.102:0/1436801060 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ecdf1609f0 0x55ecdf55d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 >> 172.21.15.102:0/1436801060 conn(0x55ecdf196460 msgr2=0x55ecdf564460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 shutdown_connections 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.688+0000 7fa7bbf83740 1 -- 172.21.15.102:0/1436801060 wait complete. 2024-09-21T03:43:08.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7bbf83740 20 client.17325 trim_cache size 0 max 16384 2024-09-21T03:43:08.696 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:08.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 msgr2=0x7fa79c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 0x7fa79c0b8b90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa7a80acd00 tx=0x7fa7a8079a20 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 msgr2=0x7fa7b01a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800b3f0 tx=0x7fa7a800b8b0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 shutdown_connections 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa79c0b6680 0x7fa79c0b8b90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7b010deb0 0x7fa7b01a0010 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7b0105250 0x7fa7b019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 --2- 172.21.15.102:0/3643348511 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7b0104900 0x7fa7b019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 >> 172.21.15.102:0/3643348511 conn(0x7fa7b0079760 msgr2=0x7fa7b0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 shutdown_connections 2024-09-21T03:43:08.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:08.689+0000 7fa7b5a0f640 1 -- 172.21.15.102:0/3643348511 wait complete. 2024-09-21T03:43:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:08 smithi121 ceph-mon[34316]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:43:08.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:08 smithi121 ceph-mon[34316]: pgmap v618: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:08 smithi148 ceph-mon[34651]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T03:43:08.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:08 smithi148 ceph-mon[34651]: pgmap v618: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:10.386 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:10.387 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:10.648 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:10.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:10 smithi102 ceph-mon[31392]: pgmap v619: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:10.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:10 smithi121 ceph-mon[34316]: pgmap v619: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:10 smithi148 ceph-mon[34651]: pgmap v619: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-09-21T03:43:11.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 -- 172.21.15.102:0/874323883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c103b60 msgr2=0x7f3b1c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 --2- 172.21.15.102:0/874323883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c103b60 0x7f3b1c103f70 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009ca0 tx=0x7f3b1402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 -- 172.21.15.102:0/874323883 shutdown_connections 2024-09-21T03:43:11.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 --2- 172.21.15.102:0/874323883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c109df0 0x7f3b1c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 --2- 172.21.15.102:0/874323883 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c1094a0 0x7f3b1c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 --2- 172.21.15.102:0/874323883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c103b60 0x7f3b1c103f70 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 -- 172.21.15.102:0/874323883 >> 172.21.15.102:0/874323883 conn(0x7f3b1c07b850 msgr2=0x7f3b1c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 -- 172.21.15.102:0/874323883 shutdown_connections 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.150+0000 7f3b2476e640 1 -- 172.21.15.102:0/874323883 wait complete. 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 Processor -- start 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 -- start start 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c103b60 0x7f3b1c19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c1094a0 0x7f3b1c19abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c113bd0 con 0x7f3b1c109df0 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c113a50 con 0x7f3b1c1094a0 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2476e640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c113d50 con 0x7f3b1c103b60 2024-09-21T03:43:11.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b22d0b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c103b60 0x7f3b1c19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b22d0b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37298/0 (socket says 172.21.15.102:37298) 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b22d0b640 1 -- 172.21.15.102:0/1730478609 learned_addr learned my addr 172.21.15.102:0/1730478609 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.151+0000 7f3b21d09640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c1094a0 0x7f3b1c19abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 -- 172.21.15.102:0/1730478609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c103b60 msgr2=0x7f3b1c19a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c103b60 0x7f3b1c19a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 -- 172.21.15.102:0/1730478609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c1094a0 msgr2=0x7f3b1c19abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c1094a0 0x7f3b1c19abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 -- 172.21.15.102:0/1730478609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c1a04d0 con 0x7f3b1c109df0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b22d0b640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c970 tx=0x7f3b0c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b1b7fe640 1 -- 172.21.15.102:0/1730478609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00ae60 con 0x7f3b1c109df0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b1b7fe640 1 -- 172.21.15.102:0/1730478609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b0c0054f0 con 0x7f3b1c109df0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1a07c0 con 0x7f3b1c109df0 2024-09-21T03:43:11.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b1b7fe640 1 -- 172.21.15.102:0/1730478609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004e00 con 0x7f3b1c109df0 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.152+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c1a0cb0 con 0x7f3b1c109df0 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.154+0000 7f3b2ace2740 1 Processor -- start 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b1b7fe640 1 -- 172.21.15.102:0/1730478609 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f3b0c005020 con 0x7f3b1c109df0 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 -- start start 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7954a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c79182670 0x562c7954aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c794c0e60 con 0x562c7917a490 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562c794b0290 con 0x562c791a3350 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562c794b40a0 con 0x562c79182670 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37308/0 (socket says 172.21.15.102:37308) 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b2250a640 1 -- 172.21.15.102:0/4128861325 learned_addr learned my addr 172.21.15.102:0/4128861325 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:11.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b21d09640 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7954a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.155+0000 7f3b21d09640 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c79182670 0x562c7954aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 -- 172.21.15.102:0/4128861325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c79182670 msgr2=0x562c7954aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c79182670 0x562c7954aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b1b7fe640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 0x7f3b040b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 -- 172.21.15.102:0/4128861325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 msgr2=0x562c7954a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7954a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 -- 172.21.15.102:0/4128861325 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7920e930 con 0x562c7917a490 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b22d0b640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 0x7f3b040b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b2250a640 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3b14035000 tx=0x7f3b14031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b266deb835ba613 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b1b7fe640 1 -- 172.21.15.102:0/1730478609 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f3b0c0e72c0 con 0x7f3b1c109df0 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b18ff9640 1 -- 172.21.15.102:0/4128861325 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14003970 con 0x562c7917a490 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b18ff9640 1 -- 172.21.15.102:0/4128861325 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b14036030 con 0x562c7917a490 2024-09-21T03:43:11.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.156+0000 7f3b18ff9640 1 -- 172.21.15.102:0/4128861325 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14004480 con 0x562c7917a490 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 -- 172.21.15.102:0/4128861325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 msgr2=0x562c7954a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b22d0b640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 0x7f3b040b8bc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0e4a50 tx=0x7f3b0c079d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f3b14035000 tx=0x7f3b14031b40 comp rx=0 tx=0).stop 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 -- 172.21.15.102:0/4128861325 shutdown_connections 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7954a970 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c79182670 0x562c7954aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/4128861325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7954a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 -- 172.21.15.102:0/4128861325 >> 172.21.15.102:0/4128861325 conn(0x562c79197740 msgr2=0x562c79548320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 -- 172.21.15.102:0/4128861325 shutdown_connections 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.157+0000 7f3b2ace2740 1 -- 172.21.15.102:0/4128861325 wait complete. 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 -- start start 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 Processor -- start 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c79182670 0x562c7955a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c795660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c79311890 con 0x562c7917a490 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562c7944ad40 con 0x562c79182670 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562c7955cd90 con 0x562c791a3350 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2ace2740 10 client.0 _ll_register_callbacks cb 0x562c794aec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37320/0 (socket says 172.21.15.102:37320) 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 -- 172.21.15.102:0/3191159735 learned_addr learned my addr 172.21.15.102:0/3191159735 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c79182670 0x562c7955a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c795660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 -- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 msgr2=0x562c795660f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c795660f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 -- 172.21.15.102:0/3191159735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c79182670 msgr2=0x562c7955a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c79182670 0x562c7955a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.158+0000 7f3b21d09640 1 -- 172.21.15.102:0/3191159735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c79566630 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3b10011fc0 tx=0x7f3b10013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6854520550bfa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000fe80 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f3b10005020 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b14036030 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3b10005220 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 10 client.17337 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562c79568ef0 con 0x562c7917a490 2024-09-21T03:43:11.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b14036030 con 0x562c7917a490 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3b1000e5c0 con 0x562c7917a490 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 10 client.17337 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 10 client.17337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 20 client.17337 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.159+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79161cd0 0x562c7956c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.160+0000 7f3b2ace2740 4 client.17337 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.160+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c794c2db0 con 0x562c79161cd0 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.160+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79161cd0 0x562c7956c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.160+0000 7f3b01ffb640 10 client.17337 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:11.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.160+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79161cd0 0x562c7956c450 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=191ab49fec2671a7 server_cookie=e51e126b9e2212ba in_seq=0 out_seq=0 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b01ffb640 1 -- 172.21.15.102:0/3191159735 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c794c2db0 con 0x562c79161cd0 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b01ffb640 10 client.17337 handle_command_reply: tid=0 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 client.17337 shutdown 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 msgr2=0x562c7955a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3b10011fc0 tx=0x7f3b10013040 comp rx=0 tx=0).stop 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 shutdown_connections 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c795660f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c79182670 0x562c7955a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79161cd0 0x562c7956c450 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3191159735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c7917a490 0x562c7955a340 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 >> 172.21.15.102:0/3191159735 conn(0x562c79197740 msgr2=0x562c79546850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.161+0000 7f3b01ffb640 0 client.17337 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.162+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 shutdown_connections 2024-09-21T03:43:11.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.162+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3191159735 wait complete. 2024-09-21T03:43:11.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.162+0000 7f3b2ace2740 20 client.17337 trim_cache size 0 max 16384 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 Processor -- start 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 -- start start 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c7917a490 0x562c79555920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c79557330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1b0040 con 0x562c79182670 2024-09-21T03:43:11.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ad910 con 0x562c7917a490 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ab780 con 0x562c791a3350 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37336/0 (socket says 172.21.15.102:37336) 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b2250a640 1 -- 172.21.15.102:0/3545080397 learned_addr learned my addr 172.21.15.102:0/3545080397 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.179+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c79557330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b21d09640 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c7917a490 0x562c79555920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 -- 172.21.15.102:0/3545080397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 msgr2=0x562c79557330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c79557330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 -- 172.21.15.102:0/3545080397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c7917a490 msgr2=0x562c79555920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c7917a490 0x562c79555920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 -- 172.21.15.102:0/3545080397 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7954cd40 con 0x562c79182670 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b2250a640 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3b14004150 tx=0x7f3b14004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a3d53c0f7d10ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b03fff640 1 -- 172.21.15.102:0/3545080397 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1405d070 con 0x562c79182670 2024-09-21T03:43:11.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b03fff640 1 -- 172.21.15.102:0/3545080397 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b14036070 con 0x562c79182670 2024-09-21T03:43:11.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.180+0000 7f3b03fff640 1 -- 172.21.15.102:0/3545080397 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1404a040 con 0x562c79182670 2024-09-21T03:43:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3545080397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 msgr2=0x562c79546f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3b14004150 tx=0x7f3b14004180 comp rx=0 tx=0).stop 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3545080397 shutdown_connections 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c79546f60 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c791a3350 0x562c79557330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/3545080397 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c7917a490 0x562c79555920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3545080397 >> 172.21.15.102:0/3545080397 conn(0x562c79197740 msgr2=0x562c79546850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3545080397 shutdown_connections 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- 172.21.15.102:0/3545080397 wait complete. 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- start start 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 Processor -- start 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 0x562c79562260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7955d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1abdd0 con 0x562c79182670 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ad240 con 0x562c791a3350 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.181+0000 7f3b2ace2740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c1ac4a0 con 0x562c7917a490 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2ace2740 10 client.0 _ll_register_callbacks cb 0x7f3b1000acb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37340/0 (socket says 172.21.15.102:37340) 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 -- 172.21.15.102:0/258813154 learned_addr learned my addr 172.21.15.102:0/258813154 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b21d09640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7955d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b21d09640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 0x562c79562260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 -- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 msgr2=0x562c79562260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 0x562c79562260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 -- 172.21.15.102:0/258813154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 msgr2=0x562c7955d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7955d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 -- 172.21.15.102:0/258813154 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c7955d550 con 0x562c79182670 2024-09-21T03:43:11.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b21d09640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 0x562c79562260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2250a640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009bf0 tx=0x7f3b14009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6894e26e6b1444a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b01ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1405d070 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f3b140318a0 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b14036070 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3b14066050 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2ace2740 10 client.17343 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.182+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562c795d7630 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3b14036070 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f3b14060020 con 0x562c79182670 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 10 client.17343 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 10 client.17343 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 20 client.17343 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79137080 0x562c795d99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:11.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 4 client.17343 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:11.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562c794be860 con 0x562c79137080 2024-09-21T03:43:11.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.183+0000 7f3b21d09640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79137080 0x562c795d99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:11.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.184+0000 7f3b01ffb640 10 client.17343 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:11.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.184+0000 7f3b21d09640 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79137080 0x562c795d99a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef22c9066cf036cf server_cookie=a6c7e1fcfe6e8266 in_seq=0 out_seq=0 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b01ffb640 1 -- 172.21.15.102:0/258813154 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562c794be860 con 0x562c79137080 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b01ffb640 10 client.17343 handle_command_reply: tid=0 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 client.17343 shutdown 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 msgr2=0x562c795627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009bf0 tx=0x7f3b14009580 comp rx=0 tx=0).stop 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 shutdown_connections 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562c79137080 0x562c795d99a0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c79182670 0x562c795627a0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562c791a3350 0x562c7955d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b01ffb640 0 client.17343 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 --2- 172.21.15.102:0/258813154 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562c7917a490 0x562c79562260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 >> 172.21.15.102:0/258813154 conn(0x562c79197740 msgr2=0x562c7954f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.185+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 shutdown_connections 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2ace2740 1 -- 172.21.15.102:0/258813154 wait complete. 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2ace2740 20 client.17343 trim_cache size 0 max 16384 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "0f18c705-4ad6-43b0-8f29-ca2a0d455a7f", 2024-09-21T03:43:11.192 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 msgr2=0x7f3b040b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 0x7f3b040b8bc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0e4a50 tx=0x7f3b0c079d50 comp rx=0 tx=0).stop 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 msgr2=0x7f3b1c19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00c970 tx=0x7f3b0c00cd70 comp rx=0 tx=0).stop 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 shutdown_connections 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3b040b66b0 0x7f3b040b8bc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3b1c109df0 0x7f3b1c19fe60 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3b1c1094a0 0x7f3b1c19abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 --2- 172.21.15.102:0/1730478609 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3b1c103b60 0x7f3b1c19a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 >> 172.21.15.102:0/1730478609 conn(0x7f3b1c07b850 msgr2=0x7f3b1c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 shutdown_connections 2024-09-21T03:43:11.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:11.186+0000 7f3b2476e640 1 -- 172.21.15.102:0/1730478609 wait complete. 2024-09-21T03:43:11.893 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:11 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:43:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:11 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:11 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:43:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:11 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:11.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:11 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:43:12.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:11 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:43:12.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:11 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:12.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:11 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:43:12.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:11 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:12.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:11 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:43:12.137 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:12.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:11 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:43:12.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:11 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:12.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:11 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:43:12.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:11 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:12.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:11 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:43:12.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 -- 172.21.15.102:0/825304268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc105ba0 msgr2=0x7f22dc10f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 --2- 172.21.15.102:0/825304268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc105ba0 0x7f22dc10f610 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009ca0 tx=0x7f22d402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 -- 172.21.15.102:0/825304268 shutdown_connections 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 --2- 172.21.15.102:0/825304268 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc105ba0 0x7f22dc10f610 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 --2- 172.21.15.102:0/825304268 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105250 0x7f22dc105660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 --2- 172.21.15.102:0/825304268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc1031d0 0x7f22dc1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 -- 172.21.15.102:0/825304268 >> 172.21.15.102:0/825304268 conn(0x7f22dc079ec0 msgr2=0x7f22dc07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 -- 172.21.15.102:0/825304268 shutdown_connections 2024-09-21T03:43:12.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 -- 172.21.15.102:0/825304268 wait complete. 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.591+0000 7f22e34bb640 1 Processor -- start 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 -- start start 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc105250 0x7f22dc19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105ba0 0x7f22dc19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112bb0 con 0x7f22dc1031d0 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112a30 con 0x7f22dc105250 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e34bb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc112d30 con 0x7f22dc105ba0 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37358/0 (socket says 172.21.15.102:37358) 2024-09-21T03:43:12.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 -- 172.21.15.102:0/3811832502 learned_addr learned my addr 172.21.15.102:0/3811832502 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1a58640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105ba0 0x7f22dc19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e0a56640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc105250 0x7f22dc19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 -- 172.21.15.102:0/3811832502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105ba0 msgr2=0x7f22dc19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105ba0 0x7f22dc19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 -- 172.21.15.102:0/3811832502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc105250 msgr2=0x7f22dc19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc105250 0x7f22dc19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 -- 172.21.15.102:0/3811832502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc1a66d0 con 0x7f22dc1031d0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.592+0000 7f22e1257640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d770 tx=0x7f22d800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.593+0000 7f22d27fc640 1 -- 172.21.15.102:0/3811832502 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8017070 con 0x7f22dc1031d0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.593+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc1a69c0 con 0x7f22dc1031d0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.593+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc1a6f50 con 0x7f22dc1031d0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.593+0000 7f22d27fc640 1 -- 172.21.15.102:0/3811832502 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22d8009c30 con 0x7f22dc1031d0 2024-09-21T03:43:12.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.593+0000 7f22d27fc640 1 -- 172.21.15.102:0/3811832502 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8003d70 con 0x7f22dc1031d0 2024-09-21T03:43:12.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.595+0000 7f22e9a2f740 1 Processor -- start 2024-09-21T03:43:12.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 -- start start 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22d27fc640 1 -- 172.21.15.102:0/3811832502 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f22d80035f0 con 0x7f22dc1031d0 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe6f8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe6f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562cbe66ee50 con 0x562cbe330390 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562cbe65e280 con 0x562cbe3281b0 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562cbe662090 con 0x562cbe351070 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37366/0 (socket says 172.21.15.102:37366) 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 -- 172.21.15.102:0/4083697586 learned_addr learned my addr 172.21.15.102:0/4083697586 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e1257640 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe6f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e1a58640 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe6f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 -- 172.21.15.102:0/4083697586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 msgr2=0x562cbe6f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe6f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 -- 172.21.15.102:0/4083697586 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 msgr2=0x562cbe6f8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe6f8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.596+0000 7f22e0a56640 1 -- 172.21.15.102:0/4083697586 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cbe3bc650 con 0x562cbe330390 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22e0a56640 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00caa0 tx=0x7f22cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb29e6dfeb45201b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22d27fc640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 0x7f22c80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22e1a58640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 0x7f22c80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22c77fe640 1 -- 172.21.15.102:0/4083697586 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc010430 con 0x562cbe330390 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22c77fe640 1 -- 172.21.15.102:0/4083697586 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22cc010aa0 con 0x562cbe330390 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22c77fe640 1 -- 172.21.15.102:0/4083697586 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc01aab0 con 0x562cbe330390 2024-09-21T03:43:12.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.597+0000 7f22d27fc640 1 -- 172.21.15.102:0/3811832502 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f22d80e71b0 con 0x7f22dc1031d0 2024-09-21T03:43:12.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- 172.21.15.102:0/4083697586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 msgr2=0x562cbe6f90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00caa0 tx=0x7f22cc00cf60 comp rx=0 tx=0).stop 2024-09-21T03:43:12.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e1a58640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 0x7f22c80b8c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006010 tx=0x7f22d402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- 172.21.15.102:0/4083697586 shutdown_connections 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe6f90d0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe6f8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/4083697586 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe6f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- 172.21.15.102:0/4083697586 >> 172.21.15.102:0/4083697586 conn(0x562cbe345460 msgr2=0x562cbe6f6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- 172.21.15.102:0/4083697586 shutdown_connections 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- 172.21.15.102:0/4083697586 wait complete. 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 -- start start 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.598+0000 7f22e9a2f740 1 Processor -- start 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe330390 0x562cbe704250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe710180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562cbe4bf700 con 0x562cbe3281b0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562cbe5f9110 con 0x562cbe330390 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562cbe706e30 con 0x562cbe351070 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e9a2f740 10 client.0 _ll_register_callbacks cb 0x562cbe612990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37372/0 (socket says 172.21.15.102:37372) 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 -- 172.21.15.102:0/272567774 learned_addr learned my addr 172.21.15.102:0/272567774 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1a58640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe710180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e0a56640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe330390 0x562cbe704250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 -- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 msgr2=0x562cbe710180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe710180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 -- 172.21.15.102:0/272567774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe330390 msgr2=0x562cbe704250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe330390 0x562cbe704250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.599+0000 7f22e1257640 1 -- 172.21.15.102:0/272567774 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cbe626c40 con 0x562cbe3281b0 2024-09-21T03:43:12.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e1257640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009610 tx=0x7f22d80eaf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8bb6d628f51b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d8020070 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f22d8094110 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22cc010aa0 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f22d80a8e30 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 10 client.17355 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562cbe712b40 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22cc010aa0 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f22d80a88e0 con 0x562cbe3281b0 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 10 client.17355 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 20 client.17355 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe30f9f0 0x562cbe7160e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 4 client.17355 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:12.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.600+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cbe670da0 con 0x562cbe30f9f0 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.601+0000 7f22e0a56640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe30f9f0 0x562cbe7160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.601+0000 7f22c4ff9640 10 client.17355 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.601+0000 7f22e0a56640 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe30f9f0 0x562cbe7160e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d664b29b80a5314 server_cookie=98037b52391f44d2 in_seq=0 out_seq=0 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22c4ff9640 1 -- 172.21.15.102:0/272567774 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cbe670da0 con 0x562cbe30f9f0 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22c4ff9640 10 client.17355 handle_command_reply: tid=0 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 client.17355 shutdown 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 msgr2=0x562cbe703d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009610 tx=0x7f22d80eaf70 comp rx=0 tx=0).stop 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 shutdown_connections 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe710180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe330390 0x562cbe704250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe30f9f0 0x562cbe7160e0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/272567774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe3281b0 0x562cbe703d10 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 >> 172.21.15.102:0/272567774 conn(0x562cbe345460 msgr2=0x562cbe6fb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22c4ff9640 0 client.17355 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 shutdown_connections 2024-09-21T03:43:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 1 -- 172.21.15.102:0/272567774 wait complete. 2024-09-21T03:43:12.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.602+0000 7f22e9a2f740 20 client.17355 trim_cache size 0 max 16384 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 Processor -- start 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 -- start start 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe3281b0 0x562cbe703ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe351070 0x562cbe6f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f22c0011280 con 0x562cbe330390 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22c000eb50 con 0x562cbe351070 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22c000c9c0 con 0x562cbe3281b0 2024-09-21T03:43:12.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37386/0 (socket says 172.21.15.102:37386) 2024-09-21T03:43:12.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 -- 172.21.15.102:0/1361272943 learned_addr learned my addr 172.21.15.102:0/1361272943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:12.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e1257640 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe3281b0 0x562cbe703ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e1a58640 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe351070 0x562cbe6f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 -- 172.21.15.102:0/1361272943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe3281b0 msgr2=0x562cbe703ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe3281b0 0x562cbe703ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 -- 172.21.15.102:0/1361272943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe351070 msgr2=0x562cbe6f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe351070 0x562cbe6f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.620+0000 7f22e0a56640 1 -- 172.21.15.102:0/1361272943 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cbe7062f0 con 0x562cbe330390 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.621+0000 7f22e0a56640 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0058e0 tx=0x7f22cc0059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f30011a948a646 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.621+0000 7f22c6ffd640 1 -- 172.21.15.102:0/1361272943 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc032070 con 0x562cbe330390 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.621+0000 7f22c6ffd640 1 -- 172.21.15.102:0/1361272943 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22cc00ee70 con 0x562cbe330390 2024-09-21T03:43:12.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.621+0000 7f22c6ffd640 1 -- 172.21.15.102:0/1361272943 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0048e0 con 0x562cbe330390 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- 172.21.15.102:0/1361272943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 msgr2=0x562cbe704000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0058e0 tx=0x7f22cc0059c0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- 172.21.15.102:0/1361272943 shutdown_connections 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe704000 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe351070 0x562cbe6f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/1361272943 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe3281b0 0x562cbe703ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- 172.21.15.102:0/1361272943 >> 172.21.15.102:0/1361272943 conn(0x562cbe345460 msgr2=0x562cbe702590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- 172.21.15.102:0/1361272943 shutdown_connections 2024-09-21T03:43:12.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- 172.21.15.102:0/1361272943 wait complete. 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 -- start start 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.622+0000 7f22e9a2f740 1 Processor -- start 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe778e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe7078e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f22c000d010 con 0x562cbe330390 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22c000e480 con 0x562cbe3281b0 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f22c000d6e0 con 0x562cbe351070 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e9a2f740 10 client.0 _ll_register_callbacks cb 0x7f22d800d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:37388/0 (socket says 172.21.15.102:37388) 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 -- 172.21.15.102:0/2008521655 learned_addr learned my addr 172.21.15.102:0/2008521655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:12.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e1257640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe778e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e1a58640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe7078e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 -- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 msgr2=0x562cbe7078e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe7078e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 -- 172.21.15.102:0/2008521655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 msgr2=0x562cbe778e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe778e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 -- 172.21.15.102:0/2008521655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cbe708050 con 0x562cbe330390 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22e0a56640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f22cc01ac20 tx=0x7f22cc0056f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67d5043004ed875 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.623+0000 7f22c4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc03d060 con 0x562cbe330390 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f22cc01a5f0 con 0x562cbe330390 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22cc00ee70 con 0x562cbe330390 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f22cc032040 con 0x562cbe330390 2024-09-21T03:43:12.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 10 client.17361 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562cbe7805d0 con 0x562cbe330390 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f22cc00ee70 con 0x562cbe330390 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f22cc02c030 con 0x562cbe330390 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 10 client.17361 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 10 client.17361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 20 client.17361 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe2e4da0 0x562cbe782a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 4 client.17361 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.624+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562cbe66c850 con 0x562cbe2e4da0 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22e1257640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe2e4da0 0x562cbe782a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22e1257640 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe2e4da0 0x562cbe782a70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94f4773627ad7bf1 server_cookie=cf2812a163216c2a in_seq=0 out_seq=0 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22c4ff9640 10 client.17361 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22c4ff9640 1 -- 172.21.15.102:0/2008521655 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x562cbe66c850 con 0x562cbe2e4da0 2024-09-21T03:43:12.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22c4ff9640 10 client.17361 handle_command_reply: tid=0 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22e9a2f740 1 client.17361 shutdown 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 msgr2=0x562cbe7793d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.625+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f22cc01ac20 tx=0x7f22cc0056f0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 shutdown_connections 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x562cbe2e4da0 0x562cbe782a70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562cbe330390 0x562cbe7793d0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562cbe351070 0x562cbe7078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 --2- 172.21.15.102:0/2008521655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562cbe3281b0 0x562cbe778e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 >> 172.21.15.102:0/2008521655 conn(0x562cbe345460 msgr2=0x562cbe703ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22c4ff9640 0 client.17361 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 shutdown_connections 2024-09-21T03:43:12.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 1 -- 172.21.15.102:0/2008521655 wait complete. 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e9a2f740 20 client.17361 trim_cache size 0 max 16384 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.635 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.636 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.637 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.638 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.640 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "0f18c705-4ad6-43b0-8f29-ca2a0d455a7f": { 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:11.184407+0000", 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "836ab757-3bc4-42f6-adc1-f62cc07e4d10": { 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:01.147651+0000", 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.641 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:43:12.642 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.644 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:12.645 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 msgr2=0x7f22c80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 0x7f22c80b8c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f22d4006010 tx=0x7f22d402f310 comp rx=0 tx=0).stop 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 msgr2=0x7f22dc19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d770 tx=0x7f22d800dc30 comp rx=0 tx=0).stop 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.626+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 shutdown_connections 2024-09-21T03:43:12.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f22c80b6730 0x7f22c80b8c40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f22dc105ba0 0x7f22dc19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22dc105250 0x7f22dc19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 --2- 172.21.15.102:0/3811832502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f22dc1031d0 0x7f22dc19b440 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 >> 172.21.15.102:0/3811832502 conn(0x7f22dc079ec0 msgr2=0x7f22dc108600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 shutdown_connections 2024-09-21T03:43:12.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:12.627+0000 7f22e34bb640 1 -- 172.21.15.102:0/3811832502 wait complete. 2024-09-21T03:43:12.932 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:12 smithi102 ceph-mon[31392]: pgmap v620: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:43:13.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:12 smithi121 ceph-mon[34316]: pgmap v620: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:43:13.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:12 smithi148 ceph-mon[34651]: pgmap v620: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:43:13.382 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:13.383 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:43:13.630 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:14.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 -- 172.21.15.102:0/1199192332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 msgr2=0x7f60c8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 --2- 172.21.15.102:0/1199192332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8102ef0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009900 tx=0x7f60c402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:14.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 -- 172.21.15.102:0/1199192332 shutdown_connections 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 --2- 172.21.15.102:0/1199192332 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c8108d20 0x7f60c810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 --2- 172.21.15.102:0/1199192332 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c81083d0 0x7f60c81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 --2- 172.21.15.102:0/1199192332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8102ef0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.082+0000 7f60cf617640 1 -- 172.21.15.102:0/1199192332 >> 172.21.15.102:0/1199192332 conn(0x7f60c8079790 msgr2=0x7f60c8079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 -- 172.21.15.102:0/1199192332 shutdown_connections 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 -- 172.21.15.102:0/1199192332 wait complete. 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 Processor -- start 2024-09-21T03:43:14.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 -- start start 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 0x7f60c8199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 0x7f60c819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.083+0000 7f60cf617640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8112b60 con 0x7f60c8102ae0 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cf617640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f60c81129e0 con 0x7f60c81083d0 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cf617640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8112ce0 con 0x7f60c8108d20 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51090/0 (socket says 172.21.15.102:51090) 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 -- 172.21.15.102:0/2373905738 learned_addr learned my addr 172.21.15.102:0/2373905738 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60ccbb2640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 0x7f60c8199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 -- 172.21.15.102:0/2373905738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 msgr2=0x7f60c819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cdbb4640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 0x7f60c819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 0x7f60c819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 -- 172.21.15.102:0/2373905738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 msgr2=0x7f60c8199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 0x7f60c8199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 -- 172.21.15.102:0/2373905738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c819f4a0 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60ccbb2640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 0x7f60c8199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cdbb4640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 0x7f60c819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cd3b3640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f60c4006010 tx=0x7f60c4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c403f070 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c819f730 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f60c4031e10 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.084+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c4035030 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.085+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a5ef0 con 0x7f60c8102ae0 2024-09-21T03:43:14.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.085+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c8102ef0 con 0x7f60c8102ae0 2024-09-21T03:43:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.087+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f60c4042070 con 0x7f60c8102ae0 2024-09-21T03:43:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.088+0000 7f60be7fc640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 0x7f60b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.088+0000 7f60ccbb2640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 0x7f60b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.088+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7f60c4108890 con 0x7f60c8102ae0 2024-09-21T03:43:14.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.088+0000 7f60ccbb2640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 0x7f60b40b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60c8107f60 tx=0x7f60b8008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:14.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.091+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60c40ced70 con 0x7f60c8102ae0 2024-09-21T03:43:14.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.302+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60c802e640 con 0x7f60c8102ae0 2024-09-21T03:43:14.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.303+0000 7f60be7fc640 1 -- 172.21.15.102:0/2373905738 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f60c40d3150 con 0x7f60c8102ae0 2024-09-21T03:43:14.305 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:43:14.305 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:43:14.306 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 msgr2=0x7f60b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 0x7f60b40b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f60c8107f60 tx=0x7f60b8008040 comp rx=0 tx=0).stop 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 msgr2=0x7f60c8199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f60c4006010 tx=0x7f60c4004430 comp rx=0 tx=0).stop 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 shutdown_connections 2024-09-21T03:43:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f60b40b6680 0x7f60b40b8b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f60c8108d20 0x7f60c819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f60c81083d0 0x7f60c8199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 --2- 172.21.15.102:0/2373905738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60c8102ae0 0x7f60c8199530 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 >> 172.21.15.102:0/2373905738 conn(0x7f60c8079790 msgr2=0x7f60c8106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 shutdown_connections 2024-09-21T03:43:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:14.305+0000 7f60cf617640 1 -- 172.21.15.102:0/2373905738 wait complete. 2024-09-21T03:43:14.660 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2373905738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:14.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2373905738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:14.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2373905738' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:14.913 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:43:15.156 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:15.556 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:15 smithi102 ceph-mon[31392]: pgmap v621: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:15.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 -- 172.21.15.102:0/2500478995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 msgr2=0x7fac7c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 --2- 172.21.15.102:0/2500478995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c102e70 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009900 tx=0x7fac6c02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:15.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 -- 172.21.15.102:0/2500478995 shutdown_connections 2024-09-21T03:43:15.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 --2- 172.21.15.102:0/2500478995 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c108cf0 0x7fac7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 --2- 172.21.15.102:0/2500478995 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c1083a0 0x7fac7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 --2- 172.21.15.102:0/2500478995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c102e70 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 -- 172.21.15.102:0/2500478995 >> 172.21.15.102:0/2500478995 conn(0x7fac7c079730 msgr2=0x7fac7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 -- 172.21.15.102:0/2500478995 shutdown_connections 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.645+0000 7fac8276c640 1 -- 172.21.15.102:0/2500478995 wait complete. 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 Processor -- start 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 -- start start 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c1083a0 0x7fac7c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c108cf0 0x7fac7c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c112a80 con 0x7fac7c102a60 2024-09-21T03:43:15.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c112900 con 0x7fac7c1083a0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac8276c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c112c00 con 0x7fac7c108cf0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51110/0 (socket says 172.21.15.102:51110) 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 -- 172.21.15.102:0/1222353540 learned_addr learned my addr 172.21.15.102:0/1222353540 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac73fff640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c1083a0 0x7fac7c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac80d09640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c108cf0 0x7fac7c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 -- 172.21.15.102:0/1222353540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c108cf0 msgr2=0x7fac7c19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c108cf0 0x7fac7c19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 -- 172.21.15.102:0/1222353540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c1083a0 msgr2=0x7fac7c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c1083a0 0x7fac7c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.646+0000 7fac7bfff640 1 -- 172.21.15.102:0/1222353540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7c1a65e0 con 0x7fac7c102a60 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005ab0 tx=0x7fac6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac79ffb640 1 -- 172.21.15.102:0/1222353540 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c03f030 con 0x7fac7c102a60 2024-09-21T03:43:15.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac79ffb640 1 -- 172.21.15.102:0/1222353540 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac6c003cd0 con 0x7fac7c102a60 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac79ffb640 1 -- 172.21.15.102:0/1222353540 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c035070 con 0x7fac7c102a60 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7c1a6870 con 0x7fac7c102a60 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.647+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7c1a6d50 con 0x7fac7c102a60 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.649+0000 7fac79ffb640 1 -- 172.21.15.102:0/1222353540 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fac6c042030 con 0x7fac7c102a60 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 Processor -- start 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 -- start start 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 0x55ce8a1e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce8a15fea0 con 0x55ce89e191b0 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce8a14f2d0 con 0x55ce89e21390 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac88ce0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ce8a1530e0 con 0x55ce89e42070 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51116/0 (socket says 172.21.15.102:51116) 2024-09-21T03:43:15.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac7bfff640 1 -- 172.21.15.102:0/3847567388 learned_addr learned my addr 172.21.15.102:0/3847567388 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac80d09640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac73fff640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 0x55ce8a1e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac79ffb640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 0x7fac680b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.650+0000 7fac80d09640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 0x7fac680b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 -- 172.21.15.102:0/3847567388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 msgr2=0x55ce8a1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 -- 172.21.15.102:0/3847567388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 msgr2=0x55ce8a1e9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 -- 172.21.15.102:0/3847567388 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce89ead650 con 0x55ce89e21390 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac7bfff640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac79ffb640 1 -- 172.21.15.102:0/1222353540 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fac6c107bf0 con 0x7fac7c102a60 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac80d09640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 0x7fac680b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fac74009fd0 tx=0x7fac74004ab0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac73fff640 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 0x55ce8a1e9d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06aaa0 tx=0x7fac640107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbf1e4e7bc24383 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac727fc640 1 -- 172.21.15.102:0/3847567388 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64004030 con 0x55ce89e21390 2024-09-21T03:43:15.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac727fc640 1 -- 172.21.15.102:0/3847567388 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac640041d0 con 0x55ce89e21390 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.651+0000 7fac727fc640 1 -- 172.21.15.102:0/3847567388 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64011770 con 0x55ce89e21390 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- 172.21.15.102:0/3847567388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 msgr2=0x55ce8a1e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 0x55ce8a1e9d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06aaa0 tx=0x7fac640107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- 172.21.15.102:0/3847567388 shutdown_connections 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1e9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e21390 0x55ce8a1e9d40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3847567388 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- 172.21.15.102:0/3847567388 >> 172.21.15.102:0/3847567388 conn(0x55ce89e36460 msgr2=0x55ce8a1e71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- 172.21.15.102:0/3847567388 shutdown_connections 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- 172.21.15.102:0/3847567388 wait complete. 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.652+0000 7fac88ce0740 1 -- start start 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 Processor -- start 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e21390 0x55ce8a1f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a2050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce89fb0700 con 0x55ce89e191b0 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce8a0ea160 con 0x55ce89e42070 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55ce8a1fbda0 con 0x55ce89e21390 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac88ce0740 10 client.0 _ll_register_callbacks cb 0x55ce8a1039e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51118/0 (socket says 172.21.15.102:51118) 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 -- 172.21.15.102:0/1165573782 learned_addr learned my addr 172.21.15.102:0/1165573782 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac73fff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e21390 0x55ce8a1f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac80d09640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a2050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 -- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e21390 msgr2=0x55ce8a1f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e21390 0x55ce8a1f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 -- 172.21.15.102:0/1165573782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 msgr2=0x55ce8a2050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a2050d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.653+0000 7fac7bfff640 1 -- 172.21.15.102:0/1165573782 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce8a117c90 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac7bfff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fac6c105380 tx=0x7fac6c1057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d753f08cb25f1d1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c049070 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fac6c0d6f60 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac640041d0 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fac6c0cd3d0 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac88ce0740 10 client.17379 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ce8a207ac0 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.654+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac640041d0 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fac6c0ccce0 con 0x55ce89e191b0 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 10 client.17379 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 10 client.17379 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:15.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 20 client.17379 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:15.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89e009f0 0x55ce8a20b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 4 client.17379 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:15.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce8a161df0 con 0x55ce89e009f0 2024-09-21T03:43:15.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.655+0000 7fac73fff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89e009f0 0x55ce8a20b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.656+0000 7fac5b7fe640 10 client.17379 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.656+0000 7fac73fff640 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89e009f0 0x55ce8a20b030 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3acd24a5f90e4999 server_cookie=ead1d1a1bef0002f in_seq=0 out_seq=0 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac5b7fe640 1 -- 172.21.15.102:0/1165573782 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce8a161df0 con 0x55ce89e009f0 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac5b7fe640 10 client.17379 handle_command_reply: tid=0 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 client.17379 shutdown 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 msgr2=0x55ce8a1f8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fac6c105380 tx=0x7fac6c1057d0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 shutdown_connections 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89e009f0 0x55ce8a20b030 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a2050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e21390 0x55ce8a1f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 --2- 172.21.15.102:0/1165573782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e191b0 0x55ce8a1f8d90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 >> 172.21.15.102:0/1165573782 conn(0x55ce89e36460 msgr2=0x55ce8a1e5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac5b7fe640 0 client.17379 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 shutdown_connections 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 1 -- 172.21.15.102:0/1165573782 wait complete. 2024-09-21T03:43:15.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.657+0000 7fac88ce0740 20 client.17379 trim_cache size 0 max 16384 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 Processor -- start 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 -- start start 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e191b0 0x55ce8a1f7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a204fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1affe0 con 0x55ce89e21390 2024-09-21T03:43:15.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1ad8b0 con 0x55ce89e42070 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac88ce0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1ab720 con 0x55ce89e191b0 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac73fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac73fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51122/0 (socket says 172.21.15.102:51122) 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.670+0000 7fac73fff640 1 -- 172.21.15.102:0/2866006131 learned_addr learned my addr 172.21.15.102:0/2866006131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac7bfff640 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e191b0 0x55ce8a1f7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac80d09640 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a204fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 -- 172.21.15.102:0/2866006131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e191b0 msgr2=0x55ce8a1f7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e191b0 0x55ce8a1f7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 -- 172.21.15.102:0/2866006131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 msgr2=0x55ce8a204fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a204fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 -- 172.21.15.102:0/2866006131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce8a1e13b0 con 0x55ce89e21390 2024-09-21T03:43:15.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac73fff640 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fac64010ca0 tx=0x7fac64005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44de9addd1fa18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac71ffb640 1 -- 172.21.15.102:0/2866006131 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64005040 con 0x55ce89e21390 2024-09-21T03:43:15.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac71ffb640 1 -- 172.21.15.102:0/2866006131 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac640035f0 con 0x55ce89e21390 2024-09-21T03:43:15.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.671+0000 7fac71ffb640 1 -- 172.21.15.102:0/2866006131 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64029670 con 0x55ce89e21390 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- 172.21.15.102:0/2866006131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 msgr2=0x55ce8a1e7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fac64010ca0 tx=0x7fac64005c70 comp rx=0 tx=0).stop 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- 172.21.15.102:0/2866006131 shutdown_connections 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1e7220 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e42070 0x55ce8a204fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 --2- 172.21.15.102:0/2866006131 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e191b0 0x55ce8a1f7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- 172.21.15.102:0/2866006131 >> 172.21.15.102:0/2866006131 conn(0x55ce89e36460 msgr2=0x55ce8a1e6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- 172.21.15.102:0/2866006131 shutdown_connections 2024-09-21T03:43:15.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- 172.21.15.102:0/2866006131 wait complete. 2024-09-21T03:43:15.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.672+0000 7fac88ce0740 1 -- start start 2024-09-21T03:43:15.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 Processor -- start 2024-09-21T03:43:15.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e191b0 0x55ce8a2019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1fd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1abd70 con 0x55ce89e21390 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1ad1e0 con 0x55ce89e191b0 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fac7c1ac440 con 0x55ce89e42070 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac88ce0740 10 client.0 _ll_register_callbacks cb 0x7fac6c0c9a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51136/0 (socket says 172.21.15.102:51136) 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 -- 172.21.15.102:0/3924958023 learned_addr learned my addr 172.21.15.102:0/3924958023 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac7bfff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e191b0 0x55ce8a2019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac80d09640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1fd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 -- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 msgr2=0x55ce8a1fd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1fd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 -- 172.21.15.102:0/3924958023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e191b0 msgr2=0x55ce8a2019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e191b0 0x55ce8a2019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.673+0000 7fac73fff640 1 -- 172.21.15.102:0/3924958023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce8a2749f0 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac73fff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fac6400bdc0 tx=0x7fac6400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82328c5d80a375e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64003a20 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8630+0+0 (secure 0 0 0) 0x7fac64003bc0 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac640035f0 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fac6403e050 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 10 client.17385 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ce8a275ac0 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fac640035f0 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fac64029b30 con 0x55ce89e21390 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 10 client.17385 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 10 client.17385 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 20 client.17385 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:15.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89dd5da0 0x55ce8a278020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 4 client.17385 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.674+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce8a15d8a0 con 0x55ce89dd5da0 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.675+0000 7fac7bfff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89dd5da0 0x55ce8a278020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac5b7fe640 10 client.17385 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac7bfff640 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89dd5da0 0x55ce8a278020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf022aa55275d575 server_cookie=f4863cd7dff3eb65 in_seq=0 out_seq=0 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac5b7fe640 1 -- 172.21.15.102:0/3924958023 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce8a15d8a0 con 0x55ce89dd5da0 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac5b7fe640 10 client.17385 handle_command_reply: tid=0 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 client.17385 shutdown 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 msgr2=0x55ce8a1fcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fac6400bdc0 tx=0x7fac6400bdf0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 shutdown_connections 2024-09-21T03:43:15.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x55ce89dd5da0 0x55ce8a278020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce89e21390 0x55ce8a1fcf00 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac5b7fe640 0 client.17385 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55ce89e42070 0x55ce8a1fd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 --2- 172.21.15.102:0/3924958023 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce89e191b0 0x55ce8a2019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 >> 172.21.15.102:0/3924958023 conn(0x55ce89e36460 msgr2=0x55ce8a1ee3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 shutdown_connections 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 1 -- 172.21.15.102:0/3924958023 wait complete. 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.676+0000 7fac88ce0740 20 client.17385 trim_cache size 0 max 16384 2024-09-21T03:43:15.683 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 msgr2=0x7fac680b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 0x7fac680b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fac74009fd0 tx=0x7fac74004ab0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 msgr2=0x7fac7c19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005ab0 tx=0x7fac6c0042f0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 shutdown_connections 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fac680b66b0 0x7fac680b8bc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fac7c108cf0 0x7fac7c19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fac7c1083a0 0x7fac7c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 --2- 172.21.15.102:0/1222353540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fac7c102a60 0x7fac7c19b350 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 >> 172.21.15.102:0/1222353540 conn(0x7fac7c079730 msgr2=0x7fac7c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 shutdown_connections 2024-09-21T03:43:15.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:15.677+0000 7fac8276c640 1 -- 172.21.15.102:0/1222353540 wait complete. 2024-09-21T03:43:15.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:15 smithi148 ceph-mon[34651]: pgmap v621: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:15.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:15 smithi121 ceph-mon[34316]: pgmap v621: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:16.425 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:43:16.675 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:16.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:16 smithi102 ceph-mon[31392]: pgmap v622: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:16.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:16 smithi121 ceph-mon[34316]: pgmap v622: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:16.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:16 smithi148 ceph-mon[34651]: pgmap v622: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:43:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 -- 172.21.15.102:0/269180707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b881083c0 msgr2=0x7f6b881087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 --2- 172.21.15.102:0/269180707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b881083c0 0x7f6b881087d0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b7002a410 comp rx=0 tx=0).stop 2024-09-21T03:43:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 -- 172.21.15.102:0/269180707 shutdown_connections 2024-09-21T03:43:17.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 --2- 172.21.15.102:0/269180707 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b881083c0 0x7f6b881087d0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 --2- 172.21.15.102:0/269180707 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88108d10 0x7f6b8810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 --2- 172.21.15.102:0/269180707 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b88102a80 0x7f6b88102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 -- 172.21.15.102:0/269180707 >> 172.21.15.102:0/269180707 conn(0x7f6b88079740 msgr2=0x7f6b88079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 -- 172.21.15.102:0/269180707 shutdown_connections 2024-09-21T03:43:17.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.139+0000 7f6b8d251640 1 -- 172.21.15.102:0/269180707 wait complete. 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 Processor -- start 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 -- start start 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 0x7f6b8819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881083c0 0x7f6b8819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88112aa0 con 0x7f6b88108d10 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88112920 con 0x7f6b88102a80 2024-09-21T03:43:17.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8d251640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88112c20 con 0x7f6b881083c0 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8759e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51152/0 (socket says 172.21.15.102:51152) 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.140+0000 7f6b8759e640 1 -- 172.21.15.102:0/2856606797 learned_addr learned my addr 172.21.15.102:0/2856606797 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8659c640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881083c0 0x7f6b8819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 0x7f6b8819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 -- 172.21.15.102:0/2856606797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881083c0 msgr2=0x7f6b8819b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881083c0 0x7f6b8819b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 -- 172.21.15.102:0/2856606797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 msgr2=0x7f6b8819b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 0x7f6b8819b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 -- 172.21.15.102:0/2856606797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b881a6680 con 0x7f6b88108d10 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 0x7f6b8819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8759e640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000eb10 tx=0x7f6b8000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b7ffff640 1 -- 172.21.15.102:0/2856606797 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80004b20 con 0x7f6b88108d10 2024-09-21T03:43:17.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b881a6970 con 0x7f6b88108d10 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b7ffff640 1 -- 172.21.15.102:0/2856606797 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b80004cc0 con 0x7f6b88108d10 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b7ffff640 1 -- 172.21.15.102:0/2856606797 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80010720 con 0x7f6b88108d10 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.141+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b881a6e80 con 0x7f6b88108d10 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.144+0000 7f6b937c5740 1 Processor -- start 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.144+0000 7f6b7ffff640 1 -- 172.21.15.102:0/2856606797 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f6b80005000 con 0x7f6b88108d10 2024-09-21T03:43:17.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.144+0000 7f6b937c5740 1 -- start start 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d309d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d309d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5614d3013ea0 con 0x5614d2cd5390 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5614d30032d0 con 0x5614d2cf6070 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b937c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5614d30070e0 con 0x5614d2ccd1b0 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51156/0 (socket says 172.21.15.102:51156) 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 -- 172.21.15.102:0/1344977132 learned_addr learned my addr 172.21.15.102:0/1344977132 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d309d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d309d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b7ffff640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 0x7f6b740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 -- 172.21.15.102:0/1344977132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 msgr2=0x5614d309d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d309d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 -- 172.21.15.102:0/1344977132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 msgr2=0x5614d309d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d309d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 -- 172.21.15.102:0/1344977132 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614d2d61650 con 0x5614d2cd5390 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8759e640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 0x7f6b740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.145+0000 7f6b8659c640 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5247c2d681f46e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.146+0000 7f6b7ffff640 1 -- 172.21.15.102:0/2856606797 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f6b800e7d60 con 0x7f6b88108d10 2024-09-21T03:43:17.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.146+0000 7f6b7d7fa640 1 -- 172.21.15.102:0/1344977132 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70035070 con 0x5614d2cd5390 2024-09-21T03:43:17.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.146+0000 7f6b7d7fa640 1 -- 172.21.15.102:0/1344977132 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b70004030 con 0x5614d2cd5390 2024-09-21T03:43:17.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.146+0000 7f6b7d7fa640 1 -- 172.21.15.102:0/1344977132 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b700055a0 con 0x5614d2cd5390 2024-09-21T03:43:17.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- 172.21.15.102:0/1344977132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 msgr2=0x5614d309dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b8759e640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 0x7f6b740b8bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6b800e5520 tx=0x7f6b800e8060 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009900 tx=0x7f6b70000bc0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- 172.21.15.102:0/1344977132 shutdown_connections 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d309dd40 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d309d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 --2- 172.21.15.102:0/1344977132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d309d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- 172.21.15.102:0/1344977132 >> 172.21.15.102:0/1344977132 conn(0x5614d2cea460 msgr2=0x5614d309b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- 172.21.15.102:0/1344977132 shutdown_connections 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- 172.21.15.102:0/1344977132 wait complete. 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 -- start start 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.147+0000 7f6b937c5740 1 Processor -- start 2024-09-21T03:43:17.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d30b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5614d2e64700 con 0x5614d2cd5390 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5614d2f9e160 con 0x5614d2cf6070 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5614d30aba40 con 0x5614d2ccd1b0 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b937c5740 10 client.0 _ll_register_callbacks cb 0x5614d2fb79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51166/0 (socket says 172.21.15.102:51166) 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 -- 172.21.15.102:0/3417370672 learned_addr learned my addr 172.21.15.102:0/3417370672 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b8659c640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b8659c640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d30b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 -- 172.21.15.102:0/3417370672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 msgr2=0x5614d30a89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30a89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 -- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 msgr2=0x5614d30b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d30b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 -- 172.21.15.102:0/3417370672 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614d2fcbc90 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b8659c640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d30b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800bf40 tx=0x7f6b78011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f0deabe19416a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.148+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b78004440 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f6b780035f0 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b70004030 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6b780037f0 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 10 client.17397 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5614d30b7810 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b70004030 con 0x5614d2cd5390 2024-09-21T03:43:17.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6b78012ca0 con 0x5614d2cd5390 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 10 client.17397 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 10 client.17397 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 20 client.17397 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cb49f0 0x5614d30bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 4 client.17397 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614d3015df0 con 0x5614d2cb49f0 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.149+0000 7f6b8659c640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cb49f0 0x5614d30bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.150+0000 7f6b8659c640 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cb49f0 0x5614d30bad60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5dc5962fb6f960a9 server_cookie=ba5b30288803718d in_seq=0 out_seq=0 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.150+0000 7f6b6e7fc640 10 client.17397 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/3417370672 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614d3015df0 con 0x5614d2cb49f0 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b6e7fc640 10 client.17397 handle_command_reply: tid=0 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 client.17397 shutdown 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 msgr2=0x5614d30a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800bf40 tx=0x7f6b78011870 comp rx=0 tx=0).stop 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 shutdown_connections 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cb49f0 0x5614d30bad60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a8ee0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cf6070 0x5614d30b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b6e7fc640 0 client.17397 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 --2- 172.21.15.102:0/3417370672 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30a89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 >> 172.21.15.102:0/3417370672 conn(0x5614d2cea460 msgr2=0x5614d30a0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 shutdown_connections 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 1 -- 172.21.15.102:0/3417370672 wait complete. 2024-09-21T03:43:17.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.151+0000 7f6b937c5740 20 client.17397 trim_cache size 0 max 16384 2024-09-21T03:43:17.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.164+0000 7f6b937c5740 1 Processor -- start 2024-09-21T03:43:17.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.164+0000 7f6b937c5740 1 -- start start 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cb49f0 0x5614d30a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881b22d0 con 0x5614d2cd5390 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881afba0 con 0x5614d2cb49f0 2024-09-21T03:43:17.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b937c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ada10 con 0x5614d2ccd1b0 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51170/0 (socket says 172.21.15.102:51170) 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 -- 172.21.15.102:0/831462641 learned_addr learned my addr 172.21.15.102:0/831462641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cb49f0 0x5614d30a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 -- 172.21.15.102:0/831462641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 msgr2=0x5614d30b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30b4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 -- 172.21.15.102:0/831462641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cb49f0 msgr2=0x5614d30a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cb49f0 0x5614d30a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.165+0000 7f6b8659c640 1 -- 172.21.15.102:0/831462641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614d30a6ea0 con 0x5614d2cd5390 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.166+0000 7f6b8659c640 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a930 tx=0x7f6b700051a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f8297256f2f161 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.166+0000 7f6b7cff9640 1 -- 172.21.15.102:0/831462641 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70035040 con 0x5614d2cd5390 2024-09-21T03:43:17.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.166+0000 7f6b7cff9640 1 -- 172.21.15.102:0/831462641 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b70005420 con 0x5614d2cd5390 2024-09-21T03:43:17.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.166+0000 7f6b7cff9640 1 -- 172.21.15.102:0/831462641 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70003d70 con 0x5614d2cd5390 2024-09-21T03:43:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- 172.21.15.102:0/831462641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 msgr2=0x5614d30a5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6b7002a930 tx=0x7f6b700051a0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- 172.21.15.102:0/831462641 shutdown_connections 2024-09-21T03:43:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cd5390 0x5614d30a5b90 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 --2- 172.21.15.102:0/831462641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cb49f0 0x5614d30a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- 172.21.15.102:0/831462641 >> 172.21.15.102:0/831462641 conn(0x5614d2cea460 msgr2=0x5614d30a8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- 172.21.15.102:0/831462641 shutdown_connections 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- 172.21.15.102:0/831462641 wait complete. 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 -- start start 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.167+0000 7f6b937c5740 1 Processor -- start 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30ad4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cd5390 0x5614d3124720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ae060 con 0x5614d2cb49f0 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881af4d0 con 0x5614d2cd5390 2024-09-21T03:43:17.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881ae730 con 0x5614d2ccd1b0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 10 client.0 _ll_register_callbacks cb 0x7f6b7800b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51172/0 (socket says 172.21.15.102:51172) 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 -- 172.21.15.102:0/407774989 learned_addr learned my addr 172.21.15.102:0/407774989 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30ad4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 -- 172.21.15.102:0/407774989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 msgr2=0x5614d30ad4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30ad4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 -- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cd5390 msgr2=0x5614d3124720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cd5390 0x5614d3124720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 -- 172.21.15.102:0/407774989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614d30adcf0 con 0x5614d2cb49f0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b8659c640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6b70046040 tx=0x7f6b70005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bb7ba46278ff26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b6e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70062060 con 0x5614d2cb49f0 2024-09-21T03:43:17.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b70005420 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.168+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f6b70004a40 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6b70035050 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 10 client.17403 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5614d3125c70 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6b70005420 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f6b70031cd0 con 0x5614d2cb49f0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 10 client.17403 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 10 client.17403 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 20 client.17403 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cf6070 0x5614d3127eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 4 client.17403 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614d30118a0 con 0x5614d2cf6070 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.169+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cf6070 0x5614d3127eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:17.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b6e7fc640 10 client.17403 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b86d9d640 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cf6070 0x5614d3127eb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1942c54e787b709 server_cookie=7f8b99c1ce0a8327 in_seq=0 out_seq=0 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b6e7fc640 1 -- 172.21.15.102:0/407774989 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614d30118a0 con 0x5614d2cf6070 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b6e7fc640 10 client.17403 handle_command_reply: tid=0 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 client.17403 shutdown 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 msgr2=0x5614d30acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6b70046040 tx=0x7f6b70005710 comp rx=0 tx=0).stop 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 shutdown_connections 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5614d2cf6070 0x5614d3127eb0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5614d2cd5390 0x5614d3124720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5614d2ccd1b0 0x5614d30ad4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 --2- 172.21.15.102:0/407774989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5614d2cb49f0 0x5614d30acf60 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 >> 172.21.15.102:0/407774989 conn(0x5614d2cea460 msgr2=0x5614d309e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b6e7fc640 0 client.17403 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 shutdown_connections 2024-09-21T03:43:17.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 1 -- 172.21.15.102:0/407774989 wait complete. 2024-09-21T03:43:17.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.170+0000 7f6b937c5740 20 client.17403 trim_cache size 0 max 16384 2024-09-21T03:43:17.178 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 msgr2=0x7f6b740b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 0x7f6b740b8bc0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6b800e5520 tx=0x7f6b800e8060 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 msgr2=0x7f6b8819be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000eb10 tx=0x7f6b8000c2d0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 shutdown_connections 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6b740b66b0 0x7f6b740b8bc0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b88108d10 0x7f6b8819be70 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6b881083c0 0x7f6b8819b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 --2- 172.21.15.102:0/2856606797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b88102a80 0x7f6b8819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 >> 172.21.15.102:0/2856606797 conn(0x7f6b88079740 msgr2=0x7f6b88104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:17.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 shutdown_connections 2024-09-21T03:43:17.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:17.171+0000 7f6b8d251640 1 -- 172.21.15.102:0/2856606797 wait complete. 2024-09-21T03:43:18.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:43:18.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:17 smithi102 ceph-mon[31392]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:43:18.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:17 smithi148 ceph-mon[34651]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:43:18.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:17 smithi121 ceph-mon[34316]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T03:43:18.325 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.783+0000 7fa1f5324640 1 -- 172.21.15.102:0/802156111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 msgr2=0x7fa1f0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.783+0000 7fa1f5324640 1 --2- 172.21.15.102:0/802156111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f0102e90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009900 tx=0x7fa1e002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 -- 172.21.15.102:0/802156111 shutdown_connections 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 --2- 172.21.15.102:0/802156111 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 --2- 172.21.15.102:0/802156111 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 0x7fa1f01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 --2- 172.21.15.102:0/802156111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f0102e90 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 -- 172.21.15.102:0/802156111 >> 172.21.15.102:0/802156111 conn(0x7fa1f0079740 msgr2=0x7fa1f0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 -- 172.21.15.102:0/802156111 shutdown_connections 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 -- 172.21.15.102:0/802156111 wait complete. 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 Processor -- start 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.784+0000 7fa1f5324640 1 -- start start 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 0x7fa1f019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112ac0 con 0x7fa1f0102a80 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112940 con 0x7fa1f0108d10 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1f5324640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112c40 con 0x7fa1f01083c0 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51190/0 (socket says 172.21.15.102:51190) 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 -- 172.21.15.102:0/411584983 learned_addr learned my addr 172.21.15.102:0/411584983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 0x7fa1f019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 -- 172.21.15.102:0/411584983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 msgr2=0x7fa1f019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 0x7fa1f019ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 -- 172.21.15.102:0/411584983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 msgr2=0x7fa1f019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 -- 172.21.15.102:0/411584983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01a0450 con 0x7fa1f0102a80 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:18.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005ab0 tx=0x7fa1e00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.785+0000 7fa1d7fff640 1 -- 172.21.15.102:0/411584983 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e003f030 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.786+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01a06e0 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.786+0000 7fa1d7fff640 1 -- 172.21.15.102:0/411584983 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1e0003cd0 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.786+0000 7fa1d7fff640 1 -- 172.21.15.102:0/411584983 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0035070 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.786+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a0bc0 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 Processor -- start 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 -- start start 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c320e070 0x55f4c35b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1d7fff640 1 -- 172.21.15.102:0/411584983 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa1e0042030 con 0x7fa1f0102a80 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f4c352bea0 con 0x55f4c31e51b0 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f4c351b2d0 con 0x55f4c320e070 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1fb898740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f4c351f0e0 con 0x55f4c31ed390 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.788+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51198/0 (socket says 172.21.15.102:51198) 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 -- 172.21.15.102:0/3059618417 learned_addr learned my addr 172.21.15.102:0/3059618417 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c320e070 0x55f4c35b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 -- 172.21.15.102:0/3059618417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 msgr2=0x55f4c35b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 -- 172.21.15.102:0/3059618417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c320e070 msgr2=0x55f4c35b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c320e070 0x55f4c35b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 -- 172.21.15.102:0/3059618417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c3279650 con 0x55f4c31e51b0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0105030 tx=0x7fa1e010bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704d34c1f8524184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1d57fa640 1 -- 172.21.15.102:0/3059618417 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e011b070 con 0x55f4c31e51b0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1d7fff640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 0x7fa1d80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1d57fa640 1 -- 172.21.15.102:0/3059618417 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1e0110b40 con 0x55f4c31e51b0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1d57fa640 1 -- 172.21.15.102:0/3059618417 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00c9e40 con 0x55f4c31e51b0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.789+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 0x7fa1d80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1d7fff640 1 -- 172.21.15.102:0/411584983 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fa1e01079e0 con 0x7fa1f0102a80 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 -- 172.21.15.102:0/3059618417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 msgr2=0x55f4c35b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 0x7fa1d80b8bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e8008470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0105030 tx=0x7fa1e010bd20 comp rx=0 tx=0).stop 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 -- 172.21.15.102:0/3059618417 shutdown_connections 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b5be0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 --2- 172.21.15.102:0/3059618417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c320e070 0x55f4c35b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 -- 172.21.15.102:0/3059618417 >> 172.21.15.102:0/3059618417 conn(0x55f4c3202460 msgr2=0x55f4c35b3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 -- 172.21.15.102:0/3059618417 shutdown_connections 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.790+0000 7fa1fb898740 1 -- 172.21.15.102:0/3059618417 wait complete. 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 -- start start 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 Processor -- start 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 0x55f4c35d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f4c337c700 con 0x55f4c320e070 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f4c34b6160 con 0x55f4c31e51b0 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55f4c352bea0 con 0x55f4c31ed390 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1fb898740 10 client.0 _ll_register_callbacks cb 0x55f4c34cf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:18.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 0x55f4c35d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39520/0 (socket says 172.21.15.102:39520) 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1eeffd640 1 -- 172.21.15.102:0/413751422 learned_addr learned my addr 172.21.15.102:0/413751422 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.791+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 -- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 msgr2=0x55f4c35c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 -- 172.21.15.102:0/413751422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 msgr2=0x55f4c35c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 -- 172.21.15.102:0/413751422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c34e3c90 con 0x55f4c320e070 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1ef7fe640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 0x55f4c35d1060 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8010e00 tx=0x7fa1e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be7fff2a90a680e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:18.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e801d620 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e0110b40 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fa1e801d7c0 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa1e8010e30 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1fb898740 10 client.17415 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f4c35d3af0 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.792+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1e0110b40 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa1e8025ab0 con 0x55f4c320e070 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 10 client.17415 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 10 client.17415 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 20 client.17415 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c31cc9f0 0x55f4c35d7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 4 client.17415 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4c352ddf0 con 0x55f4c31cc9f0 2024-09-21T03:43:18.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c31cc9f0 0x55f4c35d7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c31cc9f0 0x55f4c35d7000 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5483622ba938005c server_cookie=91eabe464d3b7519 in_seq=0 out_seq=0 2024-09-21T03:43:18.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.793+0000 7fa1d2ff5640 10 client.17415 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/413751422 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4c352ddf0 con 0x55f4c31cc9f0 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1d2ff5640 10 client.17415 handle_command_reply: tid=0 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 client.17415 shutdown 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 msgr2=0x55f4c35d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 0x55f4c35d1060 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8010e00 tx=0x7fa1e8004a40 comp rx=0 tx=0).stop 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 shutdown_connections 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c31cc9f0 0x55f4c35d7000 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1d2ff5640 0 client.17415 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c320e070 0x55f4c35d1060 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c35c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.794+0000 7fa1fb898740 1 --2- 172.21.15.102:0/413751422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31e51b0 0x55f4c35c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.795+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 >> 172.21.15.102:0/413751422 conn(0x55f4c3202460 msgr2=0x55f4c35b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.795+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 shutdown_connections 2024-09-21T03:43:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.795+0000 7fa1fb898740 1 -- 172.21.15.102:0/413751422 wait complete. 2024-09-21T03:43:18.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.795+0000 7fa1fb898740 20 client.17415 trim_cache size 0 max 16384 2024-09-21T03:43:18.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.807+0000 7fa1fb898740 1 Processor -- start 2024-09-21T03:43:18.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 -- start start 2024-09-21T03:43:18.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31ed390 0x55f4c35b3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01affe0 con 0x55f4c31e51b0 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ad8b0 con 0x55f4c31ed390 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1fb898740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ab720 con 0x55f4c31cc9f0 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51212/0 (socket says 172.21.15.102:51212) 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/1884831787 learned_addr learned my addr 172.21.15.102:0/1884831787 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/1884831787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31cc9f0 msgr2=0x55f4c35c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/1884831787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31ed390 msgr2=0x55f4c35b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31ed390 0x55f4c35b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/1884831787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4c35c43c0 con 0x55f4c31e51b0 2024-09-21T03:43:18.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.808+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400db90 tx=0x7fa1e4012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307b10447ce67654 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1d4ff9640 1 -- 172.21.15.102:0/1884831787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e401f070 con 0x55f4c31e51b0 2024-09-21T03:43:18.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1d4ff9640 1 -- 172.21.15.102:0/1884831787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1e400dd40 con 0x55f4c31e51b0 2024-09-21T03:43:18.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1d4ff9640 1 -- 172.21.15.102:0/1884831787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40107b0 con 0x55f4c31e51b0 2024-09-21T03:43:18.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 -- 172.21.15.102:0/1884831787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 msgr2=0x55f4c35b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400db90 tx=0x7fa1e4012820 comp rx=0 tx=0).stop 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 -- 172.21.15.102:0/1884831787 shutdown_connections 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35b2bc0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31ed390 0x55f4c35b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 --2- 172.21.15.102:0/1884831787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 -- 172.21.15.102:0/1884831787 >> 172.21.15.102:0/1884831787 conn(0x55f4c3202460 msgr2=0x55f4c35c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 -- 172.21.15.102:0/1884831787 shutdown_connections 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.809+0000 7fa1fb898740 1 -- 172.21.15.102:0/1884831787 wait complete. 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 -- start start 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 Processor -- start 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c363ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01abd70 con 0x55f4c31e51b0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ad1e0 con 0x55f4c31cc9f0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ac440 con 0x55f4c31ed390 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1fb898740 10 client.0 _ll_register_callbacks cb 0x7fa1e800fed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1ee7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1ee7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51214/0 (socket says 172.21.15.102:51214) 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/4030195563 learned_addr learned my addr 172.21.15.102:0/4030195563 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.810+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 msgr2=0x55f4c363ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c363ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/4030195563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31cc9f0 msgr2=0x55f4c35c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 -- 172.21.15.102:0/4030195563 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4c363b1b0 con 0x55f4c31e51b0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1ee7fc640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa1e401d040 tx=0x7fa1e40052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c18552912c88f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:18.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e401f040 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fa1e4005510 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e400dd40 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa1e4033050 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1fb898740 10 client.17421 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55f4c36425a0 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.811+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa1e400dd40 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fa1e4022030 con 0x55f4c31e51b0 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 10 client.17421 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 10 client.17421 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 20 client.17421 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c320e070 0x55f4c3644c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 4 client.17421 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:18.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f4c35298a0 con 0x55f4c320e070 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c320e070 0x55f4c3644c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1eeffd640 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c320e070 0x55f4c3644c50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27b71a292d5136e3 server_cookie=5cfc761611690bfc in_seq=0 out_seq=0 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.812+0000 7fa1d2ff5640 10 client.17421 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1d2ff5640 1 -- 172.21.15.102:0/4030195563 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f4c35298a0 con 0x55f4c320e070 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1d2ff5640 10 client.17421 handle_command_reply: tid=0 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 client.17421 shutdown 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 msgr2=0x55f4c35ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa1e401d040 tx=0x7fa1e40052f0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 shutdown_connections 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55f4c320e070 0x55f4c3644c50 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f4c31e51b0 0x55f4c35ca1a0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55f4c31ed390 0x55f4c363ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 --2- 172.21.15.102:0/4030195563 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f4c31cc9f0 0x55f4c35c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 >> 172.21.15.102:0/4030195563 conn(0x55f4c3202460 msgr2=0x55f4c35b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1d2ff5640 0 client.17421 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 shutdown_connections 2024-09-21T03:43:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 1 -- 172.21.15.102:0/4030195563 wait complete. 2024-09-21T03:43:18.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.813+0000 7fa1fb898740 20 client.17421 trim_cache size 0 max 16384 2024-09-21T03:43:18.820 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 msgr2=0x7fa1d80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 0x7fa1d80b8bc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e8008470 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 msgr2=0x7fa1f019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005ab0 tx=0x7fa1e00042f0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 shutdown_connections 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa1d80b66b0 0x7fa1d80b8bc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa1f0108d10 0x7fa1f019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa1f01083c0 0x7fa1f019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 --2- 172.21.15.102:0/411584983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa1f0102a80 0x7fa1f019a5a0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 >> 172.21.15.102:0/411584983 conn(0x7fa1f0079740 msgr2=0x7fa1f0101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 shutdown_connections 2024-09-21T03:43:18.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:18.814+0000 7fa1f5324640 1 -- 172.21.15.102:0/411584983 wait complete. 2024-09-21T03:43:19.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:18 smithi102 ceph-mon[31392]: pgmap v624: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:19.243 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:18 smithi148 ceph-mon[34651]: pgmap v624: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:19.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:18 smithi121 ceph-mon[34316]: pgmap v624: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:20.746 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:20.747 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:20.773 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:20 smithi102 ceph-mon[31392]: pgmap v625: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:20.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:20 smithi121 ceph-mon[34316]: pgmap v625: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:20.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:20 smithi148 ceph-mon[34651]: pgmap v625: 97 pgs: 97 active+clean; 156 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:20.999 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:21.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 -- 172.21.15.102:0/493432318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec06b2d0 msgr2=0x7f94ec1022a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 --2- 172.21.15.102:0/493432318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1022a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:21.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 -- 172.21.15.102:0/493432318 shutdown_connections 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 --2- 172.21.15.102:0/493432318 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec102bf0 0x7f94ec108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 --2- 172.21.15.102:0/493432318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec1027e0 0x7f94ec107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 --2- 172.21.15.102:0/493432318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1022a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 -- 172.21.15.102:0/493432318 >> 172.21.15.102:0/493432318 conn(0x7f94ec079ec0 msgr2=0x7f94ec07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 -- 172.21.15.102:0/493432318 shutdown_connections 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.510+0000 7f94f103d640 1 -- 172.21.15.102:0/493432318 wait complete. 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.511+0000 7f94f103d640 1 Processor -- start 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.511+0000 7f94f103d640 1 -- start start 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec102bf0 0x7f94ec19ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec112c00 con 0x7f94ec1027e0 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec112a80 con 0x7f94ec102bf0 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94f103d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec112d80 con 0x7f94ec06b2d0 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51240/0 (socket says 172.21.15.102:51240) 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 -- 172.21.15.102:0/3118149815 learned_addr learned my addr 172.21.15.102:0/3118149815 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:21.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec102bf0 0x7f94ec19ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ead9d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 -- 172.21.15.102:0/3118149815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec06b2d0 msgr2=0x7f94ec1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 -- 172.21.15.102:0/3118149815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec102bf0 msgr2=0x7f94ec19ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec102bf0 0x7f94ec19ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 -- 172.21.15.102:0/3118149815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec19f460 con 0x7f94ec1027e0 2024-09-21T03:43:21.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.512+0000 7f94ea59c640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c970 tx=0x7f94d400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.513+0000 7f94e3fff640 1 -- 172.21.15.102:0/3118149815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4007bb0 con 0x7f94ec1027e0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.513+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec19f750 con 0x7f94ec1027e0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.513+0000 7f94e3fff640 1 -- 172.21.15.102:0/3118149815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94d4007d50 con 0x7f94ec1027e0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.513+0000 7f94e3fff640 1 -- 172.21.15.102:0/3118149815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d400f450 con 0x7f94ec1027e0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.513+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec1a5eb0 con 0x7f94ec1027e0 2024-09-21T03:43:21.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.515+0000 7f94f75b1740 1 Processor -- start 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.515+0000 7f94f75b1740 1 -- start start 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.515+0000 7f94e3fff640 1 -- 172.21.15.102:0/3118149815 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f94d4004f30 con 0x7f94ec1027e0 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf44350 0x56288c2eb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c2ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56288c261e60 con 0x56288bf1b490 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56288c251290 con 0x56288bf44350 2024-09-21T03:43:21.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94f75b1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56288c2550a0 con 0x56288bf23670 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51250/0 (socket says 172.21.15.102:51250) 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 -- 172.21.15.102:0/338890389 learned_addr learned my addr 172.21.15.102:0/338890389 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94eb59e640 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf44350 0x56288c2eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ea59c640 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c2ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 -- 172.21.15.102:0/338890389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 msgr2=0x56288c2ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c2ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 -- 172.21.15.102:0/338890389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf44350 msgr2=0x56288c2eb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf44350 0x56288c2eb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 -- 172.21.15.102:0/338890389 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288bfaf930 con 0x56288bf1b490 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.516+0000 7f94ead9d640 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc032d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4138a700d801a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94e3fff640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 0x7f94d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94e17fa640 1 -- 172.21.15.102:0/338890389 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc035040 con 0x56288bf1b490 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94e17fa640 1 -- 172.21.15.102:0/338890389 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94dc031710 con 0x56288bf1b490 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 0x7f94d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94e17fa640 1 -- 172.21.15.102:0/338890389 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0047a0 con 0x56288bf1b490 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.517+0000 7f94e3fff640 1 -- 172.21.15.102:0/3118149815 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f94d40e73b0 con 0x7f94ec1027e0 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- 172.21.15.102:0/338890389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 msgr2=0x56288c2eb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 0x7f94d80b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f94e400a400 tx=0x7f94e400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009900 tx=0x7f94dc032d30 comp rx=0 tx=0).stop 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- 172.21.15.102:0/338890389 shutdown_connections 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2eb970 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c2ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 --2- 172.21.15.102:0/338890389 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf44350 0x56288c2eb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- 172.21.15.102:0/338890389 >> 172.21.15.102:0/338890389 conn(0x56288bf38740 msgr2=0x56288c2e9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- 172.21.15.102:0/338890389 shutdown_connections 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- 172.21.15.102:0/338890389 wait complete. 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 -- start start 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.518+0000 7f94f75b1740 1 Processor -- start 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56288c0b2890 con 0x56288bf1b490 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56288c1ebd40 con 0x56288bf23670 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x56288c2fbd10 con 0x56288bf44350 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94f75b1740 10 client.0 _ll_register_callbacks cb 0x56288c24fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51258/0 (socket says 172.21.15.102:51258) 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 -- 172.21.15.102:0/124413392 learned_addr learned my addr 172.21.15.102:0/124413392 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ea59c640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94eb59e640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 -- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 msgr2=0x56288c2f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 -- 172.21.15.102:0/124413392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 msgr2=0x56288c2fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 -- 172.21.15.102:0/124413392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288c2fb7e0 con 0x56288bf1b490 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ea59c640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94ead9d640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f94dc02a930 tx=0x7f94dc009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a950dd99d2c855bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.519+0000 7f94d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc04e030 con 0x56288bf1b490 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f94dc0054b0 con 0x56288bf1b490 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94dc031710 con 0x56288bf1b490 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f94dc035040 con 0x56288bf1b490 2024-09-21T03:43:21.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 10 client.17433 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56288c30a0e0 con 0x56288bf1b490 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94dc031710 con 0x56288bf1b490 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f94dc046830 con 0x56288bf1b490 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 10 client.17433 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 10 client.17433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 20 client.17433 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bf02cd0 0x56288c30d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 4 client.17433 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.520+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56288c263db0 con 0x56288bf02cd0 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.521+0000 7f94ea59c640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bf02cd0 0x56288c30d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.521+0000 7f94d27fc640 10 client.17433 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.521+0000 7f94ea59c640 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bf02cd0 0x56288c30d440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd769608f349f8c server_cookie=131ed7d84f5e8359 in_seq=0 out_seq=0 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94d27fc640 1 -- 172.21.15.102:0/124413392 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56288c263db0 con 0x56288bf02cd0 2024-09-21T03:43:21.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94d27fc640 10 client.17433 handle_command_reply: tid=0 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 client.17433 shutdown 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 msgr2=0x56288c2f3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f94dc02a930 tx=0x7f94dc009520 comp rx=0 tx=0).stop 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 shutdown_connections 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bf02cd0 0x56288c30d440 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 --2- 172.21.15.102:0/124413392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2f3410 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94d27fc640 0 client.17433 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 >> 172.21.15.102:0/124413392 conn(0x56288bf38740 msgr2=0x56288c2ece20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 shutdown_connections 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 1 -- 172.21.15.102:0/124413392 wait complete. 2024-09-21T03:43:21.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.522+0000 7f94f75b1740 20 client.17433 trim_cache size 0 max 16384 2024-09-21T03:43:21.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 Processor -- start 2024-09-21T03:43:21.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 -- start start 2024-09-21T03:43:21.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2f6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1b00e0 con 0x56288bf1b490 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1ad9b0 con 0x56288bf23670 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94f75b1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1ab820 con 0x56288bf44350 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94ead9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51272/0 (socket says 172.21.15.102:51272) 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.540+0000 7f94ead9d640 1 -- 172.21.15.102:0/2989150453 learned_addr learned my addr 172.21.15.102:0/2989150453 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ea59c640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94eb59e640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 -- 172.21.15.102:0/2989150453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 msgr2=0x56288c2f66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 -- 172.21.15.102:0/2989150453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 msgr2=0x56288c2f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 -- 172.21.15.102:0/2989150453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56288c2f7490 con 0x56288bf1b490 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94eb59e640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94ead9d640 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f94dc006010 tx=0x7f94dc032ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a903b1b5c1edf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94e0ff9640 1 -- 172.21.15.102:0/2989150453 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc05f070 con 0x56288bf1b490 2024-09-21T03:43:21.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94e0ff9640 1 -- 172.21.15.102:0/2989150453 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94dc046920 con 0x56288bf1b490 2024-09-21T03:43:21.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.541+0000 7f94e0ff9640 1 -- 172.21.15.102:0/2989150453 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94dc04e040 con 0x56288bf1b490 2024-09-21T03:43:21.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- 172.21.15.102:0/2989150453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 msgr2=0x56288c2ecb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f94dc006010 tx=0x7f94dc032ae0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- 172.21.15.102:0/2989150453 shutdown_connections 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf44350 0x56288c2f66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf23670 0x56288c2f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 --2- 172.21.15.102:0/2989150453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf1b490 0x56288c2ecb70 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- 172.21.15.102:0/2989150453 >> 172.21.15.102:0/2989150453 conn(0x56288bf38740 msgr2=0x56288c2ec460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- 172.21.15.102:0/2989150453 shutdown_connections 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- 172.21.15.102:0/2989150453 wait complete. 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 -- start start 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.542+0000 7f94f75b1740 1 Processor -- start 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 0x56288c306140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c3066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1abe70 con 0x56288bf44350 2024-09-21T03:43:21.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1ad2e0 con 0x56288bf1b490 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec1ac540 con 0x56288bf23670 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94f75b1740 10 client.0 _ll_register_callbacks cb 0x7f94dc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51286/0 (socket says 172.21.15.102:51286) 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 -- 172.21.15.102:0/3126397893 learned_addr learned my addr 172.21.15.102:0/3126397893 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94ea59c640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c3066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94ead9d640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 0x56288c306140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 -- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 msgr2=0x56288c3066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c3066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 -- 172.21.15.102:0/3126397893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 msgr2=0x56288c306140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 0x56288c306140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 -- 172.21.15.102:0/3126397893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56288c3701f0 con 0x56288bf44350 2024-09-21T03:43:21.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94ead9d640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 0x56288c306140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94ea59c640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c3066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94eb59e640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f94e40166b0 tx=0x7f94e4004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff79facf44b59c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.543+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4024830 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f94e40249d0 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94dc046920 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f94e4024bd0 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 10 client.17439 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56288c378700 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f94dc046920 con 0x56288bf44350 2024-09-21T03:43:21.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f94e402d3b0 con 0x56288bf44350 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 10 client.17439 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 20 client.17439 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bed8080 0x56288c37af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 4 client.17439 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56288c25f860 con 0x56288bed8080 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.544+0000 7f94ead9d640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bed8080 0x56288c37af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.545+0000 7f94ead9d640 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bed8080 0x56288c37af70 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15e6da17768ccd8 server_cookie=80ae8b1103a03574 in_seq=0 out_seq=0 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.545+0000 7f94d27fc640 10 client.17439 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.546+0000 7f94d27fc640 1 -- 172.21.15.102:0/3126397893 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56288c25f860 con 0x56288bed8080 2024-09-21T03:43:21.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94d27fc640 10 client.17439 handle_command_reply: tid=0 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 client.17439 shutdown 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 msgr2=0x56288c36fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f94e40166b0 tx=0x7f94e4004b50 comp rx=0 tx=0).stop 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 shutdown_connections 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x56288bed8080 0x56288c37af70 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56288bf44350 0x56288c36fb80 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x56288bf23670 0x56288c3066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 --2- 172.21.15.102:0/3126397893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56288bf1b490 0x56288c306140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94d27fc640 0 client.17439 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 >> 172.21.15.102:0/3126397893 conn(0x56288bf38740 msgr2=0x56288c2f0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 shutdown_connections 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 1 -- 172.21.15.102:0/3126397893 wait complete. 2024-09-21T03:43:21.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.547+0000 7f94f75b1740 20 client.17439 trim_cache size 0 max 16384 2024-09-21T03:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "d8285ed6-e990-40bf-a960-3f19a6eba78d", 2024-09-21T03:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:43:21.558 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 msgr2=0x7f94d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 0x7f94d80b8b90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f94e400a400 tx=0x7f94e400d040 comp rx=0 tx=0).stop 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 msgr2=0x7f94ec199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c970 tx=0x7f94d400ce30 comp rx=0 tx=0).stop 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 shutdown_connections 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f94d80b6680 0x7f94d80b8b90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f94ec1027e0 0x7f94ec199a90 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f94ec102bf0 0x7f94ec19ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 --2- 172.21.15.102:0/3118149815 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f94ec06b2d0 0x7f94ec1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:21.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 >> 172.21.15.102:0/3118149815 conn(0x7f94ec079ec0 msgr2=0x7f94ec100de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:21.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 shutdown_connections 2024-09-21T03:43:21.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:21.548+0000 7f94f103d640 1 -- 172.21.15.102:0/3118149815 wait complete. 2024-09-21T03:43:21.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:21 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:43:21.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:21 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:21.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:21 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:43:21.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:21 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:21.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:21 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:43:22.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:21 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:43:22.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:21 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:22.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:21 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:43:22.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:21 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:22.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:21 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:43:22.137 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:21 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:43:22.137 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:21 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:22.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:21 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:43:22.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:21 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:22.138 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:21 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:43:22.351 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:22.639 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:23.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:22 smithi121 ceph-mon[34316]: pgmap v626: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:23.065 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:22 smithi102 ceph-mon[31392]: pgmap v626: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 -- 172.21.15.102:0/2948079198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 msgr2=0x7f961410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 --2- 172.21.15.102:0/2948079198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961410f520 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f960c009ca0 tx=0x7f960c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 -- 172.21.15.102:0/2948079198 shutdown_connections 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 --2- 172.21.15.102:0/2948079198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961410f520 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 --2- 172.21.15.102:0/2948079198 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 0x7f96141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 --2- 172.21.15.102:0/2948079198 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 0x7f9614102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 -- 172.21.15.102:0/2948079198 >> 172.21.15.102:0/2948079198 conn(0x7f9614079730 msgr2=0x7f9614079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 -- 172.21.15.102:0/2948079198 shutdown_connections 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.154+0000 7f961c4cb640 1 -- 172.21.15.102:0/2948079198 wait complete. 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 Processor -- start 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 -- start start 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 0x7f961419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 0x7f961419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9614112a80 con 0x7f9614108cf0 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9614112900 con 0x7f9614102a60 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961c4cb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9614112c00 con 0x7f96141083a0 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51312/0 (socket says 172.21.15.102:51312) 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 -- 172.21.15.102:0/3571417913 learned_addr learned my addr 172.21.15.102:0/3571417913 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:23.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961a267640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 0x7f961419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f9619a66640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 0x7f961419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 -- 172.21.15.102:0/3571417913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 msgr2=0x7f961419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 0x7f961419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 -- 172.21.15.102:0/3571417913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 msgr2=0x7f961419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 0x7f961419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.155+0000 7f961aa68640 1 -- 172.21.15.102:0/3571417913 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141a0450 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f961aa68640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f960c005e30 tx=0x7f960c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f960b7fe640 1 -- 172.21.15.102:0/3571417913 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c031650 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f960b7fe640 1 -- 172.21.15.102:0/3571417913 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f960c0317f0 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96141a06e0 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f960b7fe640 1 -- 172.21.15.102:0/3571417913 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c02fb70 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.156+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96141a6ea0 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.158+0000 7f960b7fe640 1 -- 172.21.15.102:0/3571417913 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f960c02fd70 con 0x7f9614108cf0 2024-09-21T03:43:23.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 Processor -- start 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 -- start start 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d25650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 0x558103d260d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558103c9be50 con 0x5581039551b0 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558103c8b280 con 0x55810397e070 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9622a3f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558103c8f090 con 0x55810395d390 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f961a267640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f961a267640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51328/0 (socket says 172.21.15.102:51328) 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f961a267640 1 -- 172.21.15.102:0/3730275547 learned_addr learned my addr 172.21.15.102:0/3730275547 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9619a66640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 0x558103d260d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f960b7fe640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 0x7f96000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f9619a66640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d25650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.159+0000 7f961aa68640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 0x7f96000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 -- 172.21.15.102:0/3730275547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 msgr2=0x558103d260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 0x558103d260d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 -- 172.21.15.102:0/3730275547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 msgr2=0x558103d25650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d25650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 -- 172.21.15.102:0/3730275547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581039e9650 con 0x5581039551b0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f9619a66640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 0x558103d260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f960b7fe640 1 -- 172.21.15.102:0/3571417913 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f960c1089b0 con 0x7f9614108cf0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961a267640 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f961000bd50 tx=0x7f96100107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8de700126f4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f9608ff9640 1 -- 172.21.15.102:0/3730275547 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610005220 con 0x5581039551b0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f961aa68640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 0x7f96000b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f960c106170 tx=0x7f960c02a8c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f9608ff9640 1 -- 172.21.15.102:0/3730275547 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f961000be40 con 0x5581039551b0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.160+0000 7f9608ff9640 1 -- 172.21.15.102:0/3730275547 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96100117c0 con 0x5581039551b0 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- 172.21.15.102:0/3730275547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 msgr2=0x558103d25b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f961000bd50 tx=0x7f96100107a0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- 172.21.15.102:0/3730275547 shutdown_connections 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5581039551b0 0x558103d25b90 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55810395d390 0x558103d260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 --2- 172.21.15.102:0/3730275547 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d25650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- 172.21.15.102:0/3730275547 >> 172.21.15.102:0/3730275547 conn(0x558103972460 msgr2=0x558103d23540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- 172.21.15.102:0/3730275547 shutdown_connections 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- 172.21.15.102:0/3730275547 wait complete. 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.161+0000 7f9622a3f740 1 -- start start 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 Processor -- start 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d30d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558103aec700 con 0x55810395d390 2024-09-21T03:43:23.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558103c26110 con 0x55810397e070 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x558103d33e30 con 0x5581039551b0 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9622a3f740 10 client.0 _ll_register_callbacks cb 0x558103c3f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51334/0 (socket says 172.21.15.102:51334) 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 -- 172.21.15.102:0/2696230726 learned_addr learned my addr 172.21.15.102:0/2696230726 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9619a66640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9619a66640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d30d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 -- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 msgr2=0x558103d30d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d30d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 -- 172.21.15.102:0/2696230726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 msgr2=0x558103d3d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d3d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f961a267640 1 -- 172.21.15.102:0/2696230726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558103c53c40 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.162+0000 7f9619a66640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f961a267640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f9610011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ce217b86bafe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610011b70 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558103c9dda0 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9610011d10 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f961001b430 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 10 client.17451 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558103d3fba0 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x558103c9dda0 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f961002f540 con 0x55810395d390 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 10 client.17451 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:23.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 10 client.17451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.163+0000 7f9622a3f740 20 client.17451 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810393c9f0 0x558103d42f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f9622a3f740 4 client.17451 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558103c99850 con 0x55810393c9f0 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f9619a66640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810393c9f0 0x558103d42f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f95fdffb640 10 client.17451 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.164+0000 7f9619a66640 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810393c9f0 0x558103d42f00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57218b5ada033947 server_cookie=1648b9ff2833dade in_seq=0 out_seq=0 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f95fdffb640 1 -- 172.21.15.102:0/2696230726 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558103c99850 con 0x55810393c9f0 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f95fdffb640 10 client.17451 handle_command_reply: tid=0 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 client.17451 shutdown 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 msgr2=0x558103d312d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f9610000c00 tx=0x7f9610011770 comp rx=0 tx=0).stop 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 shutdown_connections 2024-09-21T03:43:23.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810393c9f0 0x558103d42f00 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f95fdffb640 0 client.17451 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d312d0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810397e070 0x558103d3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2696230726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d30d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.165+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 >> 172.21.15.102:0/2696230726 conn(0x558103972460 msgr2=0x558103d287e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.166+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 shutdown_connections 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.166+0000 7f9622a3f740 1 -- 172.21.15.102:0/2696230726 wait complete. 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.166+0000 7f9622a3f740 20 client.17451 trim_cache size 0 max 16384 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.182+0000 7f9622a3f740 1 Processor -- start 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 -- start start 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810393c9f0 0x558103d27040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96141b21e0 con 0x55810395d390 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f96141afab0 con 0x55810393c9f0 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9622a3f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f96141ad920 con 0x5581039551b0 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51336/0 (socket says 172.21.15.102:51336) 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 -- 172.21.15.102:0/305245689 learned_addr learned my addr 172.21.15.102:0/305245689 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f961a267640 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 -- 172.21.15.102:0/305245689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 msgr2=0x558103d329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d329c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 -- 172.21.15.102:0/305245689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810393c9f0 msgr2=0x558103d27040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810393c9f0 0x558103d27040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 -- 172.21.15.102:0/305245689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558103d43360 con 0x55810395d390 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.183+0000 7f9619a66640 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9604005fd0 tx=0x7f960400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485fdb95f9148c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f95fffff640 1 -- 172.21.15.102:0/305245689 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604012a70 con 0x55810395d390 2024-09-21T03:43:23.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f95fffff640 1 -- 172.21.15.102:0/305245689 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9604004c70 con 0x55810395d390 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f95fffff640 1 -- 172.21.15.102:0/305245689 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604005610 con 0x55810395d390 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 -- 172.21.15.102:0/305245689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 msgr2=0x558103d3d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f9604005fd0 tx=0x7f960400b650 comp rx=0 tx=0).stop 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 -- 172.21.15.102:0/305245689 shutdown_connections 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810395d390 0x558103d3d050 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 --2- 172.21.15.102:0/305245689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810393c9f0 0x558103d27040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 -- 172.21.15.102:0/305245689 >> 172.21.15.102:0/305245689 conn(0x558103972460 msgr2=0x558103d322b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 -- 172.21.15.102:0/305245689 shutdown_connections 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.184+0000 7f9622a3f740 1 -- 172.21.15.102:0/305245689 wait complete. 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 -- start start 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 Processor -- start 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d34c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810395d390 0x558103d35170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96141adf70 con 0x55810393c9f0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f96141af3e0 con 0x55810395d390 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f96141ae640 con 0x5581039551b0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9622a3f740 10 client.0 _ll_register_callbacks cb 0x7f960400bde0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9619a66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9619a66640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51348/0 (socket says 172.21.15.102:51348) 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9619a66640 1 -- 172.21.15.102:0/2974355073 learned_addr learned my addr 172.21.15.102:0/2974355073 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f961a267640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d34c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.185+0000 7f9619a66640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810395d390 0x558103d35170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 -- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 msgr2=0x558103d34c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d34c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 -- 172.21.15.102:0/2974355073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810395d390 msgr2=0x558103d35170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810395d390 0x558103d35170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 -- 172.21.15.102:0/2974355073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558103d357e0 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9619a66640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f960400bfd0 tx=0x7f96040051f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e014bd68e2eef1b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604004ab0 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9604012a70 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9604004c70 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9604012c70 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 10 client.17457 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558103dad600 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9604004c70 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9604026070 con 0x55810393c9f0 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 10 client.17457 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 10 client.17457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.186+0000 7f9622a3f740 20 client.17457 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810397e070 0x558103dafe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:23.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f9622a3f740 4 client.17457 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558103c96c80 con 0x55810397e070 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f961a267640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810397e070 0x558103dafe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f95fdffb640 10 client.17457 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.187+0000 7f961a267640 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810397e070 0x558103dafe20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b5e89034970c33d server_cookie=b3c3be94a11dda02 in_seq=0 out_seq=0 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f95fdffb640 1 -- 172.21.15.102:0/2974355073 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x558103c96c80 con 0x55810397e070 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f95fdffb640 10 client.17457 handle_command_reply: tid=0 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 client.17457 shutdown 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 msgr2=0x558103d39780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f960400bfd0 tx=0x7f96040051f0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 shutdown_connections 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55810395d390 0x558103d35170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5581039551b0 0x558103d34c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55810397e070 0x558103dafe20 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 --2- 172.21.15.102:0/2974355073 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55810393c9f0 0x558103d39780 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f95fdffb640 0 client.17457 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.257 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:43:23.258 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.259 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.261 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.262 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "0f18c705-4ad6-43b0-8f29-ca2a0d455a7f": { 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:11.184407+0000", 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "836ab757-3bc4-42f6-adc1-f62cc07e4d10": { 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:01.147651+0000", 2024-09-21T03:43:23.263 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:43:23.264 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "d8285ed6-e990-40bf-a960-3f19a6eba78d": { 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:21.546155+0000", 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.266 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:23.267 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 >> 172.21.15.102:0/2974355073 conn(0x558103972460 msgr2=0x558103d26e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 shutdown_connections 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 1 -- 172.21.15.102:0/2974355073 wait complete. 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f9622a3f740 20 client.17457 trim_cache size 0 max 16384 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 msgr2=0x7f96000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 0x7f96000b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f960c106170 tx=0x7f960c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 msgr2=0x7f961419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.188+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f960c005e30 tx=0x7f960c003f90 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 shutdown_connections 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f96000b6680 0x7f96000b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9614108cf0 0x7f961419fd20 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f96141083a0 0x7f961419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 --2- 172.21.15.102:0/3571417913 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9614102a60 0x7f961419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 >> 172.21.15.102:0/3571417913 conn(0x7f9614079730 msgr2=0x7f961406b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 shutdown_connections 2024-09-21T03:43:23.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:23.189+0000 7f961c4cb640 1 -- 172.21.15.102:0/3571417913 wait complete. 2024-09-21T03:43:23.270 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:22 smithi148 ceph-mon[34651]: pgmap v626: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:43:24.108 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:43:24.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:43:24.352 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:24.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:24 smithi121 ceph-mon[34316]: pgmap v627: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:24.825 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:24 smithi102 ceph-mon[31392]: pgmap v627: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 -- 172.21.15.102:0/3088110891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac103b60 msgr2=0x7f55ac103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 --2- 172.21.15.102:0/3088110891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac103b60 0x7f55ac103f70 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f559c009900 tx=0x7f559c02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 -- 172.21.15.102:0/3088110891 shutdown_connections 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 --2- 172.21.15.102:0/3088110891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac109df0 0x7f55ac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 --2- 172.21.15.102:0/3088110891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac1094a0 0x7f55ac1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 --2- 172.21.15.102:0/3088110891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac103b60 0x7f55ac103f70 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 -- 172.21.15.102:0/3088110891 >> 172.21.15.102:0/3088110891 conn(0x7f55ac07b850 msgr2=0x7f55ac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.912+0000 7f55b1485640 1 -- 172.21.15.102:0/3088110891 shutdown_connections 2024-09-21T03:43:24.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.913+0000 7f55b1485640 1 -- 172.21.15.102:0/3088110891 wait complete. 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.913+0000 7f55b1485640 1 Processor -- start 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.913+0000 7f55b1485640 1 -- start start 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac103b60 0x7f55ac19a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 0x7f55ac19fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113bf0 con 0x7f55ac1094a0 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113a70 con 0x7f55ac103b60 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac113d70 con 0x7f55ac109df0 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39364/0 (socket says 172.21.15.102:39364) 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 -- 172.21.15.102:0/3079419199 learned_addr learned my addr 172.21.15.102:0/3079419199 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55ab7fe640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 0x7f55ac19fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aaffd640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac103b60 0x7f55ac19a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:24.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 -- 172.21.15.102:0/3079419199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 msgr2=0x7f55ac19fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 0x7f55ac19fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 -- 172.21.15.102:0/3079419199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac103b60 msgr2=0x7f55ac19a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac103b60 0x7f55ac19a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 -- 172.21.15.102:0/3079419199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1a0570 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55ab7fe640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 0x7f55ac19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55aa7fc640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55a000d750 tx=0x7f55a000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0017070 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1a0860 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f55a00054f0 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.914+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1a6fc0 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.915+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0004d90 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.915+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ac103f70 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.918+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f55a0005020 con 0x7f55ac1094a0 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.919+0000 7f5593fff640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 0x7f55940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:24.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.919+0000 7f55aaffd640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 0x7f55940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.919+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f55a00e7660 con 0x7f55ac1094a0 2024-09-21T03:43:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.919+0000 7f55aaffd640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 0x7f55940b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f559c0096c0 tx=0x7f559c009630 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:24.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:24.922+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55a0005310 con 0x7f55ac1094a0 2024-09-21T03:43:24.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:24 smithi148 ceph-mon[34651]: pgmap v627: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:25.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.136+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55ac02e640 con 0x7f55ac1094a0 2024-09-21T03:43:25.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.136+0000 7f5593fff640 1 -- 172.21.15.102:0/3079419199 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f55a00adb70 con 0x7f55ac1094a0 2024-09-21T03:43:25.139 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:43:25.139 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:43:25.139 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.138+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 msgr2=0x7f55940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.138+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 0x7f55940b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f559c0096c0 tx=0x7f559c009630 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 msgr2=0x7f55ac19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f55a000d750 tx=0x7f55a000dc10 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 shutdown_connections 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f55940b6680 0x7f55940b8b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ac1094a0 0x7f55ac19aba0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f55ac109df0 0x7f55ac19fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 --2- 172.21.15.102:0/3079419199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55ac103b60 0x7f55ac19a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:25.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 >> 172.21.15.102:0/3079419199 conn(0x7f55ac07b850 msgr2=0x7f55ac107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:25.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 shutdown_connections 2024-09-21T03:43:25.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:25.139+0000 7f55b1485640 1 -- 172.21.15.102:0/3079419199 wait complete. 2024-09-21T03:43:25.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:25 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3079419199' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:25.924 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:25 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3079419199' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:25.956 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:43:25.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:25 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3079419199' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:43:26.206 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:26.569 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:26 smithi102 ceph-mon[31392]: pgmap v628: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 -- 172.21.15.102:0/1747089856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc108d00 msgr2=0x7f5bcc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/1747089856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc108d00 0x7f5bcc10f530 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009ca0 tx=0x7f5bc402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 -- 172.21.15.102:0/1747089856 shutdown_connections 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/1747089856 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc108d00 0x7f5bcc10f530 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/1747089856 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/1747089856 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc102a70 0x7f5bcc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 -- 172.21.15.102:0/1747089856 >> 172.21.15.102:0/1747089856 conn(0x7f5bcc079730 msgr2=0x7f5bcc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 -- 172.21.15.102:0/1747089856 shutdown_connections 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.658+0000 7f5bd18ad640 1 -- 172.21.15.102:0/1747089856 wait complete. 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 Processor -- start 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 -- start start 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc102a70 0x7f5bcc19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc108d00 0x7f5bcc19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc113bb0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc113a30 con 0x7f5bcc102a70 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bd18ad640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc113d30 con 0x7f5bcc108d00 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.659+0000 7f5bc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39378/0 (socket says 172.21.15.102:39378) 2024-09-21T03:43:26.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 -- 172.21.15.102:0/27750369 learned_addr learned my addr 172.21.15.102:0/27750369 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc102a70 0x7f5bcc19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc108d00 0x7f5bcc19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 -- 172.21.15.102:0/27750369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc108d00 msgr2=0x7f5bcc19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc108d00 0x7f5bcc19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 -- 172.21.15.102:0/27750369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc102a70 msgr2=0x7f5bcc19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc102a70 0x7f5bcc19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 -- 172.21.15.102:0/27750369 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bcc1a04d0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400c970 tx=0x7f5bb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bd08ab640 1 -- 172.21.15.102:0/27750369 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4007bb0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bd08ab640 1 -- 172.21.15.102:0/27750369 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bb4007d50 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bcc1a07c0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bd08ab640 1 -- 172.21.15.102:0/27750369 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400f450 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.660+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bcc1a6f20 con 0x7f5bcc1083b0 2024-09-21T03:43:26.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 Processor -- start 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 -- start start 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd08ab640 1 -- 172.21.15.102:0/27750369 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f5bb40046c0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8096070 0x5604c843d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c843e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5604c83b3ea0 con 0x5604c806d1b0 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5604c83a32d0 con 0x5604c8096070 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5604c83a70e0 con 0x5604c8075390 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39394/0 (socket says 172.21.15.102:39394) 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3768543931 learned_addr learned my addr 172.21.15.102:0/3768543931 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8096070 0x5604c843d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.663+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c843e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3768543931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 msgr2=0x5604c843e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c843e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3768543931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8096070 msgr2=0x5604c843d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8096070 0x5604c843d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3768543931 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c8101650 con 0x5604c806d1b0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c843e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bd08ab640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 0x7f5bb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00b760 tx=0x7f5bbc00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce213b58970f8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 0x7f5bb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bc1ffb640 1 -- 172.21.15.102:0/3768543931 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc003dd0 con 0x5604c806d1b0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bd08ab640 1 -- 172.21.15.102:0/27750369 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f5bb40e76e0 con 0x7f5bcc1083b0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bc1ffb640 1 -- 172.21.15.102:0/3768543931 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bbc015070 con 0x5604c806d1b0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.664+0000 7f5bc1ffb640 1 -- 172.21.15.102:0/3768543931 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011440 con 0x5604c806d1b0 2024-09-21T03:43:26.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3768543931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 msgr2=0x5604c843dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 0x7f5bb80b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4006010 tx=0x7f5bc4009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00b760 tx=0x7f5bbc00bc20 comp rx=0 tx=0).stop 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3768543931 shutdown_connections 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c843dbe0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c843e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3768543931 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8096070 0x5604c843d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3768543931 >> 172.21.15.102:0/3768543931 conn(0x5604c808a460 msgr2=0x5604c843b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3768543931 shutdown_connections 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3768543931 wait complete. 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.665+0000 7f5bd7e21740 1 -- start start 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 Processor -- start 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c806d1b0 0x5604c8448de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8075390 0x5604c8449320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5604c8204700 con 0x5604c8096070 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5604c833e160 con 0x5604c8075390 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5604c844be80 con 0x5604c806d1b0 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bd7e21740 10 client.0 _ll_register_callbacks cb 0x5604c83579e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39410/0 (socket says 172.21.15.102:39410) 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1933067752 learned_addr learned my addr 172.21.15.102:0/1933067752 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8075390 0x5604c8449320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c806d1b0 0x5604c8448de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c806d1b0 msgr2=0x5604c8448de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c806d1b0 0x5604c8448de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1933067752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8075390 msgr2=0x5604c8449320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8075390 0x5604c8449320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.666+0000 7f5bcb7fe640 1 -- 172.21.15.102:0/1933067752 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c836bc90 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005c70 tx=0x7f5bc402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2f76e80f91c7af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4004250 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f5bc40043f0 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bbc015070 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5bc40045f0 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bd7e21740 10 client.17475 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5604c8457b60 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bbc015070 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5bc4058030 con 0x5604c8096070 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bd7e21740 10 client.17475 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.667+0000 7f5bd7e21740 10 client.17475 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:26.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bd7e21740 20 client.17475 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:26.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c80549f0 0x5604c845b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bd7e21740 4 client.17475 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:26.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604c83b5df0 con 0x5604c80549f0 2024-09-21T03:43:26.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c80549f0 0x5604c845b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c80549f0 0x5604c845b010 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cf3d57f44bc0ef3e server_cookie=60590942697b1e26 in_seq=0 out_seq=0 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.668+0000 7f5baaffd640 10 client.17475 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5baaffd640 1 -- 172.21.15.102:0/1933067752 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604c83b5df0 con 0x5604c80549f0 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5baaffd640 10 client.17475 handle_command_reply: tid=0 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 client.17475 shutdown 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 msgr2=0x5604c84551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4005c70 tx=0x7f5bc402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 shutdown_connections 2024-09-21T03:43:26.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c80549f0 0x5604c845b010 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5baaffd640 0 client.17475 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c8096070 0x5604c84551a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c8075390 0x5604c8449320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/1933067752 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c806d1b0 0x5604c8448de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 >> 172.21.15.102:0/1933067752 conn(0x5604c808a460 msgr2=0x5604c8440830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 shutdown_connections 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.669+0000 7f5bd7e21740 1 -- 172.21.15.102:0/1933067752 wait complete. 2024-09-21T03:43:26.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.670+0000 7f5bd7e21740 20 client.17475 trim_cache size 0 max 16384 2024-09-21T03:43:26.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.682+0000 7f5bd7e21740 1 Processor -- start 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.682+0000 7f5bd7e21740 1 -- start start 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 0x5604c84492a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c8445fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1b2200 con 0x5604c806d1b0 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1afad0 con 0x5604c80549f0 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ad940 con 0x5604c8075390 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39422/0 (socket says 172.21.15.102:39422) 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 -- 172.21.15.102:0/516918121 learned_addr learned my addr 172.21.15.102:0/516918121 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 -- 172.21.15.102:0/516918121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 msgr2=0x5604c8445fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 0x5604c84492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c8445fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c8445fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 -- 172.21.15.102:0/516918121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 msgr2=0x5604c84492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 0x5604c84492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 -- 172.21.15.102:0/516918121 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604c84472e0 con 0x5604c806d1b0 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 0x5604c84492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c8445fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000c00 tx=0x7f5bb40ad380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9690c7be9c129e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.683+0000 7f5bc17fa640 1 -- 172.21.15.102:0/516918121 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb401d040 con 0x5604c806d1b0 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bc17fa640 1 -- 172.21.15.102:0/516918121 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bb40adbf0 con 0x5604c806d1b0 2024-09-21T03:43:26.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bc17fa640 1 -- 172.21.15.102:0/516918121 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40a8e40 con 0x5604c806d1b0 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 -- 172.21.15.102:0/516918121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 msgr2=0x5604c84550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4000c00 tx=0x7f5bb40ad380 comp rx=0 tx=0).stop 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 -- 172.21.15.102:0/516918121 shutdown_connections 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c806d1b0 0x5604c84550a0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c8445fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/516918121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c80549f0 0x5604c84492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 -- 172.21.15.102:0/516918121 >> 172.21.15.102:0/516918121 conn(0x5604c808a460 msgr2=0x5604c8448b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 -- 172.21.15.102:0/516918121 shutdown_connections 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.684+0000 7f5bd7e21740 1 -- 172.21.15.102:0/516918121 wait complete. 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 -- start start 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 Processor -- start 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c806d1b0 0x5604c844de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c84c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1adf90 con 0x5604c80549f0 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1af400 con 0x5604c806d1b0 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bcc1ae660 con 0x5604c8075390 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bd7e21740 10 client.0 _ll_register_callbacks cb 0x7f5bc4009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bcaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39438/0 (socket says 172.21.15.102:39438) 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3888240237 learned_addr learned my addr 172.21.15.102:0/3888240237 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:26.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c806d1b0 0x5604c844de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.685+0000 7f5bcb7fe640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c84c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 msgr2=0x5604c84c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c84c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3888240237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c806d1b0 msgr2=0x5604c844de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c806d1b0 0x5604c844de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 -- 172.21.15.102:0/3888240237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604c84c5020 con 0x5604c80549f0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bcaffd640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x5604c843c320 tx=0x7f5bbc0049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ddf16126af1d4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5baaffd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011440 con 0x5604c80549f0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f5bbc0115e0 con 0x5604c80549f0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bb40adbf0 con 0x5604c80549f0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5bbc0117e0 con 0x5604c80549f0 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bd7e21740 10 client.17481 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:26.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5604c84c61e0 con 0x5604c80549f0 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.686+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bb40adbf0 con 0x5604c80549f0 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f5bbc032030 con 0x5604c80549f0 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 10 client.17481 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 10 client.17481 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 20 client.17481 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c8096070 0x5604c84c8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 4 client.17481 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604c83b18a0 con 0x5604c8096070 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c8096070 0x5604c84c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5baaffd640 10 client.17481 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.687+0000 7f5bc3fff640 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c8096070 0x5604c84c8860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d6cb575e2499f02 server_cookie=bc22ac352027f623 in_seq=0 out_seq=0 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5baaffd640 1 -- 172.21.15.102:0/3888240237 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604c83b18a0 con 0x5604c8096070 2024-09-21T03:43:26.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5baaffd640 10 client.17481 handle_command_reply: tid=0 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 client.17481 shutdown 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 msgr2=0x5604c844d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x5604c843c320 tx=0x7f5bbc0049b0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 shutdown_connections 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x5604c8096070 0x5604c84c8860 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5604c8075390 0x5604c84c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5604c806d1b0 0x5604c844de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 --2- 172.21.15.102:0/3888240237 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5604c80549f0 0x5604c844d8d0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 >> 172.21.15.102:0/3888240237 conn(0x5604c808a460 msgr2=0x5604c843e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5baaffd640 0 client.17481 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 shutdown_connections 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 1 -- 172.21.15.102:0/3888240237 wait complete. 2024-09-21T03:43:26.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.688+0000 7f5bd7e21740 20 client.17481 trim_cache size 0 max 16384 2024-09-21T03:43:26.696 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:26.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 msgr2=0x7f5bb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 0x7f5bb80b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4006010 tx=0x7f5bc4009440 comp rx=0 tx=0).stop 2024-09-21T03:43:26.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 msgr2=0x7f5bcc19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400c970 tx=0x7f5bb400ce30 comp rx=0 tx=0).stop 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 shutdown_connections 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5bb80b6680 0x7f5bb80b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bcc1083b0 0x7f5bcc19ab00 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bcc108d00 0x7f5bcc19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 --2- 172.21.15.102:0/27750369 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bcc102a70 0x7f5bcc19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 >> 172.21.15.102:0/27750369 conn(0x7f5bcc079730 msgr2=0x7f5bcc1043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 shutdown_connections 2024-09-21T03:43:26.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:26.689+0000 7f5bd18ad640 1 -- 172.21.15.102:0/27750369 wait complete. 2024-09-21T03:43:26.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:26 smithi121 ceph-mon[34316]: pgmap v628: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:26.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:26 smithi148 ceph-mon[34651]: pgmap v628: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 7 op/s 2024-09-21T03:43:27.591 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:43:27.840 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:28.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/3308546270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 msgr2=0x7f8e581098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/3308546270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e581098b0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009900 tx=0x7f8e4802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/3308546270 shutdown_connections 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/3308546270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e581098b0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/3308546270 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 0x7f8e58110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/3308546270 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e58103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/3308546270 >> 172.21.15.102:0/3308546270 conn(0x7f8e5807b850 msgr2=0x7f8e5807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/3308546270 shutdown_connections 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/3308546270 wait complete. 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 Processor -- start 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.350+0000 7f8e5fb1d640 1 -- start start 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e5819a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 0x7f8e5819ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58113c90 con 0x7f8e581094a0 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58113b10 con 0x7f8e58103b60 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5fb1d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58113e10 con 0x7f8e58109df0 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39468/0 (socket says 172.21.15.102:39468) 2024-09-21T03:43:28.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/1636491817 learned_addr learned my addr 172.21.15.102:0/1636491817 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e5819a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 0x7f8e5819ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/1636491817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 msgr2=0x7f8e5819ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 0x7f8e5819ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/1636491817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 msgr2=0x7f8e5819a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e5819a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/1636491817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e581a0690 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e5819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.351+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005940 tx=0x7f8e48004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.352+0000 7f8e4effd640 1 -- 172.21.15.102:0/1636491817 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4803f030 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.352+0000 7f8e4effd640 1 -- 172.21.15.102:0/1636491817 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e48003cd0 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.352+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581a0920 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.352+0000 7f8e4effd640 1 -- 172.21.15.102:0/1636491817 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48035070 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.352+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e581a70e0 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.354+0000 7f8e4effd640 1 -- 172.21.15.102:0/1636491817 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f8e48042030 con 0x7f8e581094a0 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.354+0000 7f8e66091740 1 Processor -- start 2024-09-21T03:43:28.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 -- start start 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826ad070 0x557682a542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a54d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5576829caea0 con 0x5576826841b0 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5576829ba2d0 con 0x55768268c390 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e66091740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5576829be0e0 con 0x5576826ad070 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39484/0 (socket says 172.21.15.102:39484) 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/744574888 learned_addr learned my addr 172.21.15.102:0/744574888 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a54d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826ad070 0x557682a542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e4effd640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 0x7f8e440b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/744574888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826ad070 msgr2=0x557682a542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826ad070 0x557682a542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/744574888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 msgr2=0x557682a54d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a54d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/744574888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557682718650 con 0x5576826841b0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a54d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.355+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 0x7f8e440b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e4effd640 1 -- 172.21.15.102:0/1636491817 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f8e48107ad0 con 0x7f8e581094a0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400aa10 tx=0x7f8e5400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e1310f6536983e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e43fff640 1 -- 172.21.15.102:0/744574888 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54015070 con 0x5576826841b0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e43fff640 1 -- 172.21.15.102:0/744574888 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e5400cc60 con 0x5576826841b0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e43fff640 1 -- 172.21.15.102:0/744574888 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540105d0 con 0x5576826841b0 2024-09-21T03:43:28.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.356+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 0x7f8e440b8c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8e50007da0 tx=0x7f8e50004b50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- 172.21.15.102:0/744574888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 msgr2=0x557682a54800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400aa10 tx=0x7f8e5400aed0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- 172.21.15.102:0/744574888 shutdown_connections 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a54800 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a54d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 --2- 172.21.15.102:0/744574888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826ad070 0x557682a542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- 172.21.15.102:0/744574888 >> 172.21.15.102:0/744574888 conn(0x5576826a1460 msgr2=0x557682a521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- 172.21.15.102:0/744574888 shutdown_connections 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- 172.21.15.102:0/744574888 wait complete. 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.357+0000 7f8e66091740 1 -- start start 2024-09-21T03:43:28.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 Processor -- start 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a5f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576826ad070 0x557682a60370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55768281b700 con 0x55768268c390 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557682955160 con 0x5576826ad070 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x557682a62aa0 con 0x5576826841b0 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e66091740 10 client.0 _ll_register_callbacks cb 0x55768296e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39490/0 (socket says 172.21.15.102:39490) 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/2840480039 learned_addr learned my addr 172.21.15.102:0/2840480039 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576826ad070 0x557682a60370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a5f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/2840480039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 msgr2=0x557682a5f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a5f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576826ad070 msgr2=0x557682a60370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.358+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576826ad070 0x557682a60370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/2840480039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557682982c90 con 0x55768268c390 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a5f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8e480cd5e0 tx=0x7f8e481056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bf243250c7567d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48049030 con 0x55768268c390 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f8e480d6e70 con 0x55768268c390 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e5400cc60 con 0x55768268c390 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8e480cd230 con 0x55768268c390 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e66091740 10 client.17493 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:28.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557682a6e730 con 0x55768268c390 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e5400cc60 con 0x55768268c390 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.359+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8e48003800 con 0x55768268c390 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 10 client.17493 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 10 client.17493 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 20 client.17493 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55768266b9f0 0x557682a71b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 4 client.17493 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576829ccdf0 con 0x55768266b9f0 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.360+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55768266b9f0 0x557682a71b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.361+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55768266b9f0 0x557682a71b60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2753431af99c2c3 server_cookie=647c96b34d22d80f in_seq=0 out_seq=0 2024-09-21T03:43:28.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.361+0000 7f8e417fa640 10 client.17493 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:28.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e417fa640 1 -- 172.21.15.102:0/2840480039 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5576829ccdf0 con 0x55768266b9f0 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e417fa640 10 client.17493 handle_command_reply: tid=0 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 client.17493 shutdown 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 msgr2=0x557682a5fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8e480cd5e0 tx=0x7f8e481056e0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 shutdown_connections 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x55768266b9f0 0x557682a71b60 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768268c390 0x557682a5fe30 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5576826ad070 0x557682a60370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e417fa640 0 client.17493 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 --2- 172.21.15.102:0/2840480039 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a5f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 >> 172.21.15.102:0/2840480039 conn(0x5576826a1460 msgr2=0x557682a57450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 shutdown_connections 2024-09-21T03:43:28.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 1 -- 172.21.15.102:0/2840480039 wait complete. 2024-09-21T03:43:28.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.362+0000 7f8e66091740 20 client.17493 trim_cache size 0 max 16384 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.375+0000 7f8e66091740 1 Processor -- start 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.375+0000 7f8e66091740 1 -- start start 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768266b9f0 0x557682a55cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55768268c390 0x557682a51760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581b2380 con 0x5576826841b0 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581afc50 con 0x55768266b9f0 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e66091740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581adac0 con 0x55768268c390 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39496/0 (socket says 172.21.15.102:39496) 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/3844724981 learned_addr learned my addr 172.21.15.102:0/3844724981 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768266b9f0 0x557682a55cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55768268c390 0x557682a51760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/3844724981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55768268c390 msgr2=0x557682a51760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55768268c390 0x557682a51760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/3844724981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768266b9f0 msgr2=0x557682a55cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768266b9f0 0x557682a55cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 -- 172.21.15.102:0/3844724981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557682a565b0 con 0x5576826841b0 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.376+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8e4803bfd0 tx=0x7f8e480d7350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ec55402ff10fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.377+0000 7f8e437fe640 1 -- 172.21.15.102:0/3844724981 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48049070 con 0x5576826841b0 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.377+0000 7f8e437fe640 1 -- 172.21.15.102:0/3844724981 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e480d70c0 con 0x5576826841b0 2024-09-21T03:43:28.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.377+0000 7f8e437fe640 1 -- 172.21.15.102:0/3844724981 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e480c9f30 con 0x5576826841b0 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.377+0000 7f8e66091740 1 -- 172.21.15.102:0/3844724981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 msgr2=0x557682a61520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.377+0000 7f8e66091740 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f8e4803bfd0 tx=0x7f8e480d7350 comp rx=0 tx=0).stop 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 -- 172.21.15.102:0/3844724981 shutdown_connections 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5576826841b0 0x557682a61520 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55768268c390 0x557682a51760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- 172.21.15.102:0/3844724981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768266b9f0 0x557682a55cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 -- 172.21.15.102:0/3844724981 >> 172.21.15.102:0/3844724981 conn(0x5576826a1460 msgr2=0x557682a60e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 -- 172.21.15.102:0/3844724981 shutdown_connections 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 -- 172.21.15.102:0/3844724981 wait complete. 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 -- start start 2024-09-21T03:43:28.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 Processor -- start 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a64410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.378+0000 7f8e66091740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a64950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e66091740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ae110 con 0x55768266b9f0 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e66091740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581af580 con 0x55768268c390 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e66091740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8e581ae7e0 con 0x5576826841b0 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e66091740 10 client.0 _ll_register_callbacks cb 0x7f8e48032ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39502/0 (socket says 172.21.15.102:39502) 2024-09-21T03:43:28.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/995884336 learned_addr learned my addr 172.21.15.102:0/995884336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a64410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a64950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/995884336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 msgr2=0x557682a64410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a64410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 msgr2=0x557682a64950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:28.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a64950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 -- 172.21.15.102:0/995884336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557682adb6d0 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5e0ba640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a64950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e5d8b9640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400a7a0 tx=0x7f8e5400a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c165d247021eeb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e417fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54031060 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f8e540113f0 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.379+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e480d70c0 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8e54015040 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 10 client.17499 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557682adc9b0 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f8e54026420 con 0x55768266b9f0 2024-09-21T03:43:28.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f8e5401a450 con 0x55768266b9f0 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 10 client.17499 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 10 client.17499 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 20 client.17499 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5576826ad070 0x557682adedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 4 client.17499 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8e480d70c0 con 0x5576826ad070 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.380+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5576826ad070 0x557682adedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e417fa640 10 client.17499 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e5d0b8640 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5576826ad070 0x557682adedf0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d47bd050c788ee8 server_cookie=db46fe76b6bfe4d0 in_seq=0 out_seq=0 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e417fa640 1 -- 172.21.15.102:0/995884336 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8e480d70c0 con 0x5576826ad070 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e417fa640 10 client.17499 handle_command_reply: tid=0 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 client.17499 shutdown 2024-09-21T03:43:28.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 msgr2=0x557682a63ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400a7a0 tx=0x7f8e5400a210 comp rx=0 tx=0).stop 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 shutdown_connections 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x5576826ad070 0x557682adedf0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55768268c390 0x557682a64950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e417fa640 0 client.17499 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5576826841b0 0x557682a64410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 --2- 172.21.15.102:0/995884336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55768266b9f0 0x557682a63ed0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 >> 172.21.15.102:0/995884336 conn(0x5576826a1460 msgr2=0x557682a6ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 shutdown_connections 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 1 -- 172.21.15.102:0/995884336 wait complete. 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.381+0000 7f8e66091740 20 client.17499 trim_cache size 0 max 16384 2024-09-21T03:43:28.392 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 msgr2=0x7f8e440b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 0x7f8e440b8c10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8e50007da0 tx=0x7f8e50004b50 comp rx=0 tx=0).stop 2024-09-21T03:43:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 msgr2=0x7f8e5819acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005940 tx=0x7f8e48004360 comp rx=0 tx=0).stop 2024-09-21T03:43:28.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 shutdown_connections 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f8e440b6700 0x7f8e440b8c10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e581094a0 0x7f8e5819acc0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8e58109df0 0x7f8e5819ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 --2- 172.21.15.102:0/1636491817 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8e58103b60 0x7f8e5819a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 >> 172.21.15.102:0/1636491817 conn(0x7f8e5807b850 msgr2=0x7f8e58107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 shutdown_connections 2024-09-21T03:43:28.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:28.382+0000 7f8e5fb1d640 1 -- 172.21.15.102:0/1636491817 wait complete. 2024-09-21T03:43:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:28 smithi121 ceph-mon[34316]: pgmap v629: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:43:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:28 smithi102 ceph-mon[31392]: pgmap v629: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:43:28.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:28 smithi148 ceph-mon[34651]: pgmap v629: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 7 op/s 2024-09-21T03:43:29.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:43:29.404 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 -- 172.21.15.102:0/2157821012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80108cf0 msgr2=0x7f9d8010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 --2- 172.21.15.102:0/2157821012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80108cf0 0x7f9d8010f520 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009ca0 tx=0x7f9d7802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 -- 172.21.15.102:0/2157821012 shutdown_connections 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 --2- 172.21.15.102:0/2157821012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80108cf0 0x7f9d8010f520 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 --2- 172.21.15.102:0/2157821012 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d801083a0 0x7f9d801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 --2- 172.21.15.102:0/2157821012 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d80102a60 0x7f9d80102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 -- 172.21.15.102:0/2157821012 >> 172.21.15.102:0/2157821012 conn(0x7f9d80079730 msgr2=0x7f9d80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 -- 172.21.15.102:0/2157821012 shutdown_connections 2024-09-21T03:43:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.930+0000 7f9d85299640 1 -- 172.21.15.102:0/2157821012 wait complete. 2024-09-21T03:43:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 Processor -- start 2024-09-21T03:43:29.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 -- start start 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d801083a0 0x7f9d801996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d80108cf0 0x7f9d80199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d80112b00 con 0x7f9d80102a60 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d80112980 con 0x7f9d80108cf0 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d85299640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d80112c80 con 0x7f9d801083a0 2024-09-21T03:43:29.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.931+0000 7f9d7effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39530/0 (socket says 172.21.15.102:39530) 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 -- 172.21.15.102:0/1550988734 learned_addr learned my addr 172.21.15.102:0/1550988734 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d80108cf0 0x7f9d80199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d801083a0 0x7f9d801996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 -- 172.21.15.102:0/1550988734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d801083a0 msgr2=0x7f9d801996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d801083a0 0x7f9d801996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 -- 172.21.15.102:0/1550988734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d80108cf0 msgr2=0x7f9d80199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d80108cf0 0x7f9d80199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 -- 172.21.15.102:0/1550988734 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d801a8810 con 0x7f9d80102a60 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000b4a0 tx=0x7f9d7000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d67fff640 1 -- 172.21.15.102:0/1550988734 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70014070 con 0x7f9d80102a60 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d801a8b00 con 0x7f9d80102a60 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d67fff640 1 -- 172.21.15.102:0/1550988734 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d70010ae0 con 0x7f9d80102a60 2024-09-21T03:43:29.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d67fff640 1 -- 172.21.15.102:0/1550988734 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d70017ce0 con 0x7f9d80102a60 2024-09-21T03:43:29.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.932+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d801a9040 con 0x7f9d80102a60 2024-09-21T03:43:29.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 Processor -- start 2024-09-21T03:43:29.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 -- start start 2024-09-21T03:43:29.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d67fff640 1 -- 172.21.15.102:0/1550988734 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f9d70017070 con 0x7f9d80102a60 2024-09-21T03:43:29.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc4dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbbc3ea0 con 0x55b1bb885390 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbbb32d0 con 0x55b1bb8a6070 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbbb70e0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d7e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc4dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d7e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc4dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39544/0 (socket says 172.21.15.102:39544) 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39804/0 (socket says 172.21.15.102:39804) 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.935+0000 7f9d7e7fc640 1 -- 172.21.15.102:0/1582962753 learned_addr learned my addr 172.21.15.102:0/1582962753 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/1582962753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 msgr2=0x55b1bbc4d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/1582962753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 msgr2=0x55b1bbc4dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc4dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/1582962753 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bb911650 con 0x55b1bb8a6070 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d67fff640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 0x7f9d680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006010 tx=0x7f9d7802f4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc6d6eb5774cb607 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 0x7f9d680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d67fff640 1 -- 172.21.15.102:0/1550988734 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9d700e6d40 con 0x7f9d80102a60 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d657fa640 1 -- 172.21.15.102:0/1582962753 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78031e40 con 0x55b1bb8a6070 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d657fa640 1 -- 172.21.15.102:0/1582962753 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d78036030 con 0x55b1bb8a6070 2024-09-21T03:43:29.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.936+0000 7f9d657fa640 1 -- 172.21.15.102:0/1582962753 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78004370 con 0x55b1bb8a6070 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 -- 172.21.15.102:0/1582962753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 msgr2=0x55b1bbc4d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d7effd640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 0x7f9d680b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d700e4500 tx=0x7f9d700046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9d78006010 tx=0x7f9d7802f4c0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 -- 172.21.15.102:0/1582962753 shutdown_connections 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc4dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/1582962753 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc4d2c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 -- 172.21.15.102:0/1582962753 >> 172.21.15.102:0/1582962753 conn(0x55b1bb89a460 msgr2=0x55b1bbc4b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 -- 172.21.15.102:0/1582962753 shutdown_connections 2024-09-21T03:43:29.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.937+0000 7f9d8b80d740 1 -- 172.21.15.102:0/1582962753 wait complete. 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 -- start start 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 Processor -- start 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc58920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb885390 0x55b1bbc58e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1bba14700 con 0x55b1bb8a6070 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbb4e160 con 0x55b1bb885390 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55b1bbc5b8c0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d8b80d740 10 client.0 _ll_register_callbacks cb 0x55b1bbb679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39548/0 (socket says 172.21.15.102:39548) 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/483774800 learned_addr learned my addr 172.21.15.102:0/483774800 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc58920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.938+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb885390 0x55b1bbc58e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 msgr2=0x55b1bbc58920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc58920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/483774800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb885390 msgr2=0x55b1bbc58e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb885390 0x55b1bbc58e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/483774800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bbb7bc90 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bf0 tx=0x7f9d78031aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697134e3e8cbaa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78058060 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9d78003970 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d78036030 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d78004840 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d8b80d740 10 client.17511 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b1bbc67570 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.939+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d78036030 con 0x55b1bb8a6070 2024-09-21T03:43:29.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d78050070 con 0x55b1bb8a6070 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 10 client.17511 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 10 client.17511 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 20 client.17511 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb8649f0 0x55b1bbc6a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 4 client.17511 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1bbbc5df0 con 0x55b1bb8649f0 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb8649f0 0x55b1bbc6a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d62ff5640 10 client.17511 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.940+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb8649f0 0x55b1bbc6a8d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=811f232841fff18d server_cookie=1bd348d129569f41 in_seq=0 out_seq=0 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d62ff5640 1 -- 172.21.15.102:0/483774800 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1bbbc5df0 con 0x55b1bb8649f0 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d62ff5640 10 client.17511 handle_command_reply: tid=0 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 client.17511 shutdown 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 msgr2=0x55b1bbc64bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009bf0 tx=0x7f9d78031aa0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 shutdown_connections 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb8649f0 0x55b1bbc6a8d0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64bb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb885390 0x55b1bbc58e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/483774800 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc58920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 >> 172.21.15.102:0/483774800 conn(0x55b1bb89a460 msgr2=0x55b1bbc504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d62ff5640 0 client.17511 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 shutdown_connections 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.941+0000 7f9d8b80d740 1 -- 172.21.15.102:0/483774800 wait complete. 2024-09-21T03:43:29.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.942+0000 7f9d8b80d740 20 client.17511 trim_cache size 0 max 16384 2024-09-21T03:43:29.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.954+0000 7f9d8b80d740 1 Processor -- start 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.954+0000 7f9d8b80d740 1 -- start start 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 0x55b1bbc5a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801b43d0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801b1ca0 con 0x55b1bb8a6070 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801afb10 con 0x55b1bb885390 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39550/0 (socket says 172.21.15.102:39550) 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/622250417 learned_addr learned my addr 172.21.15.102:0/622250417 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 0x55b1bbc5a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/622250417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 msgr2=0x55b1bbc5a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 0x55b1bbc5a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/622250417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 msgr2=0x55b1bbc64ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 -- 172.21.15.102:0/622250417 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bbc4f5b0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 0x55b1bbc5a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9d7802ade0 tx=0x7f9d78031bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb062e26b9a764 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d64ff9640 1 -- 172.21.15.102:0/622250417 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78058040 con 0x55b1bb87d1b0 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d64ff9640 1 -- 172.21.15.102:0/622250417 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d78036040 con 0x55b1bb87d1b0 2024-09-21T03:43:29.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.955+0000 7f9d64ff9640 1 -- 172.21.15.102:0/622250417 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d78030ca0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 -- 172.21.15.102:0/622250417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 msgr2=0x55b1bbc4edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f9d7802ade0 tx=0x7f9d78031bc0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 -- 172.21.15.102:0/622250417 shutdown_connections 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb8a6070 0x55b1bbc64ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb885390 0x55b1bbc5a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/622250417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc4edc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 -- 172.21.15.102:0/622250417 >> 172.21.15.102:0/622250417 conn(0x55b1bb89a460 msgr2=0x55b1bbc571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 -- 172.21.15.102:0/622250417 shutdown_connections 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.956+0000 7f9d8b80d740 1 -- 172.21.15.102:0/622250417 wait complete. 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 -- start start 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 Processor -- start 2024-09-21T03:43:29.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc5cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 0x55b1bbc5d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801b0160 con 0x55b1bb885390 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801b15d0 con 0x55b1bb87d1b0 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801b0830 con 0x55b1bb8a6070 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d8b80d740 10 client.0 _ll_register_callbacks cb 0x7f9d7400c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39564/0 (socket says 172.21.15.102:39564) 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 -- 172.21.15.102:0/3811356686 learned_addr learned my addr 172.21.15.102:0/3811356686 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc5cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 0x55b1bbc5d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 -- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 msgr2=0x55b1bbc5d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 0x55b1bbc5d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 -- 172.21.15.102:0/3811356686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb87d1b0 msgr2=0x55b1bbc5cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc5cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7e7fc640 1 -- 172.21.15.102:0/3811356686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bbcd4120 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.957+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 0x55b1bbc5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d7e7fc640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c750 tx=0x7f9d74010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95913ed18f23c205 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74027060 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9d7401c880 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d78036040 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d7401ca80 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 10 client.17517 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b1bbcd5430 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9d78036040 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9d7402a3f0 con 0x55b1bb885390 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 10 client.17517 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:29.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 20 client.17517 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb839da0 0x55b1bbcd7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 4 client.17517 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.958+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b1bbbc18a0 con 0x55b1bb839da0 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb839da0 0x55b1bbcd7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d7f7fe640 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb839da0 0x55b1bbcd7bd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e674d29865ae81c server_cookie=6e2a364171f8ecae in_seq=0 out_seq=0 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d62ff5640 10 client.17517 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d62ff5640 1 -- 172.21.15.102:0/3811356686 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b1bbbc18a0 con 0x55b1bb839da0 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d62ff5640 10 client.17517 handle_command_reply: tid=0 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d8b80d740 1 client.17517 shutdown 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 msgr2=0x55b1bbc5d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.959+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f9d7400c750 tx=0x7f9d74010800 comp rx=0 tx=0).stop 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 shutdown_connections 2024-09-21T03:43:29.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55b1bb839da0 0x55b1bbcd7bd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b1bb885390 0x55b1bbc5d130 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55b1bb8a6070 0x55b1bbc5d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 --2- 172.21.15.102:0/3811356686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b1bb87d1b0 0x55b1bbc5cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 >> 172.21.15.102:0/3811356686 conn(0x55b1bb89a460 msgr2=0x55b1bbc5a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d62ff5640 0 client.17517 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 shutdown_connections 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 1 -- 172.21.15.102:0/3811356686 wait complete. 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d8b80d740 20 client.17517 trim_cache size 0 max 16384 2024-09-21T03:43:29.966 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 msgr2=0x7f9d680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 0x7f9d680b8b90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d700e4500 tx=0x7f9d700046c0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 msgr2=0x7f9d80199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000b4a0 tx=0x7f9d7000b960 comp rx=0 tx=0).stop 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 shutdown_connections 2024-09-21T03:43:29.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9d680b6680 0x7f9d680b8b90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d80108cf0 0x7f9d80199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9d801083a0 0x7f9d801996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.960+0000 7f9d85299640 1 --2- 172.21.15.102:0/1550988734 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d80102a60 0x7f9d80199160 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.961+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 >> 172.21.15.102:0/1550988734 conn(0x7f9d80079730 msgr2=0x7f9d801051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.961+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 shutdown_connections 2024-09-21T03:43:29.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:29.961+0000 7f9d85299640 1 -- 172.21.15.102:0/1550988734 wait complete. 2024-09-21T03:43:30.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:30 smithi102 ceph-mon[31392]: pgmap v630: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:30.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:30 smithi121 ceph-mon[34316]: pgmap v630: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:30.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:30 smithi148 ceph-mon[34651]: pgmap v630: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:31.761 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T03:43:31.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T03:43:32.022 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2560251429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14103b60 msgr2=0x7f9e14103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2560251429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14103b60 0x7f9e14103f70 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009900 tx=0x7f9e0402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2560251429 shutdown_connections 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2560251429 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14109df0 0x7f9e14110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2560251429 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 0x7f9e141098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2560251429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14103b60 0x7f9e14103f70 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2560251429 >> 172.21.15.102:0/2560251429 conn(0x7f9e1407b850 msgr2=0x7f9e1407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2560251429 shutdown_connections 2024-09-21T03:43:32.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2560251429 wait complete. 2024-09-21T03:43:32.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.501+0000 7f9e1a2e3640 1 Processor -- start 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 -- start start 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 0x7f9e1419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 0x7f9e1419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14113c50 con 0x7f9e14109df0 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14113ad0 con 0x7f9e141094a0 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e1a2e3640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14113dd0 con 0x7f9e14103b60 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e18880640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e18880640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39574/0 (socket says 172.21.15.102:39574) 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e18880640 1 -- 172.21.15.102:0/2955382694 learned_addr learned my addr 172.21.15.102:0/2955382694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:32.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e137fe640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 0x7f9e1419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.502+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 0x7f9e1419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 -- 172.21.15.102:0/2955382694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 msgr2=0x7f9e1419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 0x7f9e1419a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 -- 172.21.15.102:0/2955382694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 msgr2=0x7f9e1419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 0x7f9e1419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 -- 172.21.15.102:0/2955382694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e141a0530 con 0x7f9e14109df0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 0x7f9e1419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e18880640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00cad0 tx=0x7f9e0c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e117fa640 1 -- 172.21.15.102:0/2955382694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00ad60 con 0x7f9e14109df0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e141a0820 con 0x7f9e14109df0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e117fa640 1 -- 172.21.15.102:0/2955382694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e0c005020 con 0x7f9e14109df0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e117fa640 1 -- 172.21.15.102:0/2955382694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00f690 con 0x7f9e14109df0 2024-09-21T03:43:32.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.503+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e141a6f80 con 0x7f9e14109df0 2024-09-21T03:43:32.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.506+0000 7f9e20857740 1 Processor -- start 2024-09-21T03:43:32.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 -- start start 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 0x5562d7ceb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 0x5562d7ce8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7ce8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7c5ae60 con 0x5562d793d350 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5562d7c4a290 con 0x5562d7914490 2024-09-21T03:43:32.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e20857740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5562d7c4e0a0 con 0x5562d791c670 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e137fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 0x5562d7ceb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e117fa640 1 -- 172.21.15.102:0/2955382694 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f9e0c0051d0 con 0x7f9e14109df0 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 0x5562d7ce8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 0x5562d7ce8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.102:39858/0 (socket says 172.21.15.102:39858) 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.507+0000 7f9e13fff640 1 -- 172.21.15.102:0/3208407156 learned_addr learned my addr 172.21.15.102:0/3208407156 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.508+0000 7f9e137fe640 1 -- 172.21.15.102:0/3208407156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 msgr2=0x5562d7ce8d80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.508+0000 7f9e137fe640 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7ce8d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.508+0000 7f9e137fe640 1 -- 172.21.15.102:0/3208407156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 msgr2=0x5562d7ce8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.508+0000 7f9e137fe640 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 0x5562d7ce8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.508+0000 7f9e137fe640 1 -- 172.21.15.102:0/3208407156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d79a8930 con 0x5562d793d350 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e137fe640 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 0x5562d7ceb1f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9e14109110 tx=0x7f9dfc009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5fece4e9f3d29c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e0a7fc640 1 -- 172.21.15.102:0/3208407156 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc017070 con 0x5562d793d350 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e0a7fc640 1 -- 172.21.15.102:0/3208407156 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9dfc013470 con 0x5562d793d350 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e0a7fc640 1 -- 172.21.15.102:0/3208407156 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dfc0125d0 con 0x5562d793d350 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e117fa640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 0x7f9e000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.509+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 0x7f9e000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e117fa640 1 -- 172.21.15.102:0/2955382694 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9e0c0e77c0 con 0x7f9e14109df0 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 -- 172.21.15.102:0/3208407156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 msgr2=0x5562d7ceb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 0x7f9e000b8c10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5562d7ce74c0 tx=0x7f9e04032c00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 0x5562d7ceb1f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9e14109110 tx=0x7f9dfc009dd0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 -- 172.21.15.102:0/3208407156 shutdown_connections 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7ce8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d7914490 0x5562d7ce8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 --2- 172.21.15.102:0/3208407156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d793d350 0x5562d7ceb1f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 -- 172.21.15.102:0/3208407156 >> 172.21.15.102:0/3208407156 conn(0x5562d7931740 msgr2=0x5562d7ce6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 -- 172.21.15.102:0/3208407156 shutdown_connections 2024-09-21T03:43:32.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.510+0000 7f9e20857740 1 -- 172.21.15.102:0/3208407156 wait complete. 2024-09-21T03:43:32.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 -- start start 2024-09-21T03:43:32.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 Processor -- start 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7cf9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d793d350 0x5562d7d046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7aab890 con 0x5562d7914490 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5562d7be4d40 con 0x5562d793d350 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x5562d7cfb3a0 con 0x5562d791c670 2024-09-21T03:43:32.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.511+0000 7f9e20857740 10 client.0 _ll_register_callbacks cb 0x5562d7c48c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39604/0 (socket says 172.21.15.102:39604) 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 -- 172.21.15.102:0/1091244689 learned_addr learned my addr 172.21.15.102:0/1091244689 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e137fe640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7cf9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e18880640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d793d350 0x5562d7d046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 -- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 msgr2=0x5562d7cf9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7cf9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 -- 172.21.15.102:0/1091244689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d793d350 msgr2=0x5562d7d046d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d793d350 0x5562d7d046d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 -- 172.21.15.102:0/1091244689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d7d04c90 con 0x5562d7914490 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e13fff640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9e04031940 tx=0x7f9e0402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53feaeee9b23f932 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0404c070 con 0x5562d7914490 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9e04004250 con 0x5562d7914490 2024-09-21T03:43:32.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.512+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dfc013470 con 0x5562d7914490 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e04058050 con 0x5562d7914490 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 10 client.17529 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5562d7d075c0 con 0x5562d7914490 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9dfc013470 con 0x5562d7914490 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e0403c600 con 0x5562d7914490 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 10 client.17529 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 10 client.17529 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 20 client.17529 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78fbcd0 0x5562d7d0aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 4 client.17529 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562d7c5cdb0 con 0x5562d78fbcd0 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.513+0000 7f9e137fe640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78fbcd0 0x5562d7d0aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.514+0000 7f9df37fe640 10 client.17529 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:32.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.514+0000 7f9e137fe640 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78fbcd0 0x5562d7d0aae0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13a3bb1e765525 server_cookie=dc176d6d9bc85e0c in_seq=0 out_seq=0 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9df37fe640 1 -- 172.21.15.102:0/1091244689 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562d7c5cdb0 con 0x5562d78fbcd0 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9df37fe640 10 client.17529 handle_command_reply: tid=0 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 client.17529 shutdown 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 msgr2=0x5562d7cf8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9e04031940 tx=0x7f9e0402a410 comp rx=0 tx=0).stop 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 shutdown_connections 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d793d350 0x5562d7d046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d791c670 0x5562d7cf9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78fbcd0 0x5562d7d0aae0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 --2- 172.21.15.102:0/1091244689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7cf8bd0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9df37fe640 0 client.17529 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 >> 172.21.15.102:0/1091244689 conn(0x5562d7931740 msgr2=0x5562d7ceba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 shutdown_connections 2024-09-21T03:43:32.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 1 -- 172.21.15.102:0/1091244689 wait complete. 2024-09-21T03:43:32.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.515+0000 7f9e20857740 20 client.17529 trim_cache size 0 max 16384 2024-09-21T03:43:32.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 Processor -- start 2024-09-21T03:43:32.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 -- start start 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7cf8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7cf6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141b0170 con 0x5562d7914490 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ada40 con 0x5562d791c670 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e20857740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ab8b0 con 0x5562d793d350 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.533+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39614/0 (socket says 172.21.15.102:39614) 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 -- 172.21.15.102:0/5571954 learned_addr learned my addr 172.21.15.102:0/5571954 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e18880640 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7cf6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 -- 172.21.15.102:0/5571954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 msgr2=0x5562d7cf6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7cf6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 -- 172.21.15.102:0/5571954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 msgr2=0x5562d7cf8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7cf8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 -- 172.21.15.102:0/5571954 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7cf9920 con 0x5562d7914490 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e18880640 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7cf6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e13fff640 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9e0403ca50 tx=0x7f9e04005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f8aea8834374f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e09ffb640 1 -- 172.21.15.102:0/5571954 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e04061070 con 0x5562d7914490 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e09ffb640 1 -- 172.21.15.102:0/5571954 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e04004250 con 0x5562d7914490 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.534+0000 7f9e09ffb640 1 -- 172.21.15.102:0/5571954 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0404c040 con 0x5562d7914490 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- 172.21.15.102:0/5571954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 msgr2=0x5562d7d045d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9e0403ca50 tx=0x7f9e04005780 comp rx=0 tx=0).stop 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- 172.21.15.102:0/5571954 shutdown_connections 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7cf6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7cf8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 --2- 172.21.15.102:0/5571954 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d045d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- 172.21.15.102:0/5571954 >> 172.21.15.102:0/5571954 conn(0x5562d7931740 msgr2=0x5562d7cf9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- 172.21.15.102:0/5571954 shutdown_connections 2024-09-21T03:43:32.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- 172.21.15.102:0/5571954 wait complete. 2024-09-21T03:43:32.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.535+0000 7f9e20857740 1 -- start start 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 Processor -- start 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7d00d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7d0f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141abf00 con 0x5562d7914490 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ad370 con 0x5562d791c670 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141ac5d0 con 0x5562d793d350 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e20857740 10 client.0 _ll_register_callbacks cb 0x7f9e04040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e13fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39620/0 (socket says 172.21.15.102:39620) 2024-09-21T03:43:32.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e13fff640 1 -- 172.21.15.102:0/2881537773 learned_addr learned my addr 172.21.15.102:0/2881537773 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e137fe640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7d00d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.536+0000 7f9e18880640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7d0f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 -- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 msgr2=0x5562d7d0f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7d0f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 -- 172.21.15.102:0/2881537773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 msgr2=0x5562d7d00d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7d00d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 -- 172.21.15.102:0/2881537773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d7cf9570 con 0x5562d7914490 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e13fff640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005f70 tx=0x7f9e0403ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daf4c5e08c0efbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0406a060 con 0x5562d7914490 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f9e04003b40 con 0x5562d7914490 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e04004250 con 0x5562d7914490 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9e04061040 con 0x5562d7914490 2024-09-21T03:43:32.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e20857740 10 client.17535 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5562d7d10850 con 0x5562d7914490 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9e04004250 con 0x5562d7914490 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.537+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f9e040659d0 con 0x5562d7914490 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 10 client.17535 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 20 client.17535 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78d1080 0x5562d7d784c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 4 client.17535 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5562d7c58860 con 0x5562d78d1080 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e137fe640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78d1080 0x5562d7d784c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9df37fe640 10 client.17535 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.538+0000 7f9e137fe640 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78d1080 0x5562d7d784c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=943fa2436a6fd59f server_cookie=10e76f44d0d6cbf0 in_seq=0 out_seq=0 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9df37fe640 1 -- 172.21.15.102:0/2881537773 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5562d7c58860 con 0x5562d78d1080 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9df37fe640 10 client.17535 handle_command_reply: tid=0 2024-09-21T03:43:32.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 client.17535 shutdown 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 msgr2=0x5562d7d00830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9e04005f70 tx=0x7f9e0403ce30 comp rx=0 tx=0).stop 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 shutdown_connections 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5562d793d350 0x5562d7d0f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5562d791c670 0x5562d7d00d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5562d78d1080 0x5562d7d784c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 --2- 172.21.15.102:0/2881537773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7914490 0x5562d7d00830 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 >> 172.21.15.102:0/2881537773 conn(0x5562d7931740 msgr2=0x5562d7cf9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9df37fe640 0 client.17535 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 shutdown_connections 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.540+0000 7f9e20857740 1 -- 172.21.15.102:0/2881537773 wait complete. 2024-09-21T03:43:32.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e20857740 20 client.17535 trim_cache size 0 max 16384 2024-09-21T03:43:32.547 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:32.547 INFO:teuthology.orchestra.run.smithi102.stdout: "return_code": 0, 2024-09-21T03:43:32.547 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_tag": "048694bc-2fb0-4e2a-a900-c28f605e0da9", 2024-09-21T03:43:32.547 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": "asynchronous" 2024-09-21T03:43:32.547 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 msgr2=0x7f9e000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 0x7f9e000b8c10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5562d7ce74c0 tx=0x7f9e04032c00 comp rx=0 tx=0).stop 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 msgr2=0x7f9e1419fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00cad0 tx=0x7f9e0c00ced0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 shutdown_connections 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f9e000b6700 0x7f9e000b8c10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e14109df0 0x7f9e1419fe00 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9e141094a0 0x7f9e1419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 --2- 172.21.15.102:0/2955382694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9e14103b60 0x7f9e1419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:32.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 >> 172.21.15.102:0/2955382694 conn(0x7f9e1407b850 msgr2=0x7f9e141074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:32.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 shutdown_connections 2024-09-21T03:43:32.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:32.541+0000 7f9e1a2e3640 1 -- 172.21.15.102:0/2955382694 wait complete. 2024-09-21T03:43:32.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:32 smithi102 ceph-mon[31392]: pgmap v631: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:32.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:32 smithi121 ceph-mon[34316]: pgmap v631: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:32.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:32 smithi148 ceph-mon[34651]: pgmap v631: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:33.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:43:33.499 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:43:33.777 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:33 smithi102 ceph-mon[31392]: scrub queued for path: / 2024-09-21T03:43:33.777 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:33 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.777 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:33 smithi102 ceph-mon[31392]: scrub summary: active paths [/] 2024-09-21T03:43:33.777 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:33 smithi102 ceph-mon[31392]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:33 smithi121 ceph-mon[34316]: scrub queued for path: / 2024-09-21T03:43:33.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:33 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:33 smithi121 ceph-mon[34316]: scrub summary: active paths [/] 2024-09-21T03:43:33.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:33 smithi121 ceph-mon[34316]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 -- 172.21.15.102:0/3369679997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8107b80 msgr2=0x7ffae8107f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/3369679997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8107b80 0x7ffae8107f90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 -- 172.21.15.102:0/3369679997 shutdown_connections 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/3369679997 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8107b80 0x7ffae8107f90 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/3369679997 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae81084d0 0x7ffae810ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/3369679997 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae8102240 0x7ffae8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.988+0000 7ffaeff7c640 1 -- 172.21.15.102:0/3369679997 >> 172.21.15.102:0/3369679997 conn(0x7ffae8079f90 msgr2=0x7ffae807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:33.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- 172.21.15.102:0/3369679997 shutdown_connections 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- 172.21.15.102:0/3369679997 wait complete. 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 Processor -- start 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- start start 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae8107b80 0x7ffae8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae81084d0 0x7ffae819dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8111a20 con 0x7ffae8102240 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81118a0 con 0x7ffae81084d0 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.989+0000 7ffaeff7c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae8111ba0 con 0x7ffae8107b80 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52958/0 (socket says 172.21.15.102:52958) 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 -- 172.21.15.102:0/1059275873 learned_addr learned my addr 172.21.15.102:0/1059275873 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:33.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaed517640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae8107b80 0x7ffae8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaee519640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae81084d0 0x7ffae819dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 -- 172.21.15.102:0/1059275873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae8107b80 msgr2=0x7ffae8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae8107b80 0x7ffae8198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 -- 172.21.15.102:0/1059275873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae81084d0 msgr2=0x7ffae819dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae81084d0 0x7ffae819dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 -- 172.21.15.102:0/1059275873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae819e400 con 0x7ffae8102240 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ffae400d950 tx=0x7ffae400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffadeffd640 1 -- 172.21.15.102:0/1059275873 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4017070 con 0x7ffae8102240 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae819e6f0 con 0x7ffae8102240 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffadeffd640 1 -- 172.21.15.102:0/1059275873 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffae4009c30 con 0x7ffae8102240 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.990+0000 7ffadeffd640 1 -- 172.21.15.102:0/1059275873 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae400f6b0 con 0x7ffae8102240 2024-09-21T03:43:33.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.991+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae81a4e50 con 0x7ffae8102240 2024-09-21T03:43:33.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:33 smithi148 ceph-mon[34651]: scrub queued for path: / 2024-09-21T03:43:33.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:33 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:33 smithi148 ceph-mon[34651]: scrub summary: active paths [/] 2024-09-21T03:43:33.996 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:33 smithi148 ceph-mon[34651]: scrub summary: idle+waiting paths [/] 2024-09-21T03:43:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.993+0000 7ffaf64f0740 1 Processor -- start 2024-09-21T03:43:33.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.993+0000 7ffaf64f0740 1 -- start start 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.993+0000 7ffadeffd640 1 -- 172.21.15.102:0/1059275873 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ffae40109c0 con 0x7ffae8102240 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e5a7070 0x55af7e94e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e57e1b0 0x55af7e94e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af7e8c4e50 con 0x55af7e586390 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55af7e8b4280 con 0x55af7e57e1b0 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55af7e8b8090 con 0x55af7e5a7070 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaee519640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e5a7070 0x55af7e94e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52968/0 (socket says 172.21.15.102:52968) 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 -- 172.21.15.102:0/1552204726 learned_addr learned my addr 172.21.15.102:0/1552204726 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e57e1b0 0x55af7e94e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 -- 172.21.15.102:0/1552204726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e5a7070 msgr2=0x55af7e94e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:33.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e5a7070 0x55af7e94e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 -- 172.21.15.102:0/1552204726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e57e1b0 msgr2=0x55af7e94e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e57e1b0 0x55af7e94e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.994+0000 7ffaed517640 1 -- 172.21.15.102:0/1552204726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7e612650 con 0x55af7e586390 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffaed517640 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005940 tx=0x7ffad8032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f3d2279d0654ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffadeffd640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 0x7ffad40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffad3fff640 1 -- 172.21.15.102:0/1552204726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad803f070 con 0x55af7e586390 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffaee519640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 0x7ffad40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffad3fff640 1 -- 172.21.15.102:0/1552204726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffad8004030 con 0x55af7e586390 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffad3fff640 1 -- 172.21.15.102:0/1552204726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8035070 con 0x55af7e586390 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.995+0000 7ffadeffd640 1 -- 172.21.15.102:0/1059275873 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7ffae40e7470 con 0x7ffae8102240 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1552204726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 msgr2=0x55af7e94ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaee519640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 0x7ffad40b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffae0005fd0 tx=0x7ffae0011040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005940 tx=0x7ffad8032bd0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1552204726 shutdown_connections 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e94ecf0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e57e1b0 0x55af7e94e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1552204726 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e5a7070 0x55af7e94e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1552204726 >> 172.21.15.102:0/1552204726 conn(0x55af7e59b460 msgr2=0x55af7e94c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1552204726 shutdown_connections 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1552204726 wait complete. 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 -- start start 2024-09-21T03:43:34.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.996+0000 7ffaf64f0740 1 Processor -- start 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e95bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e95c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af7e715700 con 0x55af7e57e1b0 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55af7e84f110 con 0x55af7e5a7070 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55af7e95eb50 con 0x55af7e586390 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaf64f0740 10 client.0 _ll_register_callbacks cb 0x55af7e868990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:34.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52984/0 (socket says 172.21.15.102:52984) 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaedd18640 1 -- 172.21.15.102:0/1696994676 learned_addr learned my addr 172.21.15.102:0/1696994676 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaed517640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e95bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaee519640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e95c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaedd18640 1 -- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 msgr2=0x55af7e95bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.997+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e95bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaedd18640 1 -- 172.21.15.102:0/1696994676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 msgr2=0x55af7e95c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e95c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaedd18640 1 -- 172.21.15.102:0/1696994676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af7e87cc40 con 0x55af7e57e1b0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaedd18640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ffae40e4be0 tx=0x7ffae4010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e394c594ea3a817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4020070 con 0x55af7e57e1b0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7ffae4010460 con 0x55af7e57e1b0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad8004030 con 0x55af7e57e1b0 2024-09-21T03:43:34.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffae40a9120 con 0x55af7e57e1b0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 10 client.17547 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55af7e96a7c0 con 0x55af7e57e1b0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffad8004030 con 0x55af7e57e1b0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffae4010660 con 0x55af7e57e1b0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 10 client.17547 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 10 client.17547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.998+0000 7ffaf64f0740 20 client.17547 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e5659f0 0x55af7e96dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffaf64f0740 4 client.17547 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af7e8c6da0 con 0x55af7e5659f0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffaed517640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e5659f0 0x55af7e96dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffad17fa640 10 client.17547 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:33.999+0000 7ffaed517640 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e5659f0 0x55af7e96dbb0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c718c8c33e1732 server_cookie=516033b9c0487bd6 in_seq=0 out_seq=0 2024-09-21T03:43:34.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffad17fa640 1 -- 172.21.15.102:0/1696994676 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55af7e8c6da0 con 0x55af7e5659f0 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffad17fa640 10 client.17547 handle_command_reply: tid=0 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 client.17547 shutdown 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 msgr2=0x55af7e95ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ffae40e4be0 tx=0x7ffae4010cb0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 shutdown_connections 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e95c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e95bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e5659f0 0x55af7e96dbb0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/1696994676 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95ba90 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 >> 172.21.15.102:0/1696994676 conn(0x55af7e59b460 msgr2=0x55af7e94fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffad17fa640 0 client.17547 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 shutdown_connections 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.000+0000 7ffaf64f0740 1 -- 172.21.15.102:0/1696994676 wait complete. 2024-09-21T03:43:34.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.001+0000 7ffaf64f0740 20 client.17547 trim_cache size 0 max 16384 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.017+0000 7ffaf64f0740 1 Processor -- start 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 -- start start 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e958c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9591c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81b00a0 con 0x55af7e57e1b0 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81ad970 con 0x55af7e5a7070 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81ab7e0 con 0x55af7e586390 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53000/0 (socket says 172.21.15.102:53000) 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 -- 172.21.15.102:0/882670276 learned_addr learned my addr 172.21.15.102:0/882670276 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaed517640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e958c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 -- 172.21.15.102:0/882670276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 msgr2=0x55af7e958c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaee519640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e958c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 -- 172.21.15.102:0/882670276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 msgr2=0x55af7e9591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 -- 172.21.15.102:0/882670276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af7e95cd50 con 0x55af7e57e1b0 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaed517640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e958c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.018+0000 7ffaedd18640 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ad210 tx=0x7ffae40e4c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1586a51a1f6b317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffad37fe640 1 -- 172.21.15.102:0/882670276 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4020040 con 0x55af7e57e1b0 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffad37fe640 1 -- 172.21.15.102:0/882670276 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffae40ad980 con 0x55af7e57e1b0 2024-09-21T03:43:34.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffad37fe640 1 -- 172.21.15.102:0/882670276 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae40ac9f0 con 0x55af7e57e1b0 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 -- 172.21.15.102:0/882670276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 msgr2=0x55af7e95da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffae40ad210 tx=0x7ffae40e4c30 comp rx=0 tx=0).stop 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 -- 172.21.15.102:0/882670276 shutdown_connections 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e586390 0x55af7e958c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/882670276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e57e1b0 0x55af7e95da80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 -- 172.21.15.102:0/882670276 >> 172.21.15.102:0/882670276 conn(0x55af7e59b460 msgr2=0x55af7e94fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 -- 172.21.15.102:0/882670276 shutdown_connections 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.019+0000 7ffaf64f0740 1 -- 172.21.15.102:0/882670276 wait complete. 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.020+0000 7ffaf64f0740 1 -- start start 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.020+0000 7ffaf64f0740 1 Processor -- start 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.020+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e57e1b0 0x55af7e9620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.020+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.020+0000 7ffaf64f0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81abe30 con 0x55af7e586390 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81ad2a0 con 0x55af7e5a7070 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaf64f0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffae81ac500 con 0x55af7e57e1b0 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaf64f0740 10 client.0 _ll_register_callbacks cb 0x7ffae400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:53014/0 (socket says 172.21.15.102:53014) 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 -- 172.21.15.102:0/4063157646 learned_addr learned my addr 172.21.15.102:0/4063157646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:34.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaedd18640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e57e1b0 0x55af7e9620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 -- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e57e1b0 msgr2=0x55af7e9620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e57e1b0 0x55af7e9620d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 -- 172.21.15.102:0/4063157646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 msgr2=0x55af7e9d7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaee519640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9d7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 -- 172.21.15.102:0/4063157646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af7e962e90 con 0x55af7e586390 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaee519640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaed517640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad80058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0921a13ad96b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffad17fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8053070 con 0x55af7e586390 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7ffad8004230 con 0x55af7e586390 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.021+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffae40ad980 con 0x55af7e586390 2024-09-21T03:43:34.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ffad805f050 con 0x55af7e586390 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 10 client.17553 fetch_fsmap learned FSMap version 35 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55af7e9d8af0 con 0x55af7e586390 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffae40ad980 con 0x55af7e586390 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7ffad8031510 con 0x55af7e586390 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 10 client.17553 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 10 client.17553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 20 client.17553 populate_metadata read hostname 'smithi102' 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e53ada0 0x55af7e9dae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 4 client.17553 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55af7e8c2850 con 0x55af7e53ada0 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.022+0000 7ffaedd18640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e53ada0 0x55af7e9dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffad17fa640 10 client.17553 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffaedd18640 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e53ada0 0x55af7e9dae40 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d037576081cabb4 server_cookie=d62f1690022ba1d0 in_seq=0 out_seq=0 2024-09-21T03:43:34.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffad17fa640 1 -- 172.21.15.102:0/4063157646 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5966 (crc 0 0 0) 0x55af7e8c2850 con 0x55af7e53ada0 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffad17fa640 10 client.17553 handle_command_reply: tid=0 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffaf64f0740 1 client.17553 shutdown 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 msgr2=0x55af7e962610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.023+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009900 tx=0x7ffad80058d0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 shutdown_connections 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55af7e53ada0 0x55af7e9dae40 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af7e586390 0x55af7e962610 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55af7e5a7070 0x55af7e9d7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffad17fa640 0 client.17553 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 --2- 172.21.15.102:0/4063157646 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55af7e57e1b0 0x55af7e9620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 >> 172.21.15.102:0/4063157646 conn(0x55af7e59b460 msgr2=0x55af7e94fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 shutdown_connections 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 1 -- 172.21.15.102:0/4063157646 wait complete. 2024-09-21T03:43:34.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaf64f0740 20 client.17553 trim_cache size 0 max 16384 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": { 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "048694bc-2fb0-4e2a-a900-c28f605e0da9": { 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tag": "048694bc-2fb0-4e2a-a900-c28f605e0da9", 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: "options": "recursive,force" 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:34.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.032 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.033 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.034 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.035 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "048694bc-2fb0-4e2a-a900-c28f605e0da9": { 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:32.538888+0000", 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.036 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:43:34.037 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "0f18c705-4ad6-43b0-8f29-ca2a0d455a7f": { 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:11.184407+0000", 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.038 INFO:teuthology.orchestra.run.smithi102.stdout: "836ab757-3bc4-42f6-adc1-f62cc07e4d10": { 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:01.147651+0000", 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "d8285ed6-e990-40bf-a960-3f19a6eba78d": { 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:21.546155+0000", 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.040 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.041 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:43:34.042 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:43:34.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 msgr2=0x7ffad40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 0x7ffad40b8b90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffae0005fd0 tx=0x7ffae0011040 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 msgr2=0x7ffae8198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7ffae400d950 tx=0x7ffae400de10 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 shutdown_connections 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffad40b6680 0x7ffad40b8b90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae81084d0 0x7ffae819dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffae8107b80 0x7ffae8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 --2- 172.21.15.102:0/1059275873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffae8102240 0x7ffae8198490 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 >> 172.21.15.102:0/1059275873 conn(0x7ffae8079f90 msgr2=0x7ffae8105c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.024+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 shutdown_connections 2024-09-21T03:43:34.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:34.025+0000 7ffaeff7c640 1 -- 172.21.15.102:0/1059275873 wait complete. 2024-09-21T03:43:34.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:34 smithi121 ceph-mon[34316]: pgmap v632: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:34.808 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:34 smithi102 ceph-mon[31392]: pgmap v632: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:34.841 INFO:tasks.cephfs.filesystem:scrub status for tag:048694bc-2fb0-4e2a-a900-c28f605e0da9 - {'path': '/', 'tag': '048694bc-2fb0-4e2a-a900-c28f605e0da9', 'options': 'recursive,force'} 2024-09-21T03:43:34.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:34 smithi148 ceph-mon[34651]: pgmap v632: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:36.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:36 smithi121 ceph-mon[34316]: pgmap v633: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T03:43:36.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:36 smithi102 ceph-mon[31392]: pgmap v633: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T03:43:36.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:36 smithi148 ceph-mon[34651]: pgmap v633: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-21T03:43:37.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:37 smithi121 ceph-mon[34316]: scrub summary: idle 2024-09-21T03:43:37.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:37 smithi102 ceph-mon[31392]: scrub summary: idle 2024-09-21T03:43:37.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:37 smithi148 ceph-mon[34651]: scrub summary: idle 2024-09-21T03:43:38.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:38 smithi121 ceph-mon[34316]: pgmap v634: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:43:38.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:38 smithi102 ceph-mon[31392]: pgmap v634: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:43:38.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:38 smithi148 ceph-mon[34651]: pgmap v634: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-09-21T03:43:40.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:40 smithi121 ceph-mon[34316]: pgmap v635: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:40.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:40 smithi102 ceph-mon[31392]: pgmap v635: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:40.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:40 smithi148 ceph-mon[34651]: pgmap v635: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:42.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:42 smithi121 ceph-mon[34316]: pgmap v636: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:42.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:42 smithi102 ceph-mon[31392]: pgmap v636: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:42.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:42 smithi148 ceph-mon[34651]: pgmap v636: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-09-21T03:43:44.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:44 smithi121 ceph-mon[34316]: pgmap v637: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:44.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:44 smithi102 ceph-mon[31392]: pgmap v637: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:44.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:44 smithi148 ceph-mon[34651]: pgmap v637: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 7 op/s 2024-09-21T03:43:46.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:46 smithi121 ceph-mon[34316]: pgmap v638: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:43:46.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:46 smithi102 ceph-mon[31392]: pgmap v638: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:43:46.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:46 smithi148 ceph-mon[34651]: pgmap v638: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T03:43:47.365 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T03:43:47.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 -- 172.21.15.102:0/1386372765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106200 msgr2=0x7fe7a4106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 --2- 172.21.15.102:0/1386372765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106200 0x7fe7a4106610 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fe798009900 tx=0x7fe79802a410 comp rx=0 tx=0).stop 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 -- 172.21.15.102:0/1386372765 shutdown_connections 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 --2- 172.21.15.102:0/1386372765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106200 0x7fe7a4106610 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 --2- 172.21.15.102:0/1386372765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106b50 0x7fe7a41105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 --2- 172.21.15.102:0/1386372765 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 -- 172.21.15.102:0/1386372765 >> 172.21.15.102:0/1386372765 conn(0x7fe7a4077ad0 msgr2=0x7fe7a4077f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 -- 172.21.15.102:0/1386372765 shutdown_connections 2024-09-21T03:43:47.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.484+0000 7fe7aa430640 1 -- 172.21.15.102:0/1386372765 wait complete. 2024-09-21T03:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.485+0000 7fe7aa430640 1 Processor -- start 2024-09-21T03:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.485+0000 7fe7aa430640 1 -- start start 2024-09-21T03:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106200 0x7fe7a419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4113bc0 con 0x7fe7a4106b50 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4113a40 con 0x7fe7a4106200 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe7a4113d40 con 0x7fe7a4101fc0 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55128/0 (socket says 172.21.15.102:55128) 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 -- 172.21.15.102:0/433296869 learned_addr learned my addr 172.21.15.102:0/433296869 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a37fe640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106200 0x7fe7a419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a3fff640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 -- 172.21.15.102:0/433296869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 msgr2=0x7fe7a419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 -- 172.21.15.102:0/433296869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106200 msgr2=0x7fe7a419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106200 0x7fe7a419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 -- 172.21.15.102:0/433296869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7a41a0520 con 0x7fe7a4106b50 2024-09-21T03:43:47.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a3fff640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a89cd640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cce0 tx=0x7fe79c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c00f450 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7a41a0810 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe79c00fac0 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe79c018be0 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.486+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7a41a7030 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.488+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7a41023d0 con 0x7fe7a4106b50 2024-09-21T03:43:47.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.489+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe79c00fc70 con 0x7fe7a4106b50 2024-09-21T03:43:47.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.490+0000 7fe7a17fa640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 0x7fe78c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.490+0000 7fe7a3fff640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 0x7fe78c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.491+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fe79c0e7e50 con 0x7fe7a4106b50 2024-09-21T03:43:47.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.491+0000 7fe7a3fff640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 0x7fe78c0b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe794006fd0 tx=0x7fe794008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:47.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.494+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe79c014030 con 0x7fe7a4106b50 2024-09-21T03:43:47.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.690+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fe7a4063800 con 0x7fe78c0b6680 2024-09-21T03:43:47.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.699+0000 7fe7a17fa640 1 -- 172.21.15.102:0/433296869 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7fe7a4063800 con 0x7fe78c0b6680 2024-09-21T03:43:47.701 INFO:teuthology.orchestra.run.smithi102.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T03:33:46", "first": "2024-09-21T03:34:00", "last": "2024-09-21T03:43:00", "last_pruned": "2024-09-21T03:43:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T03:43:47.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 msgr2=0x7fe78c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 0x7fe78c0b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe794006fd0 tx=0x7fe794008040 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 msgr2=0x7fe7a419feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00cce0 tx=0x7fe79c00a620 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 shutdown_connections 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe78c0b6680 0x7fe78c0b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe7a4106b50 0x7fe7a419feb0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7a4106200 0x7fe7a419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 --2- 172.21.15.102:0/433296869 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe7a4101fc0 0x7fe7a419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 >> 172.21.15.102:0/433296869 conn(0x7fe7a4077ad0 msgr2=0x7fe7a4107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 shutdown_connections 2024-09-21T03:43:47.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.701+0000 7fe7aa430640 1 -- 172.21.15.102:0/433296869 wait complete. 2024-09-21T03:43:47.715 DEBUG:teuthology.orchestra.run.smithi102:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T03:43:47.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 -- 172.21.15.102:0/109483678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108340 msgr2=0x7f9710108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 --2- 172.21.15.102:0/109483678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108340 0x7f9710108750 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009900 tx=0x7f96fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 -- 172.21.15.102:0/109483678 shutdown_connections 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 --2- 172.21.15.102:0/109483678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108340 0x7f9710108750 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 --2- 172.21.15.102:0/109483678 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108c90 0x7f971010f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 --2- 172.21.15.102:0/109483678 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f9710102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 -- 172.21.15.102:0/109483678 >> 172.21.15.102:0/109483678 conn(0x7f97100fe410 msgr2=0x7f9710100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 -- 172.21.15.102:0/109483678 shutdown_connections 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.824+0000 7f9716dba640 1 -- 172.21.15.102:0/109483678 wait complete. 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 Processor -- start 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 -- start start 2024-09-21T03:43:47.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f971019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 0x7f971019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9710112a70 con 0x7f9710108c90 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f97101128f0 con 0x7f9710102a10 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9716dba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f9710112bf0 con 0x7f9710108340 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:55144/0 (socket says 172.21.15.102:55144) 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 -- 172.21.15.102:0/2746796153 learned_addr learned my addr 172.21.15.102:0/2746796153 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9714b56640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f971019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f970ffff640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 0x7f971019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 -- 172.21.15.102:0/2746796153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 msgr2=0x7f971019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 0x7f971019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 -- 172.21.15.102:0/2746796153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 msgr2=0x7f971019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f971019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9715357640 1 -- 172.21.15.102:0/2746796153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97101a0590 con 0x7f9710108c90 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f970ffff640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 0x7f971019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.825+0000 7f9714b56640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f971019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f9715357640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f970800eaa0 tx=0x7f970800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970800cdb0 con 0x7f9710108c90 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f9708005020 con 0x7f9710108c90 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97101a0880 con 0x7f9710108c90 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97080116d0 con 0x7f9710108c90 2024-09-21T03:43:47.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.826+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97101a7010 con 0x7f9710108c90 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.827+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9710102e20 con 0x7f9710108c90 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.829+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f97080051d0 con 0x7f9710108c90 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.829+0000 7f970dffb640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 0x7f97000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.829+0000 7f9714b56640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 0x7f97000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.829+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7f97080e7cd0 con 0x7f9710108c90 2024-09-21T03:43:47.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.830+0000 7f9714b56640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 0x7f97000b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9704009fc0 tx=0x7f9704005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:43:47.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:47.832+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9708016030 con 0x7f9710108c90 2024-09-21T03:43:48.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.030+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 --> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9710063800 con 0x7f97000b6680 2024-09-21T03:43:48.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.037+0000 7f970dffb640 1 -- 172.21.15.102:0/2746796153 <== mgr.14223 v2:172.21.15.102:6800/1995339284 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9710063800 con 0x7f97000b6680 2024-09-21T03:43:48.039 INFO:teuthology.orchestra.run.smithi102.stdout:/ 1m 6m3h 2024-09-21T03:43:48.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 msgr2=0x7f97000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:48.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 0x7f97000b8b90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9704009fc0 tx=0x7f9704005f90 comp rx=0 tx=0).stop 2024-09-21T03:43:48.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 msgr2=0x7f971019fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:43:48.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f970800eaa0 tx=0x7f970800ef60 comp rx=0 tx=0).stop 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 shutdown_connections 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f97000b6680 0x7f97000b8b90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9710108c90 0x7f971019fe90 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f9710108340 0x7f971019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 --2- 172.21.15.102:0/2746796153 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9710102a10 0x7f971019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 >> 172.21.15.102:0/2746796153 conn(0x7f97100fe410 msgr2=0x7f971006b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 shutdown_connections 2024-09-21T03:43:48.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:43:48.039+0000 7f9716dba640 1 -- 172.21.15.102:0/2746796153 wait complete. 2024-09-21T03:43:48.053 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T03:43:48.069 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T03:43:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:48 smithi121 ceph-mon[34316]: from='client.17559 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:48 smithi121 ceph-mon[34316]: from='client.17565 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:48 smithi121 ceph-mon[34316]: pgmap v639: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:43:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:48 smithi102 ceph-mon[31392]: from='client.17559 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:48 smithi102 ceph-mon[31392]: from='client.17565 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:48 smithi102 ceph-mon[31392]: pgmap v639: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:43:48.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:48 smithi148 ceph-mon[34651]: from='client.17559 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:48 smithi148 ceph-mon[34651]: from='client.17565 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:43:48.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:48 smithi148 ceph-mon[34651]: pgmap v639: 97 pgs: 97 active+clean; 156 MiB data, 706 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-09-21T03:43:50.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:50 smithi121 ceph-mon[34316]: pgmap v640: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:50.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:50 smithi102 ceph-mon[31392]: pgmap v640: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:50.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:50 smithi148 ceph-mon[34651]: pgmap v640: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s 2024-09-21T03:43:52.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:52 smithi121 ceph-mon[34316]: pgmap v641: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:43:52.796 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:52 smithi148 ceph-mon[34651]: pgmap v641: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:43:52.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:52 smithi102 ceph-mon[31392]: pgmap v641: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T03:43:54.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:54 smithi121 ceph-mon[34316]: pgmap v642: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:54.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:54 smithi102 ceph-mon[31392]: pgmap v642: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:54.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:54 smithi148 ceph-mon[34651]: pgmap v642: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:56.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:56 smithi121 ceph-mon[34316]: pgmap v643: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:56.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:56 smithi102 ceph-mon[31392]: pgmap v643: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:56.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:56 smithi148 ceph-mon[34651]: pgmap v643: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:58.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:43:58 smithi121 ceph-mon[34316]: pgmap v644: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:58.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:43:58 smithi102 ceph-mon[31392]: pgmap v644: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:43:58.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:43:58 smithi148 ceph-mon[34651]: pgmap v644: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-21T03:44:00.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:00 smithi121 ceph-mon[34316]: pgmap v645: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T03:44:00.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:00 smithi102 ceph-mon[31392]: pgmap v645: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T03:44:00.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:00 smithi148 ceph-mon[34651]: pgmap v645: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T03:44:02.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:02 smithi121 ceph-mon[34316]: pgmap v646: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-21T03:44:02.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:02 smithi102 ceph-mon[31392]: pgmap v646: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-21T03:44:02.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:02 smithi148 ceph-mon[34651]: pgmap v646: 97 pgs: 97 active+clean; 156 MiB data, 705 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 KiB/s wr, 22 op/s 2024-09-21T03:44:03.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:03 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:03.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:03 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:04.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:03 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:44:04.843 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T03:44:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:04 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:04.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:04 smithi102 ceph-mon[31392]: pgmap v647: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:05.185 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:05.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:05.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:04 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:05.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:04 smithi148 ceph-mon[34651]: pgmap v647: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:05.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:05.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:04 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:05.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:04 smithi121 ceph-mon[34316]: pgmap v647: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:05.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 -- 172.21.15.102:0/2826709936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde0107c00 msgr2=0x7fcde01080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 --2- 172.21.15.102:0/2826709936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde0107c00 0x7fcde01080e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009930 tx=0x7fcdd802a420 comp rx=0 tx=0).stop 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 -- 172.21.15.102:0/2826709936 shutdown_connections 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 --2- 172.21.15.102:0/2826709936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde0107c00 0x7fcde01080e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 --2- 172.21.15.102:0/2826709936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0103110 0x7fcde0107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 --2- 172.21.15.102:0/2826709936 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde01027c0 0x7fcde0102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 -- 172.21.15.102:0/2826709936 >> 172.21.15.102:0/2826709936 conn(0x7fcde0079740 msgr2=0x7fcde0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 -- 172.21.15.102:0/2826709936 shutdown_connections 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.690+0000 7fcde7c44640 1 -- 172.21.15.102:0/2826709936 wait complete. 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 Processor -- start 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 -- start start 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde0103110 0x7fcde01a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0107c00 0x7fcde01a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcde011a1e0 con 0x7fcde01027c0 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcde011a060 con 0x7fcde0107c00 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde7c44640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcde011a360 con 0x7fcde0103110 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.691+0000 7fcde59e0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51390/0 (socket says 172.21.15.102:51390) 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 -- 172.21.15.102:0/1452484476 learned_addr learned my addr 172.21.15.102:0/1452484476 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde51df640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde0103110 0x7fcde01a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde61e1640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0107c00 0x7fcde01a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 -- 172.21.15.102:0/1452484476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde0103110 msgr2=0x7fcde01a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde0103110 0x7fcde01a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 -- 172.21.15.102:0/1452484476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0107c00 msgr2=0x7fcde01a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0107c00 0x7fcde01a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 -- 172.21.15.102:0/1452484476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde01a6aa0 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde59e0640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009fd0 tx=0x7fcdd000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcddeffd640 1 -- 172.21.15.102:0/1452484476 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd000cde0 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde01a6d90 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde01ad5b0 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcddeffd640 1 -- 172.21.15.102:0/1452484476 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd0011940 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.692+0000 7fcddeffd640 1 -- 172.21.15.102:0/1452484476 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd001aa10 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 Processor -- start 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 -- start start 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcddeffd640 1 -- 172.21.15.102:0/1452484476 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fcdd00233f0 con 0x7fcde01027c0 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d80cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559906cf6e50 con 0x5599069d9070 2024-09-21T03:44:05.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559906ce6280 con 0x5599069b8390 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559906cea090 con 0x5599069b01b0 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.695+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51400/0 (socket says 172.21.15.102:51400) 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 -- 172.21.15.102:0/2605949499 learned_addr learned my addr 172.21.15.102:0/2605949499 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde59e0640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde51df640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d80cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 -- 172.21.15.102:0/2605949499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 msgr2=0x559906d807b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d807b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 -- 172.21.15.102:0/2605949499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 msgr2=0x559906d80cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d80cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 -- 172.21.15.102:0/2605949499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559906a44650 con 0x5599069d9070 2024-09-21T03:44:05.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde51df640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d80cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009930 tx=0x7fcdd8032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d58656097700bec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcddeffd640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 0x7fcdc80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcdc7fff640 1 -- 172.21.15.102:0/2605949499 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8040070 con 0x5599069d9070 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcdc7fff640 1 -- 172.21.15.102:0/2605949499 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd8031710 con 0x5599069d9070 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcdc7fff640 1 -- 172.21.15.102:0/2605949499 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8035040 con 0x5599069d9070 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.696+0000 7fcde59e0640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 0x7fcdc80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcddeffd640 1 -- 172.21.15.102:0/1452484476 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fcdd00e7a90 con 0x7fcde01027c0 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2605949499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 msgr2=0x559906d80270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcde59e0640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 0x7fcdc80b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00e5250 tx=0x7fcdd00eb5e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009930 tx=0x7fcdd8032d00 comp rx=0 tx=0).stop 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2605949499 shutdown_connections 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d80cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d807b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2605949499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d80270 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.697+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2605949499 >> 172.21.15.102:0/2605949499 conn(0x5599069cd460 msgr2=0x559906d7e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.698+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2605949499 shutdown_connections 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.698+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2605949499 wait complete. 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.698+0000 7fcdee1b8740 1 -- start start 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.698+0000 7fcdee1b8740 1 Processor -- start 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 0x559906d8bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d97d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559906b47700 con 0x5599069b01b0 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559906c81110 con 0x5599069d9070 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559906d8e9f0 con 0x5599069b8390 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 10 client.0 _ll_register_callbacks cb 0x559906c9a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51406/0 (socket says 172.21.15.102:51406) 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 -- 172.21.15.102:0/1082808240 learned_addr learned my addr 172.21.15.102:0/1082808240 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde51df640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 0x559906d8bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d97d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 -- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 msgr2=0x559906d8bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 0x559906d8bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 -- 172.21.15.102:0/1082808240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 msgr2=0x559906d97d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d97d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 -- 172.21.15.102:0/1082808240 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559906caec40 con 0x5599069b01b0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde51df640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 0x559906d8bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcde61e1640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009850 tx=0x7fcdd80053a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ad6c81cea9f48b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8051060 con 0x5599069b01b0 2024-09-21T03:44:05.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fcdd803c850 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.699+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdd8031710 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcdd8035040 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 10 client.17577 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559906d9a730 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd8031710 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcdd80449a0 con 0x5599069b01b0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 10 client.17577 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 10 client.17577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 20 client.17577 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5599069979f0 0x559906d9da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 4 client.17577 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559906cf8da0 con 0x5599069979f0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.700+0000 7fcde51df640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5599069979f0 0x559906d9da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.701+0000 7fcde51df640 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5599069979f0 0x559906d9da90 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c848891f0348be2 server_cookie=976fe9c60afc4c1d in_seq=0 out_seq=0 2024-09-21T03:44:05.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.701+0000 7fcdc57fa640 10 client.17577 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.701+0000 7fcdc57fa640 1 -- 172.21.15.102:0/1082808240 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559906cf8da0 con 0x5599069979f0 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.701+0000 7fcdc57fa640 10 client.17577 handle_command_reply: tid=0 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.701+0000 7fcdee1b8740 1 client.17577 shutdown 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 msgr2=0x559906d8b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009850 tx=0x7fcdd80053a0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 shutdown_connections 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d97d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b8390 0x559906d8bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x5599069979f0 0x559906d9da90 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/1082808240 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b01b0 0x559906d8b960 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdc57fa640 0 client.17577 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 >> 172.21.15.102:0/1082808240 conn(0x5599069cd460 msgr2=0x559906d83400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 shutdown_connections 2024-09-21T03:44:05.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 1 -- 172.21.15.102:0/1082808240 wait complete. 2024-09-21T03:44:05.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.702+0000 7fcdee1b8740 20 client.17577 trim_cache size 0 max 16384 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 Processor -- start 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 -- start start 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d81c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d8d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0111c0 con 0x5599069d9070 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00ea90 con 0x5599069b8390 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00c900 con 0x5599069b01b0 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcde61e1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51416/0 (socket says 172.21.15.102:51416) 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcde61e1640 1 -- 172.21.15.102:0/3231068773 learned_addr learned my addr 172.21.15.102:0/3231068773 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcde51df640 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d8d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.720+0000 7fcde61e1640 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d81c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 -- 172.21.15.102:0/3231068773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 msgr2=0x559906d81c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d81c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 -- 172.21.15.102:0/3231068773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 msgr2=0x559906d8d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d8d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 -- 172.21.15.102:0/3231068773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559906d79580 con 0x5599069d9070 2024-09-21T03:44:05.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcde61e1640 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fcdd802a940 tx=0x7fcdd8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25509477056b739 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcdc77fe640 1 -- 172.21.15.102:0/3231068773 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8048030 con 0x5599069d9070 2024-09-21T03:44:05.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcdc77fe640 1 -- 172.21.15.102:0/3231068773 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fcdd8031510 con 0x5599069d9070 2024-09-21T03:44:05.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.721+0000 7fcdc77fe640 1 -- 172.21.15.102:0/3231068773 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd8051040 con 0x5599069d9070 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- 172.21.15.102:0/3231068773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 msgr2=0x559906d97cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fcdd802a940 tx=0x7fcdd8005fd0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- 172.21.15.102:0/3231068773 shutdown_connections 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069d9070 0x559906d97cb0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069b8390 0x559906d8d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/3231068773 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d81c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- 172.21.15.102:0/3231068773 >> 172.21.15.102:0/3231068773 conn(0x5599069cd460 msgr2=0x559906d8ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- 172.21.15.102:0/3231068773 shutdown_connections 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- 172.21.15.102:0/3231068773 wait complete. 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.722+0000 7fcdee1b8740 1 -- start start 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 Processor -- start 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d9ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d9f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00cf50 con 0x5599069b8390 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00e3c0 con 0x5599069d9070 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc00d620 con 0x5599069b01b0 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcdee1b8740 10 client.0 _ll_register_callbacks cb 0x7fcdd00eb4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcde51df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcde51df640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51428/0 (socket says 172.21.15.102:51428) 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcde51df640 1 -- 172.21.15.102:0/2126351787 learned_addr learned my addr 172.21.15.102:0/2126351787 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d9ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.723+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d9f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 -- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 msgr2=0x559906d9ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d9ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 -- 172.21.15.102:0/2126351787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 msgr2=0x559906d9f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d9f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 -- 172.21.15.102:0/2126351787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559906e07210 con 0x5599069b8390 2024-09-21T03:44:05.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d9f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcde51df640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400aa80 tx=0x7fcdd4013b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7006675628bc9c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdc57fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400f950 con 0x5599069b8390 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8586+0+0 (secure 0 0 0) 0x7fcdd400faf0 con 0x5599069b8390 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559906cf4850 con 0x5599069b8390 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fcdd400fcf0 con 0x5599069b8390 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdee1b8740 10 client.17583 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:05.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.724+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559906e084a0 con 0x5599069b8390 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x559906cf4850 con 0x5599069b8390 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7fcdd4004b00 con 0x5599069b8390 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 10 client.17583 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 10 client.17583 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 20 client.17583 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55990696cda0 0x559906e0ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 4 client.17583 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559906cf1c80 con 0x55990696cda0 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55990696cda0 0x559906e0ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcdc57fa640 10 client.17583 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.725+0000 7fcde61e1640 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55990696cda0 0x559906e0ace0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba66c1307694418 server_cookie=30684ba35cdb3cb7 in_seq=0 out_seq=0 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdc57fa640 1 -- 172.21.15.102:0/2126351787 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x559906cf1c80 con 0x55990696cda0 2024-09-21T03:44:05.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdc57fa640 10 client.17583 handle_command_reply: tid=0 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 client.17583 shutdown 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 msgr2=0x559906d9efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400aa80 tx=0x7fcdd4013b90 comp rx=0 tx=0).stop 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 shutdown_connections 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55990696cda0 0x559906e0ace0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5599069b8390 0x559906d9efc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599069d9070 0x559906d9f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 --2- 172.21.15.102:0/2126351787 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x5599069b01b0 0x559906d9ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdc57fa640 0 client.17583 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 >> 172.21.15.102:0/2126351787 conn(0x5599069cd460 msgr2=0x559906d81970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 shutdown_connections 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 1 -- 172.21.15.102:0/2126351787 wait complete. 2024-09-21T03:44:05.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.726+0000 7fcdee1b8740 20 client.17583 trim_cache size 0 max 16384 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "status": "no active scrubs running", 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "scrubs": {}, 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "scrub_stats": { 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "e67f94b1-70d1-4a7a-ac30-82606847f199": { 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:42:19.244664+0000", 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "3715d1a9-82d4-4c4f-a5de-443e1c7a0723": { 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:36.730688+0000", 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "8ff43c1b-7f9b-4375-ad0a-50e29a431bfa": { 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:26.458936+0000", 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.734 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "319b84da-6ffe-46e6-abf1-535a8947f405": { 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:34:29.399055+0000", 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "d7e65926-e4d9-4f43-a96e-87473c176505": { 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:58.272894+0000", 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.735 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "5e6fcf1a-2ef2-4b37-8600-82f665a783c2": { 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:01.936347+0000", 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.736 INFO:teuthology.orchestra.run.smithi102.stdout: "96ddc4f7-d386-4de4-8d58-3aa987ae2db4": { 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:09.451255+0000", 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "048694bc-2fb0-4e2a-a900-c28f605e0da9": { 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:32.538888+0000", 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.737 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "84fcc7fe-4906-449e-afd5-1286ab9f97df": { 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:35:14.466961+0000", 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "d4537e22-001f-4900-84d6-1280c566048f": { 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:40.336871+0000", 2024-09-21T03:44:05.738 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "aca3977a-a9cc-416a-9ba5-cf480c41b244": { 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:36:50.954614+0000", 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.739 INFO:teuthology.orchestra.run.smithi102.stdout: "0f18c705-4ad6-43b0-8f29-ca2a0d455a7f": { 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:11.184407+0000", 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "836ab757-3bc4-42f6-adc1-f62cc07e4d10": { 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:01.147651+0000", 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.740 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "c875cda8-19d4-4e15-a058-ce0806c690fa": { 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:37:44.632312+0000", 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "d6f4a83e-9303-405b-9f1f-fe6c9139f926": { 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:38:27.296277+0000", 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.741 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "d8285ed6-e990-40bf-a960-3f19a6eba78d": { 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:43:21.546155+0000", 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "89613b17-b55e-4dcd-af5e-178e21733a6f": { 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:33:46.748089+0000", 2024-09-21T03:44:05.742 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "dcce8df1-350f-42bd-96dd-abb588b09910": { 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:40:33.775210+0000", 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "9ca14f81-6c0b-49ab-b3ca-445b25a75aea": { 2024-09-21T03:44:05.743 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:39:51.741229+0000", 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "d42d22a0-5955-4519-b56a-79aecad6530d": { 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "start_time": "2024-09-21T03:41:16.278182+0000", 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "path": "/", 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_started": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_passed": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_failed": 0, 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: "uninline_skipped": 0 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:05.744 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 msgr2=0x7fcdc80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 0x7fcdc80b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcdd00e5250 tx=0x7fcdd00eb5e0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 msgr2=0x7fcde01a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0009fd0 tx=0x7fcdd000ef00 comp rx=0 tx=0).stop 2024-09-21T03:44:05.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 shutdown_connections 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fcdc80b66b0 0x7fcdc80b8bc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcde0107c00 0x7fcde01a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fcde0103110 0x7fcde01a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 --2- 172.21.15.102:0/1452484476 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcde01027c0 0x7fcde01a0bf0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 >> 172.21.15.102:0/1452484476 conn(0x7fcde0079740 msgr2=0x7fcde0105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 shutdown_connections 2024-09-21T03:44:05.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:05.727+0000 7fcde7c44640 1 -- 172.21.15.102:0/1452484476 wait complete. 2024-09-21T03:44:06.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:05 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:05 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.453 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:05 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:06.603 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T03:44:06.603 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:06.902 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:07.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:06 smithi148 ceph-mon[34651]: pgmap v648: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:07.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:06 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:06 smithi121 ceph-mon[34316]: pgmap v648: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:07.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:06 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.302 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:06 smithi102 ceph-mon[31392]: pgmap v648: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T03:44:07.302 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.303 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:06 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.397+0000 7f3214547640 1 -- 172.21.15.102:0/2993118266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c1094f0 msgr2=0x7f320c109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.397+0000 7f3214547640 1 --2- 172.21.15.102:0/2993118266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c1094f0 0x7f320c109900 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009900 tx=0x7f31fc02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 -- 172.21.15.102:0/2993118266 shutdown_connections 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 --2- 172.21.15.102:0/2993118266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c1094f0 0x7f320c109900 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 --2- 172.21.15.102:0/2993118266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c109e40 0x7f320c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 --2- 172.21.15.102:0/2993118266 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c103bb0 0x7f320c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 -- 172.21.15.102:0/2993118266 >> 172.21.15.102:0/2993118266 conn(0x7f320c0ff600 msgr2=0x7f320c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 -- 172.21.15.102:0/2993118266 shutdown_connections 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.398+0000 7f3214547640 1 -- 172.21.15.102:0/2993118266 wait complete. 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 Processor -- start 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 -- start start 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c1094f0 0x7f320c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 0x7f320c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f320c113c20 con 0x7f320c103bb0 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f320c113aa0 con 0x7f320c1094f0 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3214547640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f320c113da0 con 0x7f320c109e40 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51448/0 (socket says 172.21.15.102:51448) 2024-09-21T03:44:07.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 -- 172.21.15.102:0/462003694 learned_addr learned my addr 172.21.15.102:0/462003694 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3212ae4640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 0x7f320c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3211ae2640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c1094f0 0x7f320c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 -- 172.21.15.102:0/462003694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 msgr2=0x7f320c19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 0x7f320c19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 -- 172.21.15.102:0/462003694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c1094f0 msgr2=0x7f320c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c1094f0 0x7f320c19abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 -- 172.21.15.102:0/462003694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c1a05a0 con 0x7f320c103bb0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f3212ae4640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 0x7f320c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.399+0000 7f32122e3640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f320800e9f0 tx=0x7f320800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.400+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320800cd80 con 0x7f320c103bb0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.400+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c1a0890 con 0x7f320c103bb0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.400+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f32080054f0 con 0x7f320c103bb0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.400+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208010690 con 0x7f320c103bb0 2024-09-21T03:44:07.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.400+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c1a6ff0 con 0x7f320c103bb0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.401+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c103fc0 con 0x7f320c103bb0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.402+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f32080046c0 con 0x7f320c103bb0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.403+0000 7f32037fe640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 0x7f31f80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.403+0000 7f3211ae2640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 0x7f31f80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.403+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f32080e7e60 con 0x7f320c103bb0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.403+0000 7f3211ae2640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 0x7f31f80b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006010 tx=0x7f31fc000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:07.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.406+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3208056710 con 0x7f320c103bb0 2024-09-21T03:44:07.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.618+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f320c19b760 con 0x7f320c103bb0 2024-09-21T03:44:07.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.619+0000 7f32037fe640 1 -- 172.21.15.102:0/462003694 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f320c19b760 con 0x7f320c103bb0 2024-09-21T03:44:07.622 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:07.622 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:44:07.622 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:44:07.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 msgr2=0x7f31f80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 0x7f31f80b8b90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006010 tx=0x7f31fc000bc0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 msgr2=0x7f320c19a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f320800e9f0 tx=0x7f320800edf0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 shutdown_connections 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31f80b6680 0x7f31f80b8b90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f320c109e40 0x7f320c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f320c1094f0 0x7f320c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 --2- 172.21.15.102:0/462003694 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f320c103bb0 0x7f320c19a630 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 >> 172.21.15.102:0/462003694 conn(0x7f320c0ff600 msgr2=0x7f320c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.621+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 shutdown_connections 2024-09-21T03:44:07.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:07.622+0000 7f3214547640 1 -- 172.21.15.102:0/462003694 wait complete. 2024-09-21T03:44:08.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T03:44:08.242 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:07 smithi102 ceph-mon[31392]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:44:08.242 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:08.242 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:08.242 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:07 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:08.242 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:07 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/462003694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:08.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:07 smithi148 ceph-mon[34651]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:44:08.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:08.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:08.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:07 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:08.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:07 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/462003694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:08.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:07 smithi121 ceph-mon[34316]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T03:44:08.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:44:08.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:44:08.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:07 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' 2024-09-21T03:44:08.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:07 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/462003694' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:08.462 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 -- 172.21.15.102:0/234280118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 msgr2=0x7f311c10f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 --2- 172.21.15.102:0/234280118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c10f780 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f3114009900 tx=0x7f311402a410 comp rx=0 tx=0).stop 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 -- 172.21.15.102:0/234280118 shutdown_connections 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 --2- 172.21.15.102:0/234280118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c10f780 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 --2- 172.21.15.102:0/234280118 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 0x7f311c108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 --2- 172.21.15.102:0/234280118 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 0x7f311c1035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 -- 172.21.15.102:0/234280118 >> 172.21.15.102:0/234280118 conn(0x7f311c079e30 msgr2=0x7f311c07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 -- 172.21.15.102:0/234280118 shutdown_connections 2024-09-21T03:44:08.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.934+0000 7f3120e73640 1 -- 172.21.15.102:0/234280118 wait complete. 2024-09-21T03:44:08.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.935+0000 7f3120e73640 1 Processor -- start 2024-09-21T03:44:08.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.935+0000 7f3120e73640 1 -- start start 2024-09-21T03:44:08.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.935+0000 7f3120e73640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 0x7f311c100870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.935+0000 7f3120e73640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 0x7f311c0fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3120e73640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3120e73640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f311c112d50 con 0x7f311c108f50 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3120e73640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f311c112bd0 con 0x7f311c1031c0 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3120e73640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f311c112ed0 con 0x7f311c108600 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51464/0 (socket says 172.21.15.102:51464) 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 -- 172.21.15.102:0/1098756736 learned_addr learned my addr 172.21.15.102:0/1098756736 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3119d9b640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 0x7f311c0fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311a59c640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 0x7f311c100870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 -- 172.21.15.102:0/1098756736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 msgr2=0x7f311c0fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 0x7f311c0fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 -- 172.21.15.102:0/1098756736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 msgr2=0x7f311c100870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 0x7f311c100870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 -- 172.21.15.102:0/1098756736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c0ffbc0 con 0x7f311c108f50 2024-09-21T03:44:08.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f311ad9d640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3114005ab0 tx=0x7f31140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f310b7fe640 1 -- 172.21.15.102:0/1098756736 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311403f030 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.936+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1ad0d0 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.937+0000 7f310b7fe640 1 -- 172.21.15.102:0/1098756736 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3114003cd0 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.937+0000 7f310b7fe640 1 -- 172.21.15.102:0/1098756736 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114035070 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.937+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1ad5b0 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.939+0000 7f310b7fe640 1 -- 172.21.15.102:0/1098756736 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f3114042030 con 0x7f311c108f50 2024-09-21T03:44:08.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.939+0000 7f31273e7740 1 Processor -- start 2024-09-21T03:44:08.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 -- start start 2024-09-21T03:44:08.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78586800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562e784fcea0 con 0x562e781be390 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562e784ec2d0 con 0x562e781df070 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f31273e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562e784f00e0 con 0x562e781b61b0 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f310b7fe640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 0x7f31040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f3119d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f3119d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51466/0 (socket says 172.21.15.102:51466) 2024-09-21T03:44:08.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f311a59c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78586800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f3119d9b640 1 -- 172.21.15.102:0/3166056868 learned_addr learned my addr 172.21.15.102:0/3166056868 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:08.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f3119d9b640 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f311ad9d640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 0x7f31040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.940+0000 7f310b7fe640 1 -- 172.21.15.102:0/1098756736 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f3114107c10 con 0x7f311c108f50 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 -- 172.21.15.102:0/3166056868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 msgr2=0x562e785862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785862c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 -- 172.21.15.102:0/3166056868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 msgr2=0x562e78586d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 -- 172.21.15.102:0/3166056868 --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7824a650 con 0x562e781b61b0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f3119d9b640 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311a59c640 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78586800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f310c005fd0 tx=0x7f310c003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d547a4df50206c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f311ad9d640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 0x7f31040b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31140cad10 tx=0x7f3114040000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f3108ff9640 1 -- 172.21.15.102:0/3166056868 <== mon.1 v2:172.21.15.148:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c004b20 con 0x562e781b61b0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f3108ff9640 1 -- 172.21.15.102:0/3166056868 <== mon.1 v2:172.21.15.148:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f310c004cc0 con 0x562e781b61b0 2024-09-21T03:44:08.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.941+0000 7f3108ff9640 1 -- 172.21.15.102:0/3166056868 <== mon.1 v2:172.21.15.148:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0126b0 con 0x562e781b61b0 2024-09-21T03:44:08.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- 172.21.15.102:0/3166056868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 msgr2=0x562e78586800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78586800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f310c005fd0 tx=0x7f310c003e00 comp rx=0 tx=0).stop 2024-09-21T03:44:08.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- 172.21.15.102:0/3166056868 shutdown_connections 2024-09-21T03:44:08.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78586d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78586800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 --2- 172.21.15.102:0/3166056868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785862c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- 172.21.15.102:0/3166056868 >> 172.21.15.102:0/3166056868 conn(0x562e781d3460 msgr2=0x562e785841b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- 172.21.15.102:0/3166056868 shutdown_connections 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- 172.21.15.102:0/3166056868 wait complete. 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.942+0000 7f31273e7740 1 -- start start 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 Processor -- start 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78591910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785923b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562e7834d700 con 0x562e781be390 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x562e78487160 con 0x562e781df070 2024-09-21T03:44:08.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x562e78594aa0 con 0x562e781b61b0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f31273e7740 10 client.0 _ll_register_callbacks cb 0x562e784a09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51468/0 (socket says 172.21.15.102:51468) 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 -- 172.21.15.102:0/1215737355 learned_addr learned my addr 172.21.15.102:0/1215737355 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f3119d9b640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78591910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f3119d9b640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785923b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 -- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 msgr2=0x562e78591910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78591910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 -- 172.21.15.102:0/1215737355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 msgr2=0x562e785923b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785923b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 -- 172.21.15.102:0/1215737355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e784b4c90 con 0x562e781be390 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f311a59c640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f310c004000 tx=0x7f310c009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696e973f915eeb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.943+0000 7f3101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:08.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c005200 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f310c0053a0 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c004cc0 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f310c0055a0 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 10 client.17601 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562e785a0750 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f310c004cc0 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f310c00f040 con 0x562e781be390 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 10 client.17601 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 10 client.17601 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 20 client.17601 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e7819d9f0 0x562e785a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 4 client.17601 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.944+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e784fedf0 con 0x562e7819d9f0 2024-09-21T03:44:08.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.945+0000 7f3119d9b640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e7819d9f0 0x562e785a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.945+0000 7f3101ffb640 10 client.17601 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.945+0000 7f3119d9b640 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e7819d9f0 0x562e785a3bc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6bcd68a545ee6584 server_cookie=805d17853df42aa8 in_seq=0 out_seq=0 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f3101ffb640 1 -- 172.21.15.102:0/1215737355 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e784fedf0 con 0x562e7819d9f0 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f3101ffb640 10 client.17601 handle_command_reply: tid=0 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 client.17601 shutdown 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 msgr2=0x562e78591e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f310c004000 tx=0x7f310c009fa0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 shutdown_connections 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e7819d9f0 0x562e785a3bc0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e78591e50 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781df070 0x562e785923b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 --2- 172.21.15.102:0/1215737355 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781b61b0 0x562e78591910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f3101ffb640 0 client.17601 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 >> 172.21.15.102:0/1215737355 conn(0x562e781d3460 msgr2=0x562e78589450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 shutdown_connections 2024-09-21T03:44:08.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 1 -- 172.21.15.102:0/1215737355 wait complete. 2024-09-21T03:44:08.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.946+0000 7f31273e7740 20 client.17601 trim_cache size 0 max 16384 2024-09-21T03:44:08.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 Processor -- start 2024-09-21T03:44:08.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 -- start start 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78593540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781df070 0x562e7858f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b8810 con 0x562e781be390 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b60e0 con 0x562e781b61b0 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f31273e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b3f50 con 0x562e781df070 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.959+0000 7f311a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51472/0 (socket says 172.21.15.102:51472) 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 -- 172.21.15.102:0/2209469892 learned_addr learned my addr 172.21.15.102:0/2209469892 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781df070 0x562e7858f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78593540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 -- 172.21.15.102:0/2209469892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781df070 msgr2=0x562e7858f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781df070 0x562e7858f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 -- 172.21.15.102:0/2209469892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 msgr2=0x562e78593540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78593540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 -- 172.21.15.102:0/2209469892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e7857e460 con 0x562e781be390 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78593540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f311a59c640 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c009ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d636098d93255b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3103fff640 1 -- 172.21.15.102:0/2209469892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c009680 con 0x562e781be390 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3103fff640 1 -- 172.21.15.102:0/2209469892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f310c005870 con 0x562e781be390 2024-09-21T03:44:08.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.960+0000 7f3103fff640 1 -- 172.21.15.102:0/2209469892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0050d0 con 0x562e781be390 2024-09-21T03:44:08.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- 172.21.15.102:0/2209469892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 msgr2=0x562e7858eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f310c006010 tx=0x7f310c009ac0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- 172.21.15.102:0/2209469892 shutdown_connections 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781be390 0x562e7858eb00 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781df070 0x562e7858f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 --2- 172.21.15.102:0/2209469892 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78593540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- 172.21.15.102:0/2209469892 >> 172.21.15.102:0/2209469892 conn(0x562e781d3460 msgr2=0x562e78592e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- 172.21.15.102:0/2209469892 shutdown_connections 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- 172.21.15.102:0/2209469892 wait complete. 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 -- start start 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.961+0000 7f31273e7740 1 Processor -- start 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78595d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781be390 0x562e78596250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b45a0 con 0x562e781df070 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b5a10 con 0x562e781b61b0 2024-09-21T03:44:08.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b4c70 con 0x562e781be390 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f31273e7740 10 client.0 _ll_register_callbacks cb 0x7f311000ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51476/0 (socket says 172.21.15.102:51476) 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 -- 172.21.15.102:0/2295299346 learned_addr learned my addr 172.21.15.102:0/2295299346 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78595d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f311a59c640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781be390 0x562e78596250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 -- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781be390 msgr2=0x562e78596250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781be390 0x562e78596250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 -- 172.21.15.102:0/2295299346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 msgr2=0x562e78595d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78595d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 -- 172.21.15.102:0/2295299346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e7860d4d0 con 0x562e781df070 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3119d9b640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3110005fd0 tx=0x7f310c005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92327665952e8b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:08.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.962+0000 7f3101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3110034060 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f31100039c0 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c005870 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3110003bc0 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 10 client.17607 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562e7860e730 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f310c005870 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f311002f400 con 0x562e781df070 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 10 client.17607 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 10 client.17607 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 20 client.17607 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e78172da0 0x562e78610ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 4 client.17607 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:08.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.963+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 --> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e784fa8a0 con 0x562e78172da0 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f311a59c640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e78172da0 0x562e78610ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f311a59c640 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e78172da0 0x562e78610ed0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6be70bb96bcb070c server_cookie=a04e022441a7bc07 in_seq=0 out_seq=0 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f3101ffb640 10 client.17607 ms_handle_connect on v2:172.21.15.148:6836/1009058837 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f3101ffb640 1 -- 172.21.15.102:0/2295299346 <== mds.2 v2:172.21.15.148:6836/1009058837 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e784fa8a0 con 0x562e78172da0 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f3101ffb640 10 client.17607 handle_command_reply: tid=0 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 client.17607 shutdown 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 msgr2=0x562e78596790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f3110005fd0 tx=0x7f310c005a90 comp rx=0 tx=0).stop 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 shutdown_connections 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:6836/1009058837,v1:172.21.15.148:6837/1009058837] conn(0x562e78172da0 0x562e78610ed0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f3101ffb640 0 client.17607 ms_handle_reset on v2:172.21.15.148:6836/1009058837 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562e781df070 0x562e78596790 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x562e781be390 0x562e78596250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 --2- 172.21.15.102:0/2295299346 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x562e781b61b0 0x562e78595d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.964+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 >> 172.21.15.102:0/2295299346 conn(0x562e781d3460 msgr2=0x562e78592dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 shutdown_connections 2024-09-21T03:44:08.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f31273e7740 1 -- 172.21.15.102:0/2295299346 wait complete. 2024-09-21T03:44:08.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f31273e7740 20 client.17607 trim_cache size 0 max 16384 2024-09-21T03:44:08.972 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 msgr2=0x7f31040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 0x7f31040b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f31140cad10 tx=0x7f3114040000 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 msgr2=0x7f311c0ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3114005ab0 tx=0x7f31140042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 shutdown_connections 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f31040b6680 0x7f31040b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f311c108f50 0x7f311c0ff3a0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f311c108600 0x7f311c0fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 --2- 172.21.15.102:0/1098756736 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f311c1031c0 0x7f311c100870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 >> 172.21.15.102:0/1098756736 conn(0x7f311c079e30 msgr2=0x7f311c1011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:08.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 shutdown_connections 2024-09-21T03:44:08.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:08.965+0000 7f3120e73640 1 -- 172.21.15.102:0/1098756736 wait complete. 2024-09-21T03:44:09.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:08 smithi102 ceph-mon[31392]: pgmap v650: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:09.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:08 smithi148 ceph-mon[34651]: pgmap v650: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:09.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:08 smithi121 ceph-mon[34316]: pgmap v650: 97 pgs: 97 active+clean; 156 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:09.801 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T03:44:10.088 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:10.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 -- 172.21.15.102:0/3270184738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 msgr2=0x7f029c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 --2- 172.21.15.102:0/3270184738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c102e70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f028c009900 tx=0x7f028c02a410 comp rx=0 tx=0).stop 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 -- 172.21.15.102:0/3270184738 shutdown_connections 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 --2- 172.21.15.102:0/3270184738 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 0x7f029c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 --2- 172.21.15.102:0/3270184738 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 0x7f029c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 --2- 172.21.15.102:0/3270184738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c102e70 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 -- 172.21.15.102:0/3270184738 >> 172.21.15.102:0/3270184738 conn(0x7f029c079730 msgr2=0x7f029c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 -- 172.21.15.102:0/3270184738 shutdown_connections 2024-09-21T03:44:10.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.604+0000 7f02a1d84640 1 -- 172.21.15.102:0/3270184738 wait complete. 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 Processor -- start 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 -- start start 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 0x7f029c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 0x7f029c19ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f029c112b00 con 0x7f029c102a60 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f029c112980 con 0x7f029c1083a0 2024-09-21T03:44:10.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f02a1d84640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f029c112c80 con 0x7f029c108cf0 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f029b7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51496/0 (socket says 172.21.15.102:51496) 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f029b7fe640 1 -- 172.21.15.102:0/1785114671 learned_addr learned my addr 172.21.15.102:0/1785114671 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f0293fff640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 0x7f029c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.605+0000 7f029bfff640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 0x7f029c19ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 -- 172.21.15.102:0/1785114671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 msgr2=0x7f029c19ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 0x7f029c19ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 -- 172.21.15.102:0/1785114671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 msgr2=0x7f029c199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 0x7f029c199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 -- 172.21.15.102:0/1785114671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c19f3e0 con 0x7f029c102a60 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f029b7fe640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f028c006010 tx=0x7f028c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f02997fa640 1 -- 172.21.15.102:0/1785114671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c03f070 con 0x7f029c102a60 2024-09-21T03:44:10.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f02997fa640 1 -- 172.21.15.102:0/1785114671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f028c031e10 con 0x7f029c102a60 2024-09-21T03:44:10.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029c19f670 con 0x7f029c102a60 2024-09-21T03:44:10.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f02997fa640 1 -- 172.21.15.102:0/1785114671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c035030 con 0x7f029c102a60 2024-09-21T03:44:10.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.606+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029c1a5e30 con 0x7f029c102a60 2024-09-21T03:44:10.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.608+0000 7f02a82f8740 1 Processor -- start 2024-09-21T03:44:10.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 -- start start 2024-09-21T03:44:10.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 0x559043ffdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x559043ffe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559043f73ea0 con 0x559043c56070 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559043f632d0 con 0x559043c35390 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02a82f8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x559043f670e0 con 0x559043c2d1b0 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f02997fa640 1 -- 172.21.15.102:0/1785114671 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f028c042070 con 0x7f029c102a60 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51500/0 (socket says 172.21.15.102:51500) 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 -- 172.21.15.102:0/2646794891 learned_addr learned my addr 172.21.15.102:0/2646794891 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f0293fff640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x559043ffe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029b7fe640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 0x559043ffdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 -- 172.21.15.102:0/2646794891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 msgr2=0x559043ffdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 0x559043ffdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 -- 172.21.15.102:0/2646794891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 msgr2=0x559043ffe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x559043ffe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029bfff640 1 -- 172.21.15.102:0/2646794891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559043cc1650 con 0x559043c56070 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.609+0000 7f029b7fe640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 0x559043ffdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f029bfff640 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f029400a430 tx=0x7f0294009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797f627d4e3a75a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f0291ffb640 1 -- 172.21.15.102:0/2646794891 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294013790 con 0x559043c56070 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f0291ffb640 1 -- 172.21.15.102:0/2646794891 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0294019070 con 0x559043c56070 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f0291ffb640 1 -- 172.21.15.102:0/2646794891 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294014d50 con 0x559043c56070 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f02997fa640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 0x7f02880b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f029b7fe640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 0x7f02880b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.610+0000 7f02997fa640 1 -- 172.21.15.102:0/1785114671 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f028c108090 con 0x7f029c102a60 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- 172.21.15.102:0/2646794891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 msgr2=0x559043ffd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f029b7fe640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 0x7f02880b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f028c105820 tx=0x7f028c031a50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f029400a430 tx=0x7f0294009650 comp rx=0 tx=0).stop 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- 172.21.15.102:0/2646794891 shutdown_connections 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x559043ffe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c2d1b0 0x559043ffdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 --2- 172.21.15.102:0/2646794891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559043ffd6a0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- 172.21.15.102:0/2646794891 >> 172.21.15.102:0/2646794891 conn(0x559043c4a460 msgr2=0x559043ffb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- 172.21.15.102:0/2646794891 shutdown_connections 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- 172.21.15.102:0/2646794891 wait complete. 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 -- start start 2024-09-21T03:44:10.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.611+0000 7f02a82f8740 1 Processor -- start 2024-09-21T03:44:10.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c2d1b0 0x559044008cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x559044009200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559043dc4700 con 0x559043c56070 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559043efe160 con 0x559043c2d1b0 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55904400be80 con 0x559043c35390 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f02a82f8740 10 client.0 _ll_register_callbacks cb 0x559043f179e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51504/0 (socket says 172.21.15.102:51504) 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 -- 172.21.15.102:0/178681363 learned_addr learned my addr 172.21.15.102:0/178681363 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c2d1b0 0x559044008cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f0293fff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x559044009200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 -- 172.21.15.102:0/178681363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 msgr2=0x559044009200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x559044009200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 -- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c2d1b0 msgr2=0x559044008cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c2d1b0 0x559044008cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f029bfff640 1 -- 172.21.15.102:0/178681363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559043f2bc90 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.612+0000 7f0293fff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x559044009200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f029bfff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x559043fffb40 tx=0x7f0294014910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb6b26ea01fd62c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02940137a0 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f0294013940 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0294019070 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f0294013b40 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 10 client.17619 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559044017a30 con 0x559043c56070 2024-09-21T03:44:10.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0294019070 con 0x559043c56070 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f029401f410 con 0x559043c56070 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 10 client.17619 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 10 client.17619 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 20 client.17619 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043c149f0 0x55904401af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 4 client.17619 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.613+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559043f75df0 con 0x559043c149f0 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.614+0000 7f0293fff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043c149f0 0x55904401af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.614+0000 7f027affd640 10 client.17619 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.614+0000 7f0293fff640 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043c149f0 0x55904401af60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=213fcd9ac2a82390 server_cookie=a27ced9065b00f7c in_seq=0 out_seq=0 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f027affd640 1 -- 172.21.15.102:0/178681363 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559043f75df0 con 0x559043c149f0 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f027affd640 10 client.17619 handle_command_reply: tid=0 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 client.17619 shutdown 2024-09-21T03:44:10.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 msgr2=0x559044009740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x559043fffb40 tx=0x7f0294014910 comp rx=0 tx=0).stop 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 shutdown_connections 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043c149f0 0x55904401af60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c56070 0x559044009740 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x559044009200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 --2- 172.21.15.102:0/178681363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c2d1b0 0x559044008cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 >> 172.21.15.102:0/178681363 conn(0x559043c4a460 msgr2=0x559044000880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f027affd640 0 client.17619 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 shutdown_connections 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 1 -- 172.21.15.102:0/178681363 wait complete. 2024-09-21T03:44:10.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.615+0000 7f02a82f8740 20 client.17619 trim_cache size 0 max 16384 2024-09-21T03:44:10.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.628+0000 7f02a82f8740 1 Processor -- start 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.628+0000 7f02a82f8740 1 -- start start 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x55904400aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c56070 0x5590440147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1b1260 con 0x559043c2d1b0 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1aeb30 con 0x559043c56070 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f02a82f8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1ac9a0 con 0x559043c35390 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51506/0 (socket says 172.21.15.102:51506) 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 -- 172.21.15.102:0/1309500641 learned_addr learned my addr 172.21.15.102:0/1309500641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 -- 172.21.15.102:0/1309500641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 msgr2=0x55904400aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x55904400aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 -- 172.21.15.102:0/1309500641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c56070 msgr2=0x5590440147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c56070 0x5590440147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 -- 172.21.15.102:0/1309500641 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559043ffbad0 con 0x559043c2d1b0 2024-09-21T03:44:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.629+0000 7f029bfff640 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ad0 tx=0x7f029400ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dceb5df5cd217e35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02917fa640 1 -- 172.21.15.102:0/1309500641 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294009740 con 0x559043c2d1b0 2024-09-21T03:44:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02917fa640 1 -- 172.21.15.102:0/1309500641 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0294019070 con 0x559043c2d1b0 2024-09-21T03:44:10.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02917fa640 1 -- 172.21.15.102:0/1309500641 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029401e480 con 0x559043c2d1b0 2024-09-21T03:44:10.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 -- 172.21.15.102:0/1309500641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 msgr2=0x559043fff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f0294009ad0 tx=0x7f029400ade0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 -- 172.21.15.102:0/1309500641 shutdown_connections 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c56070 0x5590440147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c35390 0x55904400aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 --2- 172.21.15.102:0/1309500641 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x559043fff1a0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 -- 172.21.15.102:0/1309500641 >> 172.21.15.102:0/1309500641 conn(0x559043c4a460 msgr2=0x559044014090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.630+0000 7f02a82f8740 1 -- 172.21.15.102:0/1309500641 shutdown_connections 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 -- 172.21.15.102:0/1309500641 wait complete. 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 -- start start 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 Processor -- start 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x55904400ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c56070 0x559044083910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1acff0 con 0x559043c2d1b0 2024-09-21T03:44:10.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1ae460 con 0x559043c35390 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f029c1ad6c0 con 0x559043c56070 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f02a82f8740 10 client.0 _ll_register_callbacks cb 0x7f028400a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.631+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51514/0 (socket says 172.21.15.102:51514) 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 -- 172.21.15.102:0/480554461 learned_addr learned my addr 172.21.15.102:0/480554461 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f0293fff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x55904400ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c56070 0x559044083910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 -- 172.21.15.102:0/480554461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c56070 msgr2=0x559044083910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c56070 0x559044083910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 -- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 msgr2=0x55904400ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x55904400ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 -- 172.21.15.102:0/480554461 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55904400d280 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f0293fff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x55904400ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f029bfff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0294009690 tx=0x7f0294014910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2a7b46f55e5eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f027affd640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294014520 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f029401fbd0 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0294019070 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f029401fdd0 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f02a82f8740 10 client.17625 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.632+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x559044084e60 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f0294019070 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f029401e480 con 0x559043c2d1b0 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 10 client.17625 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:10.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 10 client.17625 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 20 client.17625 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043be9da0 0x5590440874a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 4 client.17625 mds_command: new command op to 24659 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 --> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559043f718a0 con 0x559043be9da0 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f0293fff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043be9da0 0x5590440874a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f0293fff640 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043be9da0 0x5590440874a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b081d31cf4919fa0 server_cookie=712aec22ad3fa5cc in_seq=0 out_seq=0 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.633+0000 7f027affd640 10 client.17625 ms_handle_connect on v2:172.21.15.121:6838/891322364 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f027affd640 1 -- 172.21.15.102:0/480554461 <== mds.1 v2:172.21.15.121:6838/891322364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559043f718a0 con 0x559043be9da0 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f027affd640 10 client.17625 handle_command_reply: tid=0 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 client.17625 shutdown 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 msgr2=0x55904400c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0294009690 tx=0x7f0294014910 comp rx=0 tx=0).stop 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 shutdown_connections 2024-09-21T03:44:10.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:6838/891322364,v1:172.21.15.121:6839/891322364] conn(0x559043be9da0 0x5590440874a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x559043c56070 0x559044083910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559043c35390 0x55904400ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 --2- 172.21.15.102:0/480554461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559043c2d1b0 0x55904400c4f0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 >> 172.21.15.102:0/480554461 conn(0x559043c4a460 msgr2=0x559044014090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f027affd640 0 client.17625 ms_handle_reset on v2:172.21.15.121:6838/891322364 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 shutdown_connections 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 1 -- 172.21.15.102:0/480554461 wait complete. 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.634+0000 7f02a82f8740 20 client.17625 trim_cache size 0 max 16384 2024-09-21T03:44:10.641 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:44:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 msgr2=0x7f02880b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 0x7f02880b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f028c105820 tx=0x7f028c031a50 comp rx=0 tx=0).stop 2024-09-21T03:44:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 msgr2=0x7f029c199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:10.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f028c006010 tx=0x7f028c004430 comp rx=0 tx=0).stop 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 shutdown_connections 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f02880b6700 0x7f02880b8c10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f029c108cf0 0x7f029c19ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f029c1083a0 0x7f029c199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 --2- 172.21.15.102:0/1785114671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f029c102a60 0x7f029c199470 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 >> 172.21.15.102:0/1785114671 conn(0x7f029c079730 msgr2=0x7f029c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 shutdown_connections 2024-09-21T03:44:10.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:10.635+0000 7f02a1d84640 1 -- 172.21.15.102:0/1785114671 wait complete. 2024-09-21T03:44:10.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:10 smithi121 ceph-mon[34316]: pgmap v651: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:10.954 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:10 smithi102 ceph-mon[31392]: pgmap v651: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:10.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:10 smithi148 ceph-mon[34651]: pgmap v651: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T03:44:11.534 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T03:44:11.778 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:12.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 -- 172.21.15.102:0/2305864449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4102a60 msgr2=0x7f1ac4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/2305864449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4102a60 0x7f1ac4102e70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009ca0 tx=0x7f1ab402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 -- 172.21.15.102:0/2305864449 shutdown_connections 2024-09-21T03:44:12.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/2305864449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4108cf0 0x7f1ac410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/2305864449 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/2305864449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4102a60 0x7f1ac4102e70 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 -- 172.21.15.102:0/2305864449 >> 172.21.15.102:0/2305864449 conn(0x7f1ac4079730 msgr2=0x7f1ac4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 -- 172.21.15.102:0/2305864449 shutdown_connections 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.281+0000 7f1acbd3c640 1 -- 172.21.15.102:0/2305864449 wait complete. 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 Processor -- start 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 -- start start 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4102a60 0x7f1ac419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4113ba0 con 0x7f1ac4108cf0 2024-09-21T03:44:12.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4113a20 con 0x7f1ac4102a60 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1acbd3c640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac4113d20 con 0x7f1ac41083a0 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51528/0 (socket says 172.21.15.102:51528) 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 -- 172.21.15.102:0/743551727 learned_addr learned my addr 172.21.15.102:0/743551727 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4102a60 0x7f1ac419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 -- 172.21.15.102:0/743551727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 msgr2=0x7f1ac419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 -- 172.21.15.102:0/743551727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4102a60 msgr2=0x7f1ac419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4102a60 0x7f1ac419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1aca2d9640 1 -- 172.21.15.102:0/743551727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac41a0440 con 0x7f1ac4108cf0 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.282+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:12.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00d750 tx=0x7f1abc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1ac2ffd640 1 -- 172.21.15.102:0/743551727 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc017070 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1ac2ffd640 1 -- 172.21.15.102:0/743551727 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1abc0054f0 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1ac2ffd640 1 -- 172.21.15.102:0/743551727 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004cd0 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ac41a0730 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.283+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ac41a6e90 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.285+0000 7f1ad22b0740 1 Processor -- start 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.285+0000 7f1ac2ffd640 1 -- 172.21.15.102:0/743551727 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f1abc009bd0 con 0x7f1ac4108cf0 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 -- start start 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401e966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ac61b0 0x55a401e96be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a401e0cea0 con 0x55a401ace390 2024-09-21T03:44:12.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a401dfc2d0 con 0x55a401aef070 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a401e000e0 con 0x55a401ac61b0 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51538/0 (socket says 172.21.15.102:51538) 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 -- 172.21.15.102:0/3014762708 learned_addr learned my addr 172.21.15.102:0/3014762708 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401e966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ac61b0 0x55a401e96be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 -- 172.21.15.102:0/3014762708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ac61b0 msgr2=0x55a401e96be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ac61b0 0x55a401e96be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 -- 172.21.15.102:0/3014762708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 msgr2=0x55a401e966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401e966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac92d7640 1 -- 172.21.15.102:0/3014762708 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a401b5a650 con 0x55a401ace390 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.286+0000 7f1ac2ffd640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 0x7f1aac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800bf70 tx=0x7f1ab800b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a236e3ccfa8881a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 0x7f1aac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1aabfff640 1 -- 172.21.15.102:0/3014762708 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8018030 con 0x55a401ace390 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1ac2ffd640 1 -- 172.21.15.102:0/743551727 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f1abc0e7180 con 0x7f1ac4108cf0 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1aabfff640 1 -- 172.21.15.102:0/3014762708 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ab8010720 con 0x55a401ace390 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.287+0000 7f1aabfff640 1 -- 172.21.15.102:0/3014762708 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80038a0 con 0x55a401ace390 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3014762708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 msgr2=0x55a401e97120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 0x7f1aac0b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55a401e95320 tx=0x7f1ab4009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800bf70 tx=0x7f1ab800b640 comp rx=0 tx=0).stop 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3014762708 shutdown_connections 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401e97120 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ac61b0 0x55a401e96be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3014762708 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401e966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3014762708 >> 172.21.15.102:0/3014762708 conn(0x55a401ae3460 msgr2=0x55a401e94590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3014762708 shutdown_connections 2024-09-21T03:44:12.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3014762708 wait complete. 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 -- start start 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.288+0000 7f1ad22b0740 1 Processor -- start 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401ea1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a401c5d700 con 0x55a401aef070 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a401d97160 con 0x55a401ac61b0 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x55a401ea4e80 con 0x55a401ace390 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ad22b0740 10 client.0 _ll_register_callbacks cb 0x55a401db09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51542/0 (socket says 172.21.15.102:51542) 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 -- 172.21.15.102:0/1592222485 learned_addr learned my addr 172.21.15.102:0/1592222485 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401ea1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 -- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 msgr2=0x55a401ea2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 -- 172.21.15.102:0/1592222485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 msgr2=0x55a401ea1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401ea1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.289+0000 7f1aca2d9640 1 -- 172.21.15.102:0/1592222485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a401dc4c90 con 0x55a401aef070 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00d720 tx=0x7f1abc0aca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9c03f98525987c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc020070 con 0x55a401aef070 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f1abc0abcd0 con 0x55a401aef070 2024-09-21T03:44:12.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ab8010720 con 0x55a401aef070 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.290+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1abc0b4e60 con 0x55a401aef070 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 10 client.17637 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a401eb0bb0 con 0x55a401aef070 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ab8010720 con 0x55a401aef070 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1abc0abed0 con 0x55a401aef070 2024-09-21T03:44:12.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 10 client.17637 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 10 client.17637 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 20 client.17637 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401aad9f0 0x55a401eb40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 4 client.17637 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a401e0edf0 con 0x55a401aad9f0 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.291+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401aad9f0 0x55a401eb40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.292+0000 7f1aa97fa640 10 client.17637 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.292+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401aad9f0 0x55a401eb40c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60be11d3ba120d1d server_cookie=e94fb684bb745141 in_seq=0 out_seq=0 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1592222485 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a401e0edf0 con 0x55a401aad9f0 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1aa97fa640 10 client.17637 handle_command_reply: tid=0 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 client.17637 shutdown 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 msgr2=0x55a401eae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00d720 tx=0x7f1abc0aca10 comp rx=0 tx=0).stop 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 shutdown_connections 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401aad9f0 0x55a401eb40c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401aef070 0x55a401eae1d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1592222485 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401ea1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 >> 172.21.15.102:0/1592222485 conn(0x55a401ae3460 msgr2=0x55a401e99830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.293+0000 7f1aa97fa640 0 client.17637 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.294+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 shutdown_connections 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.294+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1592222485 wait complete. 2024-09-21T03:44:12.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.294+0000 7f1ad22b0740 20 client.17637 trim_cache size 0 max 16384 2024-09-21T03:44:12.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.307+0000 7f1ad22b0740 1 Processor -- start 2024-09-21T03:44:12.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.307+0000 7f1ad22b0740 1 -- start start 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401ea2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41b2210 con 0x55a401ac61b0 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41afae0 con 0x55a401aef070 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41ad950 con 0x55a401ace390 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51552/0 (socket says 172.21.15.102:51552) 2024-09-21T03:44:12.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 -- 172.21.15.102:0/3623836760 learned_addr learned my addr 172.21.15.102:0/3623836760 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401ea2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 -- 172.21.15.102:0/3623836760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 msgr2=0x55a401ea1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 -- 172.21.15.102:0/3623836760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 msgr2=0x55a401ea2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401ea2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 -- 172.21.15.102:0/3623836760 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a401e9d880 con 0x55a401ac61b0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.308+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009ca0 tx=0x7f1ab4044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55107e30078cb81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.309+0000 7f1aab7fe640 1 -- 172.21.15.102:0/3623836760 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4031450 con 0x55a401ac61b0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.309+0000 7f1aab7fe640 1 -- 172.21.15.102:0/3623836760 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ab4036050 con 0x55a401ac61b0 2024-09-21T03:44:12.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.309+0000 7f1aab7fe640 1 -- 172.21.15.102:0/3623836760 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4030820 con 0x55a401ac61b0 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3623836760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 msgr2=0x55a401eae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009ca0 tx=0x7f1ab4044000 comp rx=0 tx=0).stop 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3623836760 shutdown_connections 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401aef070 0x55a401ea2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401ace390 0x55a401ea1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/3623836760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ac61b0 0x55a401eae0d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3623836760 >> 172.21.15.102:0/3623836760 conn(0x55a401ae3460 msgr2=0x55a401ea0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3623836760 shutdown_connections 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- 172.21.15.102:0/3623836760 wait complete. 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 -- start start 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.310+0000 7f1ad22b0740 1 Processor -- start 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401eaab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401aef070 0x55a401ea6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41adfa0 con 0x55a401ace390 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41af410 con 0x55a401ac61b0 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac41ae670 con 0x55a401aef070 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ad22b0740 10 client.0 _ll_register_callbacks cb 0x7f1abc00de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51558/0 (socket says 172.21.15.102:51558) 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 -- 172.21.15.102:0/1916581114 learned_addr learned my addr 172.21.15.102:0/1916581114 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401eaab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 -- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401aef070 msgr2=0x55a401ea6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1aca2d9640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401aef070 0x55a401ea6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401aef070 0x55a401ea6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 -- 172.21.15.102:0/1916581114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 msgr2=0x55a401eaab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401eaab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 -- 172.21.15.102:0/1916581114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a401f1dad0 con 0x55a401ace390 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1ac92d7640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006010 tx=0x7f1ab80055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d69848b5f56512 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.102:3300/0 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.311+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab802c060 con 0x55a401ace390 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ab4036050 con 0x55a401ace390 2024-09-21T03:44:12.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mon.0 v2:172.21.15.102:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f1ab8010720 con 0x55a401ace390 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ab8018040 con 0x55a401ace390 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 10 client.17643 fetch_fsmap learned FSMap version 35 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a401f1ec50 con 0x55a401ace390 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mon.0 v2:172.21.15.102:3300/0 4 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f1ab4036050 con 0x55a401ace390 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mon.0 v2:172.21.15.102:3300/0 5 ==== fsmap(e 35) ==== 8346+0+0 (secure 0 0 0) 0x7f1ab8004b90 con 0x55a401ace390 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 10 client.17643 fetch_fsmap finished waiting for FSMap version 35 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 10 client.17643 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 20 client.17643 populate_metadata read hostname 'smithi102' 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401a82da0 0x55a401f20fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 4 client.17643 mds_command: new command op to 24661 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.312+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 --> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a401e0a8a0 con 0x55a401a82da0 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401a82da0 0x55a401f20fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1aa97fa640 10 client.17643 ms_handle_connect on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:12.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1ac9ad8640 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401a82da0 0x55a401f20fd0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ae0802946b52e0 server_cookie=2706e803d0f8df in_seq=0 out_seq=0 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1aa97fa640 1 -- 172.21.15.102:0/1916581114 <== mds.0 v2:172.21.15.148:6838/3369184447 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a401e0a8a0 con 0x55a401a82da0 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1aa97fa640 10 client.17643 handle_command_reply: tid=0 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1ad22b0740 1 client.17643 shutdown 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.313+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 msgr2=0x55a401ea6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8006010 tx=0x7f1ab80055f0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 shutdown_connections 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:6838/3369184447,v1:172.21.15.148:6839/3369184447] conn(0x55a401a82da0 0x55a401f20fd0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a401ace390 0x55a401ea6060 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1aa97fa640 0 client.17643 ms_handle_reset on v2:172.21.15.148:6838/3369184447 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x55a401aef070 0x55a401ea6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 --2- 172.21.15.102:0/1916581114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a401ac61b0 0x55a401eaab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 >> 172.21.15.102:0/1916581114 conn(0x55a401ae3460 msgr2=0x55a401ea1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 shutdown_connections 2024-09-21T03:44:12.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 1 -- 172.21.15.102:0/1916581114 wait complete. 2024-09-21T03:44:12.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1ad22b0740 20 client.17643 trim_cache size 0 max 16384 2024-09-21T03:44:12.321 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-21T03:44:12.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 msgr2=0x7f1aac0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 0x7f1aac0b8c10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55a401e95320 tx=0x7f1ab4009440 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 msgr2=0x7f1ac419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f1abc00d750 tx=0x7f1abc00dc10 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 shutdown_connections 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f1aac0b6700 0x7f1aac0b8c10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ac4108cf0 0x7f1ac419fd10 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f1ac41083a0 0x7f1ac419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 --2- 172.21.15.102:0/743551727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ac4102a60 0x7f1ac419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.314+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 >> 172.21.15.102:0/743551727 conn(0x7f1ac4079730 msgr2=0x7f1ac4101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.315+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 shutdown_connections 2024-09-21T03:44:12.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:12.315+0000 7f1acbd3c640 1 -- 172.21.15.102:0/743551727 wait complete. 2024-09-21T03:44:12.646 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:12 smithi102 ceph-mon[31392]: pgmap v652: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:44:12.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:12 smithi121 ceph-mon[34316]: pgmap v652: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:44:12.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:12 smithi148 ceph-mon[34651]: pgmap v652: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 28 KiB/s wr, 10 op/s 2024-09-21T03:44:13.058 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T03:44:13.058 INFO:tasks.fwd_scrub:done joining 2024-09-21T03:44:13.058 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T03:44:13.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T03:44:13.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- 172.21.15.102:0/4122876788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa760107a90 msgr2=0x7fa760107ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 --2- 172.21.15.102:0/4122876788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa760107a90 0x7fa760107ea0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa75000aa10 tx=0x7fa75002b720 comp rx=0 tx=0).stop 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- 172.21.15.102:0/4122876788 shutdown_connections 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 --2- 172.21.15.102:0/4122876788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa760107a90 0x7fa760107ea0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 --2- 172.21.15.102:0/4122876788 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601083e0 0x7fa76010ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 --2- 172.21.15.102:0/4122876788 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa7601021b0 0x7fa7601025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- 172.21.15.102:0/4122876788 >> 172.21.15.102:0/4122876788 conn(0x7fa760079d00 msgr2=0x7fa76007a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- 172.21.15.102:0/4122876788 shutdown_connections 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- 172.21.15.102:0/4122876788 wait complete. 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 Processor -- start 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.183+0000 7fa767f39640 1 -- start start 2024-09-21T03:44:13.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601021b0 0x7fa76019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 0x7fa76019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111930 con 0x7fa7601083e0 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa7601117b0 con 0x7fa760107a90 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fa760111ab0 con 0x7fa7601021b0 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51566/0 (socket says 172.21.15.102:51566) 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 -- 172.21.15.102:0/930040540 learned_addr learned my addr 172.21.15.102:0/930040540 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa765cd5640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601021b0 0x7fa76019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7654d4640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 0x7fa76019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 -- 172.21.15.102:0/930040540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601021b0 msgr2=0x7fa76019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601021b0 0x7fa76019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 -- 172.21.15.102:0/930040540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 msgr2=0x7fa76019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 0x7fa76019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 -- 172.21.15.102:0/930040540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7601a0410 con 0x7fa7601083e0 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7654d4640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 0x7fa76019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa7664d6640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa75800eaa0 tx=0x7fa75800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75800cdb0 con 0x7fa7601083e0 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fa758005020 con 0x7fa7601083e0 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7601a0700 con 0x7fa7601083e0 2024-09-21T03:44:13.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7580116d0 con 0x7fa7601083e0 2024-09-21T03:44:13.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.184+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7601a6e90 con 0x7fa7601083e0 2024-09-21T03:44:13.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.185+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7601025c0 con 0x7fa7601083e0 2024-09-21T03:44:13.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.187+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fa7580051d0 con 0x7fa7601083e0 2024-09-21T03:44:13.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.188+0000 7fa756ffd640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 0x7fa74c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.188+0000 7fa765cd5640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 0x7fa74c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.188+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7fa7580e79d0 con 0x7fa7601083e0 2024-09-21T03:44:13.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.188+0000 7fa765cd5640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 0x7fa74c0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00bbe0 tx=0x7fa75c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.192+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa758016030 con 0x7fa7601083e0 2024-09-21T03:44:13.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.372+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa760109c20 con 0x7fa7601083e0 2024-09-21T03:44:13.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.373+0000 7fa756ffd640 1 -- 172.21.15.102:0/930040540 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23449 (secure 0 0 0) 0x7fa7580adeb0 con 0x7fa7601083e0 2024-09-21T03:44:13.376 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:13.376 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":90,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:44:06.966304+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:44:13.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.375+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 msgr2=0x7fa74c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.375+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 0x7fa74c0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00bbe0 tx=0x7fa75c00b390 comp rx=0 tx=0).stop 2024-09-21T03:44:13.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 msgr2=0x7fa76019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa75800eaa0 tx=0x7fa75800ef60 comp rx=0 tx=0).stop 2024-09-21T03:44:13.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 shutdown_connections 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fa74c0b6680 0x7fa74c0b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7601083e0 0x7fa76019fd10 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa760107a90 0x7fa76019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 --2- 172.21.15.102:0/930040540 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fa7601021b0 0x7fa76019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 >> 172.21.15.102:0/930040540 conn(0x7fa760079d00 msgr2=0x7fa760103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 shutdown_connections 2024-09-21T03:44:13.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.376+0000 7fa767f39640 1 -- 172.21.15.102:0/930040540 wait complete. 2024-09-21T03:44:13.390 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:27:06.439475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T03:31:37.203364+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T03:31:39.048176+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '90', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 90, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:44:13.390 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T03:44:13.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 -- 172.21.15.102:0/1154775795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26481082c0 msgr2=0x7f26481086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 --2- 172.21.15.102:0/1154775795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26481082c0 0x7f26481086d0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f263c009900 tx=0x7f263c02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 -- 172.21.15.102:0/1154775795 shutdown_connections 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 --2- 172.21.15.102:0/1154775795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f26481082c0 0x7f26481086d0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 --2- 172.21.15.102:0/1154775795 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f2648108c10 0x7f264810f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 --2- 172.21.15.102:0/1154775795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 0x7f2648102da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 -- 172.21.15.102:0/1154775795 >> 172.21.15.102:0/1154775795 conn(0x7f26480fe3b0 msgr2=0x7f2648100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 -- 172.21.15.102:0/1154775795 shutdown_connections 2024-09-21T03:44:13.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.500+0000 7f264e1da640 1 -- 172.21.15.102:0/1154775795 wait complete. 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 Processor -- start 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 -- start start 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 0x7f264819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26481082c0 0x7f264819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f26481129f0 con 0x7f2648108c10 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2648112870 con 0x7f2648102990 2024-09-21T03:44:13.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f264e1da640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f2648112b70 con 0x7f26481082c0 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f2647fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f2647fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51582/0 (socket says 172.21.15.102:51582) 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f2647fff640 1 -- 172.21.15.102:0/1907814423 learned_addr learned my addr 172.21.15.102:0/1907814423 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f26477fe640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 0x7f264819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.501+0000 7f2646ffd640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26481082c0 0x7f264819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 -- 172.21.15.102:0/1907814423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26481082c0 msgr2=0x7f264819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26481082c0 0x7f264819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 -- 172.21.15.102:0/1907814423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 msgr2=0x7f264819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 0x7f264819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 -- 172.21.15.102:0/1907814423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26481a02e0 con 0x7f2648108c10 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2647fff640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f264000c970 tx=0x7f264000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2640007bb0 con 0x7f2648108c10 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f2640007d50 con 0x7f2648108c10 2024-09-21T03:44:13.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26400187c0 con 0x7f2648108c10 2024-09-21T03:44:13.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26481a05d0 con 0x7f2648108c10 2024-09-21T03:44:13.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.502+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26481a6df0 con 0x7f2648108c10 2024-09-21T03:44:13.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.503+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2648102da0 con 0x7f2648108c10 2024-09-21T03:44:13.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.504+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f264000fa40 con 0x7f2648108c10 2024-09-21T03:44:13.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.505+0000 7f2644ff9640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 0x7f26300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.505+0000 7f26477fe640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 0x7f26300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.505+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f26400e7890 con 0x7f2648108c10 2024-09-21T03:44:13.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.506+0000 7f26477fe640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 0x7f26300b8c10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2638007ec0 tx=0x7f26380075b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.508+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2640014030 con 0x7f2648108c10 2024-09-21T03:44:13.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.688+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f264810ba50 con 0x7f2648108c10 2024-09-21T03:44:13.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.688+0000 7f2644ff9640 1 -- 172.21.15.102:0/1907814423 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f26400ade80 con 0x7f2648108c10 2024-09-21T03:44:13.690 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 1 2024-09-21T03:44:13.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 msgr2=0x7f26300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 0x7f26300b8c10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2638007ec0 tx=0x7f26380075b0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 msgr2=0x7f264819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f264000c970 tx=0x7f264000ce30 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 shutdown_connections 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f26300b6700 0x7f26300b8c10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2648108c10 0x7f264819fc70 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f26481082c0 0x7f264819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 --2- 172.21.15.102:0/1907814423 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2648102990 0x7f264819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 >> 172.21.15.102:0/1907814423 conn(0x7f26480fe3b0 msgr2=0x7f264806aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 shutdown_connections 2024-09-21T03:44:13.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.690+0000 7f264e1da640 1 -- 172.21.15.102:0/1907814423 wait complete. 2024-09-21T03:44:13.702 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:13 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/930040540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:13.704 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T03:44:13.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:13 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/930040540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.815+0000 7f58f8bb0640 1 -- 172.21.15.102:0/4051593838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 msgr2=0x7f58f4110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.815+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/4051593838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f4110240 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009ca0 tx=0x7f58ec02a8e0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 -- 172.21.15.102:0/4051593838 shutdown_connections 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/4051593838 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f4110240 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/4051593838 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 0x7f58f410d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/4051593838 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 0x7f58f4104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 -- 172.21.15.102:0/4051593838 >> 172.21.15.102:0/4051593838 conn(0x7f58f40fe3b0 msgr2=0x7f58f4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:13.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 -- 172.21.15.102:0/4051593838 shutdown_connections 2024-09-21T03:44:13.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 -- 172.21.15.102:0/4051593838 wait complete. 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.816+0000 7f58f8bb0640 1 Processor -- start 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 -- start start 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 0x7f58f419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 0x7f58f419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4113b80 con 0x7f58f410dd30 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4113a00 con 0x7f58f4104780 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f8bb0640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f58f4113d00 con 0x7f58f41051b0 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51592/0 (socket says 172.21.15.102:51592) 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 -- 172.21.15.102:0/2884027537 learned_addr learned my addr 172.21.15.102:0/2884027537 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:13.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f259c640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 0x7f58f419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58e9d9b640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 0x7f58f419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 -- 172.21.15.102:0/2884027537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 msgr2=0x7f58f419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 0x7f58f419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 -- 172.21.15.102:0/2884027537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 msgr2=0x7f58f419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 0x7f58f419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.817+0000 7f58f2d9d640 1 -- 172.21.15.102:0/2884027537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f41a04d0 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58f2d9d640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009dc0 tx=0x7f58ec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec004040 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f58ec0046b0 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f41a0760 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec03b400 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.818+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f41a6f50 con 0x7f58f410dd30 2024-09-21T03:44:13.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.819+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f4104c10 con 0x7f58f410dd30 2024-09-21T03:44:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.820+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f58ec0305e0 con 0x7f58f410dd30 2024-09-21T03:44:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.821+0000 7f58ebfff640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 0x7f58e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.821+0000 7f58f259c640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 0x7f58e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:13.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.821+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f58ec108d50 con 0x7f58f410dd30 2024-09-21T03:44:13.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.822+0000 7f58f259c640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 0x7f58e00b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009890 tx=0x7f58e4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:13.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.824+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58ec0cf230 con 0x7f58f410dd30 2024-09-21T03:44:13.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:13 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/930040540' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:14.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.999+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f58f41a7180 con 0x7f58f410dd30 2024-09-21T03:44:14.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:13.999+0000 7f58ebfff640 1 -- 172.21.15.102:0/2884027537 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f58ec0d3610 con 0x7f58f410dd30 2024-09-21T03:44:14.001 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 32 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 msgr2=0x7f58e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 0x7f58e00b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f58e4009890 tx=0x7f58e4008040 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 msgr2=0x7f58f419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f58ec009dc0 tx=0x7f58ec003ba0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 shutdown_connections 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f58e00b6680 0x7f58e00b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f58f410dd30 0x7f58f419fdd0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f58f41051b0 0x7f58f419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 --2- 172.21.15.102:0/2884027537 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f58f4104780 0x7f58f419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.001+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 >> 172.21.15.102:0/2884027537 conn(0x7f58f40fe3b0 msgr2=0x7f58f4100f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.002+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 shutdown_connections 2024-09-21T03:44:14.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.002+0000 7f58f8bb0640 1 -- 172.21.15.102:0/2884027537 wait complete. 2024-09-21T03:44:14.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.124+0000 7ff8c5027640 1 -- 172.21.15.102:0/1448836983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0108300 msgr2=0x7ff8c0108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.124+0000 7ff8c5027640 1 --2- 172.21.15.102:0/1448836983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0108300 0x7ff8c0108710 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009900 tx=0x7ff8a802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 -- 172.21.15.102:0/1448836983 shutdown_connections 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 --2- 172.21.15.102:0/1448836983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0108300 0x7ff8c0108710 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 --2- 172.21.15.102:0/1448836983 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 0x7ff8c010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 --2- 172.21.15.102:0/1448836983 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0102a20 0x7ff8c0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 -- 172.21.15.102:0/1448836983 >> 172.21.15.102:0/1448836983 conn(0x7ff8c0079630 msgr2=0x7ff8c0079a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 -- 172.21.15.102:0/1448836983 shutdown_connections 2024-09-21T03:44:14.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 -- 172.21.15.102:0/1448836983 wait complete. 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.125+0000 7ff8c5027640 1 Processor -- start 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 -- start start 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0108300 0x7ff8c019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 0x7ff8c019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c0112a70 con 0x7ff8c0102a20 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c01128f0 con 0x7ff8c0108c50 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8c5027640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c0112bf0 con 0x7ff8c0108300 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51010/0 (socket says 172.21.15.102:51010) 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 -- 172.21.15.102:0/2321384538 learned_addr learned my addr 172.21.15.102:0/2321384538 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bf59e640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 0x7ff8c019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8b659c640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0108300 0x7ff8c019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 -- 172.21.15.102:0/2321384538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0108300 msgr2=0x7ff8c019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0108300 0x7ff8c019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 -- 172.21.15.102:0/2321384538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 msgr2=0x7ff8c019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 0x7ff8c019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.126+0000 7ff8bed9d640 1 -- 172.21.15.102:0/2321384538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c01a0510 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8bed9d640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b4a0 tx=0x7ff8b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0014070 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ff8b0010ae0 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c01a0800 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0017ce0 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.127+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c01a6f90 con 0x7ff8c0102a20 2024-09-21T03:44:14.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.128+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c0102e30 con 0x7ff8c0102a20 2024-09-21T03:44:14.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.130+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ff8b0017070 con 0x7ff8c0102a20 2024-09-21T03:44:14.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.131+0000 7ff8bcd99640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 0x7ff8ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.131+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7ff8b00e6e60 con 0x7ff8c0102a20 2024-09-21T03:44:14.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.131+0000 7ff8b659c640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 0x7ff8ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.132+0000 7ff8b659c640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 0x7ff8ac0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009230 tx=0x7ff8a8032c70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.134+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8b00ad2e0 con 0x7ff8c0102a20 2024-09-21T03:44:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.312+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8c010bab0 con 0x7ff8c0102a20 2024-09-21T03:44:14.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.312+0000 7ff8bcd99640 1 -- 172.21.15.102:0/2321384538 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7ff8b00b16c0 con 0x7ff8c0102a20 2024-09-21T03:44:14.314 INFO:teuthology.orchestra.run.smithi102.stdout:pg_num: 64 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 msgr2=0x7ff8ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 0x7ff8ac0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8009230 tx=0x7ff8a8032c70 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 msgr2=0x7ff8c019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000b4a0 tx=0x7ff8b000b960 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 shutdown_connections 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ff8ac0b6680 0x7ff8ac0b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8c0108c50 0x7ff8c019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ff8c0108300 0x7ff8c019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 --2- 172.21.15.102:0/2321384538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff8c0102a20 0x7ff8c019a5e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.314+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 >> 172.21.15.102:0/2321384538 conn(0x7ff8c0079630 msgr2=0x7ff8c006bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.315+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 shutdown_connections 2024-09-21T03:44:14.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.315+0000 7ff8c5027640 1 -- 172.21.15.102:0/2321384538 wait complete. 2024-09-21T03:44:14.328 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3337947175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf41051c0 msgr2=0x7f5bf410d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3337947175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf41051c0 0x7f5bf410d800 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009900 tx=0x7f5bf002a410 comp rx=0 tx=0).stop 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3337947175 shutdown_connections 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3337947175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf41051c0 0x7f5bf410d800 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3337947175 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf410dd40 0x7f5bf4110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3337947175 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf4104790 0x7f5bf4104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3337947175 >> 172.21.15.102:0/3337947175 conn(0x7f5bf40fe380 msgr2=0x7f5bf41007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3337947175 shutdown_connections 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.436+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3337947175 wait complete. 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 Processor -- start 2024-09-21T03:44:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 -- start start 2024-09-21T03:44:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf4104790 0x7f5bf419c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf41051c0 0x7f5bf419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4113ac0 con 0x7f5bf410dd40 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4113940 con 0x7f5bf41051c0 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfc40a640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf4113c40 con 0x7f5bf4104790 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:51022/0 (socket says 172.21.15.102:51022) 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 -- 172.21.15.102:0/3122876847 learned_addr learned my addr 172.21.15.102:0/3122876847 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bf99a5640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf41051c0 0x7f5bf419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa1a6640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf4104790 0x7f5bf419c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 -- 172.21.15.102:0/3122876847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf4104790 msgr2=0x7f5bf419c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf4104790 0x7f5bf419c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 -- 172.21.15.102:0/3122876847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf41051c0 msgr2=0x7f5bf419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.437+0000 7f5bfa9a7640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf41051c0 0x7f5bf419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5bfa9a7640 1 -- 172.21.15.102:0/3122876847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf41a25d0 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5bfa9a7640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00eaa0 tx=0x7f5bec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00cdb0 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f5bec005020 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0116d0 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf41a28c0 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.438+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf41a9050 con 0x7f5bf410dd40 2024-09-21T03:44:14.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.439+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf406ad80 con 0x7f5bf410dd40 2024-09-21T03:44:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.440+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f5bec0051d0 con 0x7f5bf410dd40 2024-09-21T03:44:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.441+0000 7f5beb7fe640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 0x7f5be00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.441+0000 7f5bfa1a6640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 0x7f5be00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.441+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8630+0+0 (secure 0 0 0) 0x7f5bec0e7dd0 con 0x7f5bf410dd40 2024-09-21T03:44:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.442+0000 7f5bfa1a6640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 0x7f5be00b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5be4005fd0 tx=0x7f5be4005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.444+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bec016030 con 0x7f5bf410dd40 2024-09-21T03:44:14.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.670+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5bf419d7c0 con 0x7f5bf410dd40 2024-09-21T03:44:14.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.678+0000 7f5beb7fe640 1 -- 172.21.15.102:0/3122876847 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+834062 (secure 0 0 0) 0x7f5bec0ae2b0 con 0x7f5bf410dd40 2024-09-21T03:44:14.685 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:14.685 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:14.685 INFO:teuthology.orchestra.run.smithi102.stdout: "epoch": 24, 2024-09-21T03:44:14.685 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "active_gid": 14223, 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "active_name": "x", 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "active_addrs": { 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6800", 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1995339284 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v1", 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:6801", 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1995339284 2024-09-21T03:44:14.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "active_addr": "172.21.15.102:6801/1995339284", 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "active_change": "2024-09-21T03:25:04.133551+0000", 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "available": true, 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "standbys": [ 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "gid": 24133, 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "z", 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: "available_modules": [ 2024-09-21T03:44:14.687 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "alerts", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.688 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.689 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.690 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.691 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.692 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.693 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_destination": { 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_destination", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.694 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_from_name": { 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_from_name", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.695 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "Ceph", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email From: name", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.696 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_host": { 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_host", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.697 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP server", 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_password": { 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_password", 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Password to authenticate with", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.699 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_port": { 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_port", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "465", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP port", 2024-09-21T03:44:14.700 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_sender": { 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_sender", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.701 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_ssl": { 2024-09-21T03:44:14.702 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_ssl", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.703 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_user": { 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_user", 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.704 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "User to authenticate as", 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.705 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "balancer", 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "active": { 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "active", 2024-09-21T03:44:14.707 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.708 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_time": { 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_time", 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.709 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0000", 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_weekday": { 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_weekday", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.711 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_max_iterations": { 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "25", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "250", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.712 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_metrics": { 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_metrics", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.713 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_step": { 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_step", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.5", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0.001", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "0.999", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.714 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "end_time": { 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_time", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2359", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.715 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "end_weekday": { 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_weekday", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.717 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.718 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.719 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.720 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.721 INFO:teuthology.orchestra.run.smithi102.stdout: "min_score": { 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_score", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "upmap", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-compat", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "none", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "read", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap", 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap-read" 2024-09-21T03:44:14.723 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Balancer mode", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_ids": { 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_ids", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.724 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.725 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.726 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_deviation": { 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_deviation", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:14.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_optimizations": { 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.728 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm", 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.729 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_down_multiplier": { 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_down_multiplier", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.730 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_refresh_rate": { 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_refresh_rate", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "20", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.731 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_starting_port": { 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_starting_port", 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.732 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4721", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_ptrace": { 2024-09-21T03:44:14.733 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_ptrace", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:44:14.734 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_interval": { 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_interval", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.735 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:44:14.736 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.7", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.737 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm_log_destination": { 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm_log_destination", 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.738 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "file", 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "file,syslog", 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: "syslog" 2024-09-21T03:44:14.739 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "cgroups_split": { 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cgroups_split", 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.740 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.741 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "config_checks_enabled": { 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_checks_enabled", 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.742 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "config_dashboard": { 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_dashboard", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.743 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_alertmanager": { 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_alertmanager", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.744 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_base": { 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_base", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:44:14.745 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_elasticsearch": { 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.746 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "elasticsearch container image", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_grafana": { 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_grafana", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.747 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_haproxy": { 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_haproxy", 2024-09-21T03:44:14.748 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.749 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "HAproxy container image", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_agent": { 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.750 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_collector": { 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.751 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_query": { 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.752 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger query container image", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_keepalived": { 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_keepalived", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Keepalived container image", 2024-09-21T03:44:14.754 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_loki": { 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_loki", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.755 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Loki container image", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nginx": { 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nginx", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.756 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nginx container image", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_node_exporter": { 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_node_exporter", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.757 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nvmeof": { 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nvmeof", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.758 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nvme-of container image", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.759 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_prometheus": { 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_prometheus", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.760 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_promtail": { 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_promtail", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.761 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Promtail container image", 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.762 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba": { 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba_metrics": { 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.764 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_snmp_gateway": { 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.765 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.766 INFO:teuthology.orchestra.run.smithi102.stdout: "container_init": { 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_init", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.767 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "daemon_cache_timeout": { 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.768 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.769 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "900", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.770 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "default_registry": { 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_registry", 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.771 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io", 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "device_cache_timeout": { 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_cache_timeout", 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.773 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1800", 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "device_enhanced_scan": { 2024-09-21T03:44:14.774 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_enhanced_scan", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.775 INFO:teuthology.orchestra.run.smithi102.stdout: "facts_cache_timeout": { 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "facts_cache_timeout", 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.776 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "grafana_dashboards_path": { 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.777 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "host_check_interval": { 2024-09-21T03:44:14.778 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "host_check_interval", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "hw_monitoring": { 2024-09-21T03:44:14.779 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hw_monitoring", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:44:14.780 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "inventory_list_all": { 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "inventory_list_all", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:44:14.781 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.782 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "log_refresh_metadata": { 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_refresh_metadata", 2024-09-21T03:44:14.783 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.784 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.785 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.786 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.787 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:44:14.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:44:14.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "*", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "max_count_per_host": { 2024-09-21T03:44:14.790 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_count_per_host", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.791 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd_draining_count": { 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_osd_draining_count", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.792 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "migration_current": { 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "migration_current", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "internal - do not modify", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.793 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "root", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.794 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm-package", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "root" 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "oob_default_addr": { 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "oob_default_addr", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.795 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "169.254.1.1", 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.796 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "prometheus_alerts_path": { 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.797 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_insecure": { 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_insecure", 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.798 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_password": { 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_password", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.799 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_url": { 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_url", 2024-09-21T03:44:14.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.801 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_username": { 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_username", 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.802 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.803 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "secure_monitoring_stack": { 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.804 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "service_discovery_port": { 2024-09-21T03:44:14.805 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "service_discovery_port", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8765", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.806 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.807 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.808 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_config_file": { 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_config_file", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:44:14.809 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:44:14.810 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_interval": { 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.811 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "use_agent": { 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_agent", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:44:14.812 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "use_repo_digest": { 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_repo_digest", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:44:14.813 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_failed_host_check": { 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:44:14.814 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_daemons": { 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.815 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_hosts": { 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.816 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crash", 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.818 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.819 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.820 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.821 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.822 INFO:teuthology.orchestra.run.smithi102.stdout: "retain_interval": { 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retain_interval", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "31536000", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.824 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_recent_interval": { 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_recent_interval", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1209600", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.825 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dashboard", 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:44:14.826 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:44:14.827 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.829 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.830 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.831 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.833 INFO:teuthology.orchestra.run.smithi102.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:44:14.834 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.835 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.836 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.838 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.839 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.840 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.841 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.842 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.845 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.846 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.847 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.848 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_URL": { 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.849 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.850 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.851 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.852 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.853 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:44:14.854 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:44:14.855 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "[]", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.856 INFO:teuthology.orchestra.run.smithi102.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "{}", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:44:14.857 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:44:14.858 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.859 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.860 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.861 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.863 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.864 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.865 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.866 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.868 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.869 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.870 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.872 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "45", 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:44:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.875 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.876 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.880 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.881 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.883 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "cross_origin_url": { 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cross_origin_url", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.884 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "crt_file": { 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crt_file", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.885 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "debug": { 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "debug", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.886 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "jwt_token_ttl": { 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "jwt_token_ttl", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "28800", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.889 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.890 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.892 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.893 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "motd": { 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "motd", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "The message of the day", 2024-09-21T03:44:14.894 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.895 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.896 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.897 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8080", 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.899 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.900 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl_server_port": { 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl_server_port", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.901 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8443", 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.902 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "sso_oauth2": { 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sso_oauth2", 2024-09-21T03:44:14.903 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.904 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:14.905 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "redirect", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.906 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect" 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.907 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.908 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "url_prefix": { 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url_prefix", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.909 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "devicehealth", 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.910 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_monitoring": { 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_monitoring", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.911 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "monitor device health metrics", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.912 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.913 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.914 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.915 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "mark_out_threshold": { 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mark_out_threshold", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2419200", 2024-09-21T03:44:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": { 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_name", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.918 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "device_health_metrics", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "retention_period": { 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retention_period", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.919 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15552000", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_frequency": { 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_frequency", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.920 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "self_heal": { 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "self_heal", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.921 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.922 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.923 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_threshold": { 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_threshold", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.924 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7257600", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "diskprediction_local", 2024-09-21T03:44:14.925 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.926 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.927 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.929 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.930 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.931 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "predict_interval": { 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predict_interval", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.932 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "predictor_model": { 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predictor_model", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "prophetstor", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.933 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.934 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.935 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.936 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "influx", 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": false, 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.937 INFO:teuthology.orchestra.run.smithi102.stdout: "batch_size": { 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "batch_size", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5000", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.938 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "database": { 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "database", 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.939 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "ceph", 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.940 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": { 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hostname", 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.941 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:14.942 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "30", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "5", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.943 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.944 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.945 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.946 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.947 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.948 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "password": { 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "password", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.949 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.950 INFO:teuthology.orchestra.run.smithi102.stdout: "port": { 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "port", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8086", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server port", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.951 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:14.952 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "false", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.953 INFO:teuthology.orchestra.run.smithi102.stdout: "threads": { 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threads", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "32", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.954 INFO:teuthology.orchestra.run.smithi102.stdout: "username": { 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "username", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "verify_ssl": { 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "verify_ssl", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "true", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.956 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "insights", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.957 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.959 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.960 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.961 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.962 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.963 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "iostat", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.964 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.965 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.966 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.967 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.968 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.969 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.970 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.971 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "k8sevents", 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_event_retention_days": { 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.973 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.974 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "config_check_secs": { 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_check_secs", 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:14.975 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "10", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.976 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.977 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.978 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.979 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.980 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.981 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.982 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "localpool", 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "failure_domain": { 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "failure_domain", 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.983 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "host", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:14.984 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.985 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.986 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:14.987 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:14.988 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.989 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": { 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_size", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.990 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:44:14.991 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:44:14.991 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.991 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.991 INFO:teuthology.orchestra.run.smithi102.stdout: "num_rep": { 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "num_rep", 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:14.992 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": { 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_num", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.994 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "128", 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.995 INFO:teuthology.orchestra.run.smithi102.stdout: "prefix": { 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prefix", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.996 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:14.997 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "subtree": { 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "subtree", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:14.998 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "rack", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:14.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mds_autoscaler", 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.000 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.001 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.002 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.003 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.004 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.004 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.004 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.004 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.004 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.005 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.006 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.006 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.006 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.006 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.007 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.008 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.009 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirroring", 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.010 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.011 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.012 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.013 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.014 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.015 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.016 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "nfs", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.017 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.019 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.020 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.021 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.022 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.023 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "fail_fs": { 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "fail_fs", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.025 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.026 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.029 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator": { 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.030 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm", 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "rook", 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "test_orchestrator" 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Orchestrator backend", 2024-09-21T03:44:15.031 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.032 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.033 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_perf_query", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.034 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.035 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.036 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.038 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.039 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.040 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_support", 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.043 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.044 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.045 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.046 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.047 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.048 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.049 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.050 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_autoscaler", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.051 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.052 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.053 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.054 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.055 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.056 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.058 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "threshold": { 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threshold", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1.0", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "scaling threshold", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.059 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "progress", 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_pg_recovery_event": { 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.060 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.061 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.062 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.063 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.064 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.065 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.066 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.067 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.068 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.069 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.070 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "max_completed_events": { 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_completed_events", 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.071 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "50", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.072 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.073 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.074 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus", 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.075 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "cache": { 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cache", 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.076 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "exclude_perf_counters": { 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "exclude_perf_counters", 2024-09-21T03:44:15.077 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.079 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.080 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.081 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.082 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.083 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools": { 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.084 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "300", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.085 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_interval": { 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_interval", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15.0", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:44:15.087 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "9283", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.088 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.089 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "stale_cache_strategy": { 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stale_cache_strategy", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "log", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.090 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "default", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.091 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "default", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "error" 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.092 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_support", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.093 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.094 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.095 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.096 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.097 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.098 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_snap_create": { 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:44:15.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.100 INFO:teuthology.orchestra.run.smithi102.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.101 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.102 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "trash_purge_schedule": { 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "trash_purge_schedule", 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.103 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.104 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "restful", 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_auth": { 2024-09-21T03:44:15.105 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_auth", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.106 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:15.107 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.108 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.109 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.110 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.111 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.112 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.113 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "max_requests": { 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_requests", 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.115 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.116 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.117 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.118 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.119 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.120 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.120 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.120 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.120 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.120 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rgw", 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.122 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.123 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.124 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.125 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.126 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:44:15.127 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.129 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rook", 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.130 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.131 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.132 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.133 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.134 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.135 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.136 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.137 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.138 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "storage_class": { 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "storage_class", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "local", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.139 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "selftest", 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.140 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.141 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.142 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.143 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.144 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.145 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.146 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.147 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "roption1": { 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption1", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.148 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "roption2": { 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption2", 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.149 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "xyz", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption1": { 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption1", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.150 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption2": { 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption2", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.151 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption3": { 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption3", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.152 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption4": { 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption4", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption5": { 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption5", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.154 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption6": { 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption6", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.155 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption7": { 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption7", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.156 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "42", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.157 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "testkey": { 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testkey", 2024-09-21T03:44:15.158 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.159 INFO:teuthology.orchestra.run.smithi102.stdout: "testlkey": { 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testlkey", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "testnewline": { 2024-09-21T03:44:15.160 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testnewline", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.161 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smb", 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "internal_store_backend": { 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "internal_store_backend", 2024-09-21T03:44:15.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.163 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.164 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.165 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.166 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.167 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.168 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "update_orchestration": { 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "update_orchestration", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.169 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snap_schedule", 2024-09-21T03:44:15.170 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_m_granularity": { 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_m_granularity", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.171 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "dump_on_update": { 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dump_on_update", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.172 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.173 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.174 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.175 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.176 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.177 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.178 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stats", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.179 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.180 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.181 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.182 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.183 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.184 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "status", 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.186 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.187 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.188 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.189 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.190 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telegraf", 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.191 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "address": { 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "address", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.194 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.196 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.197 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.198 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.199 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telemetry", 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.200 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_basic": { 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_basic", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.201 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_crash": { 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_crash", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_device": { 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_device", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.203 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_ident": { 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_ident", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_perf": { 2024-09-21T03:44:15.204 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_perf", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "contact": { 2024-09-21T03:44:15.205 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "contact", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "description": { 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "description", 2024-09-21T03:44:15.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "device_url": { 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_url", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.207 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.208 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "24", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "8", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "last_opt_revision": { 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "last_opt_revision", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard": { 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard_description": { 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard_description", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.212 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.213 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.214 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.215 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.216 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.217 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "organization": { 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "organization", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.218 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "proxy": { 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "proxy", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.219 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.220 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "url": { 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.221 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "test_orchestrator", 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.222 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.223 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.224 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.225 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.226 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.227 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.228 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "volumes", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.229 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.230 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.231 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.232 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.233 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_clones": { 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_clones", 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.234 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "periodic_async_work": { 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "periodic_async_work", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.235 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Periodically check for async work", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_delay": { 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.236 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.237 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.238 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.239 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "discovery_interval": { 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "discovery_interval", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "100", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "identifier": { 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "identifier", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.241 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.242 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.243 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.244 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.245 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.246 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.247 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_host": { 2024-09-21T03:44:15.248 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_host", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_port": { 2024-09-21T03:44:15.249 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_port", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10051", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_sender": { 2024-09-21T03:44:15.250 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_sender", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.251 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "gid": 24155, 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "y", 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "mgr_features": 4540719139924082687, 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "available_modules": [ 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "alerts", 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.252 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.253 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.254 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.255 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.256 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.257 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_destination": { 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_destination", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.258 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_from_name": { 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_from_name", 2024-09-21T03:44:15.259 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "Ceph", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email From: name", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_host": { 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_host", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.260 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP server", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_password": { 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_password", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.261 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Password to authenticate with", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_port": { 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_port", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.262 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "465", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP port", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_sender": { 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_sender", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.263 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_ssl": { 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_ssl", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.264 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_user": { 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_user", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.265 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "User to authenticate as", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.266 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "balancer", 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.267 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "active": { 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "active", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.268 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_time": { 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_time", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0000", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.269 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_weekday": { 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_weekday", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.270 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_max_iterations": { 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "25", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "250", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.271 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_metrics": { 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_metrics", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.272 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_step": { 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_step", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.5", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0.001", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "0.999", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.273 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "end_time": { 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_time", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2359", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.274 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "end_weekday": { 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_weekday", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.275 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.276 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.277 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.278 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.279 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "min_score": { 2024-09-21T03:44:15.280 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_score", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:15.281 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "upmap", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-compat", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "none", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "read", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap-read" 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Balancer mode", 2024-09-21T03:44:15.282 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_ids": { 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_ids", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.283 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.284 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.285 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_deviation": { 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_deviation", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.286 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_optimizations": { 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.287 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm", 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_down_multiplier": { 2024-09-21T03:44:15.288 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_down_multiplier", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_refresh_rate": { 2024-09-21T03:44:15.289 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_refresh_rate", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "20", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.290 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_starting_port": { 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_starting_port", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4721", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_ptrace": { 2024-09-21T03:44:15.291 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_ptrace", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.292 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_interval": { 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_interval", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.293 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.7", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.294 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm_log_destination": { 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm_log_destination", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "file", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "file,syslog", 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: "syslog" 2024-09-21T03:44:15.295 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "cgroups_split": { 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cgroups_split", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.296 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "config_checks_enabled": { 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_checks_enabled", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:44:15.297 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "config_dashboard": { 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_dashboard", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:44:15.298 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_alertmanager": { 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_alertmanager", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.299 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_base": { 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_base", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.300 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_elasticsearch": { 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "elasticsearch container image", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.301 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.302 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1907814423' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2884027537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:14 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2321384538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:14 smithi121 ceph-mon[34316]: pgmap v653: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1907814423' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2884027537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:14 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2321384538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:44:15.303 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:14 smithi148 ceph-mon[34651]: pgmap v653: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_grafana": { 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_grafana", 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.307 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_haproxy": { 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_haproxy", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:44:15.308 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "HAproxy container image", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_agent": { 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.309 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_collector": { 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.310 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_query": { 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.311 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger query container image", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_keepalived": { 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_keepalived", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.312 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Keepalived container image", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_loki": { 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_loki", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.313 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Loki container image", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nginx": { 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nginx", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.314 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nginx container image", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_node_exporter": { 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_node_exporter", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.315 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nvmeof": { 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nvmeof", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:44:15.316 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nvme-of container image", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:44:15.317 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_prometheus": { 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_prometheus", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:44:15.318 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_promtail": { 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_promtail", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:44:15.319 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Promtail container image", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba": { 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.320 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba_metrics": { 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.321 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_snmp_gateway": { 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.322 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "container_init": { 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_init", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.323 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "daemon_cache_timeout": { 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.324 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "900", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.325 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "default_registry": { 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_registry", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.326 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "device_cache_timeout": { 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_cache_timeout", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1800", 2024-09-21T03:44:15.327 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "device_enhanced_scan": { 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_enhanced_scan", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.328 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "facts_cache_timeout": { 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "facts_cache_timeout", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.329 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "grafana_dashboards_path": { 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.330 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "host_check_interval": { 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "host_check_interval", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.331 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "hw_monitoring": { 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hw_monitoring", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.332 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "inventory_list_all": { 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "inventory_list_all", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.333 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.334 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.335 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "log_refresh_metadata": { 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_refresh_metadata", 2024-09-21T03:44:15.336 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.337 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.338 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.339 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.340 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.341 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "*", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.342 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "max_count_per_host": { 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_count_per_host", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.343 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd_draining_count": { 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_osd_draining_count", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.344 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "migration_current": { 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "migration_current", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.345 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "internal - do not modify", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.346 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "root", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm-package", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "root" 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "oob_default_addr": { 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "oob_default_addr", 2024-09-21T03:44:15.347 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "169.254.1.1", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "prometheus_alerts_path": { 2024-09-21T03:44:15.348 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.349 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_insecure": { 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_insecure", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.350 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_password": { 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_password", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_url": { 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_url", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.352 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_username": { 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_username", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.353 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "secure_monitoring_stack": { 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.354 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "service_discovery_port": { 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "service_discovery_port", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8765", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.355 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.356 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_config_file": { 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_config_file", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.357 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:44:15.358 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_interval": { 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.359 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "use_agent": { 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_agent", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.360 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "use_repo_digest": { 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_repo_digest", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.361 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_failed_host_check": { 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.362 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_daemons": { 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.363 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_hosts": { 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.364 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crash", 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.365 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.366 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.367 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.368 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.369 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.370 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "retain_interval": { 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retain_interval", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "31536000", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.371 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.372 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_recent_interval": { 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_recent_interval", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1209600", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:44:15.373 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dashboard", 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.374 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.375 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.376 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.377 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.378 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.379 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.380 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.381 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:44:15.382 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:44:15.383 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.384 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.385 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.386 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.387 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.388 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.389 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.390 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_URL": { 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.391 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.392 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.393 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.394 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.395 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.396 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "[]", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.397 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "{}", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.398 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.399 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.400 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.401 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.402 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.403 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.404 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.405 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.406 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.407 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:44:15.408 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.409 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.410 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:44:15.411 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:44:15.412 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "45", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:44:15.413 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:44:15.414 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:44:15.415 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:44:15.416 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:44:15.417 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:44:15.418 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:44:15.419 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.420 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "cross_origin_url": { 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cross_origin_url", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.421 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "crt_file": { 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crt_file", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.422 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "debug": { 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "debug", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.423 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "jwt_token_ttl": { 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "jwt_token_ttl", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.424 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "28800", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.425 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.426 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.427 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.428 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.429 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.430 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.431 INFO:teuthology.orchestra.run.smithi102.stdout: "motd": { 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "motd", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "The message of the day", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.432 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.433 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.434 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8080", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.435 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:15.436 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl_server_port": { 2024-09-21T03:44:15.437 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl_server_port", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8443", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.438 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "sso_oauth2": { 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sso_oauth2", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.439 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "redirect", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect" 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.440 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:15.441 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "url_prefix": { 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url_prefix", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.442 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "devicehealth", 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.443 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_monitoring": { 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_monitoring", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "monitor device health metrics", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.444 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.445 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.446 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.447 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.448 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.449 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "mark_out_threshold": { 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mark_out_threshold", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2419200", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:44:15.450 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": { 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_name", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "device_health_metrics", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.451 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "retention_period": { 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retention_period", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15552000", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.452 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_frequency": { 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_frequency", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.453 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "self_heal": { 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "self_heal", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.454 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.455 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.456 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_threshold": { 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_threshold", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7257600", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.457 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "diskprediction_local", 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.458 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.459 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.460 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.461 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.462 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.463 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "predict_interval": { 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predict_interval", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.464 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "predictor_model": { 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predictor_model", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "prophetstor", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.465 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.466 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.467 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "influx", 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": false, 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "batch_size": { 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "batch_size", 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.468 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5000", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "database": { 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "database", 2024-09-21T03:44:15.469 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "ceph", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": { 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hostname", 2024-09-21T03:44:15.470 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.471 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "30", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "5", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.472 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.473 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.474 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.475 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.476 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "password": { 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "password", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.477 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "port": { 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "port", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.478 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8086", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server port", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.479 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.480 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "false", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "threads": { 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threads", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.481 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "32", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "username": { 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "username", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.482 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "verify_ssl": { 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "verify_ssl", 2024-09-21T03:44:15.483 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "true", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.484 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "insights", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.485 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.486 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.487 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.488 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.489 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.490 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "iostat", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.491 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.492 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.493 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.494 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.495 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.496 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.497 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "k8sevents", 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_event_retention_days": { 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.498 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "config_check_secs": { 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_check_secs", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.499 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "10", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.500 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.501 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.502 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.503 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.504 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.505 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.506 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "localpool", 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "failure_domain": { 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "failure_domain", 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.507 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "host", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.508 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.509 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.510 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.511 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.512 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": { 2024-09-21T03:44:15.513 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_size", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "num_rep": { 2024-09-21T03:44:15.514 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "num_rep", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.515 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": { 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_num", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "128", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.516 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "prefix": { 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prefix", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.517 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "subtree": { 2024-09-21T03:44:15.518 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "subtree", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "rack", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.519 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mds_autoscaler", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.520 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.521 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.522 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.523 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.524 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.525 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirroring", 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.526 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.527 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.528 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.529 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.530 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.531 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.532 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "nfs", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.533 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.534 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.535 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.536 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.537 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.538 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "fail_fs": { 2024-09-21T03:44:15.539 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "fail_fs", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.540 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.541 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.542 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.543 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.544 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator": { 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.545 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "rook", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "test_orchestrator" 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Orchestrator backend", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.546 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.547 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_perf_query", 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.548 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.549 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.550 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.551 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.552 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.553 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.554 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_support", 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.555 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.556 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.557 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.558 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.559 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.560 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.561 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_autoscaler", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.562 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.563 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.564 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.565 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.566 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.567 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.568 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "threshold": { 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threshold", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:15.569 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1.0", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "scaling threshold", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "progress", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.570 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_pg_recovery_event": { 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.571 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.572 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.573 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.574 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.575 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.576 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.577 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "max_completed_events": { 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_completed_events", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "50", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.578 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.579 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.580 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus", 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "cache": { 2024-09-21T03:44:15.581 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cache", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "exclude_perf_counters": { 2024-09-21T03:44:15.582 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "exclude_perf_counters", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.583 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.584 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.585 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.586 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.587 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.588 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools": { 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.589 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "300", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.590 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_interval": { 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_interval", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15.0", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.591 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.592 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "9283", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.593 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.594 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "stale_cache_strategy": { 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stale_cache_strategy", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "log", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.595 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "default", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.596 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "default", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "error" 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.597 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_support", 2024-09-21T03:44:15.598 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.599 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.600 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.601 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.602 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.603 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_snap_create": { 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.604 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.605 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.606 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "trash_purge_schedule": { 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "trash_purge_schedule", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.607 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.608 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "restful", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_auth": { 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_auth", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.609 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.610 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.611 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.612 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.613 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.614 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.615 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "max_requests": { 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_requests", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.616 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.617 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.618 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.619 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rgw", 2024-09-21T03:44:15.620 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.621 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.622 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.623 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.624 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.625 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.626 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.627 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rook", 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.628 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.629 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.630 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.631 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.632 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.633 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.634 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "storage_class": { 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "storage_class", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "local", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:44:15.635 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "selftest", 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.636 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.637 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.638 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.639 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.640 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "roption1": { 2024-09-21T03:44:15.641 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption1", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "roption2": { 2024-09-21T03:44:15.642 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption2", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "xyz", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption1": { 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption1", 2024-09-21T03:44:15.643 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption2": { 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption2", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.644 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption3": { 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption3", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.645 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption4": { 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption4", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.646 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption5": { 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption5", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.647 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.648 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.649 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption6": { 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption6", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.650 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption7": { 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption7", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "42", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.651 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.652 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "testkey": { 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testkey", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.653 INFO:teuthology.orchestra.run.smithi102.stdout: "testlkey": { 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testlkey", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.654 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "testnewline": { 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testnewline", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.655 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smb", 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "internal_store_backend": { 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "internal_store_backend", 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.656 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.657 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.658 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.659 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.660 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.661 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.662 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "update_orchestration": { 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "update_orchestration", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.663 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snap_schedule", 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.664 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_m_granularity": { 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_m_granularity", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.665 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "dump_on_update": { 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dump_on_update", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.666 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.667 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.668 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.669 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.670 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.671 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.672 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stats", 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.673 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.674 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.675 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.676 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.677 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.678 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.679 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "status", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.680 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.681 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.682 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.683 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.684 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.685 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telegraf", 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.686 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "address": { 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "address", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.687 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.688 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.689 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.690 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.691 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.692 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.693 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.694 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telemetry", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_basic": { 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_basic", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.695 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_crash": { 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_crash", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.696 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_device": { 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_device", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.697 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_ident": { 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_ident", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.698 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_perf": { 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_perf", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.699 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "contact": { 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "contact", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.700 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "description": { 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "description", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.701 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "device_url": { 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_url", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.702 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.703 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.704 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "24", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "8", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "last_opt_revision": { 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "last_opt_revision", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.705 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard": { 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.706 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard_description": { 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard_description", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.707 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.708 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.709 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.710 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.711 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.712 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "organization": { 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "organization", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.713 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "proxy": { 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "proxy", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.714 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.715 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "url": { 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:44:15.716 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "test_orchestrator", 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.717 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.718 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.719 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.720 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.721 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.722 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.723 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "volumes", 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.724 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.725 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.726 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.727 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.728 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_clones": { 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_clones", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.729 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "periodic_async_work": { 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "periodic_async_work", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.730 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Periodically check for async work", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_delay": { 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.731 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:44:15.732 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.733 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.734 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "discovery_interval": { 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "discovery_interval", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "100", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.735 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "identifier": { 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "identifier", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.736 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.737 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.738 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.739 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.740 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.741 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.742 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.743 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.744 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_host": { 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_host", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.745 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_port": { 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_port", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10051", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.746 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_sender": { 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_sender", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.747 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "modules": [ 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm", 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "dashboard", 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "iostat", 2024-09-21T03:44:15.748 INFO:teuthology.orchestra.run.smithi102.stdout: "nfs", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "restful", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "snap_schedule" 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "available_modules": [ 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "alerts", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.749 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.750 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.751 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.752 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.753 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.754 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_destination": { 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_destination", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.755 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_from_name": { 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_from_name", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.756 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "Ceph", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Email From: name", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_host": { 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_host", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.757 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP server", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_password": { 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_password", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.758 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Password to authenticate with", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_port": { 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_port", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.759 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "465", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP port", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_sender": { 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_sender", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.760 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SMTP envelope sender", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_ssl": { 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_ssl", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.761 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "smtp_user": { 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smtp_user", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.762 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "User to authenticate as", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.763 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "balancer", 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "active": { 2024-09-21T03:44:15.764 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "active", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_time": { 2024-09-21T03:44:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_time", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0000", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "begin_weekday": { 2024-09-21T03:44:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "begin_weekday", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_max_iterations": { 2024-09-21T03:44:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_max_iterations", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "25", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "250", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_metrics": { 2024-09-21T03:44:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_metrics", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "crush_compat_step": { 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crush_compat_step", 2024-09-21T03:44:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.5", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0.001", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "0.999", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "aggressiveness of optimization", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "end_time": { 2024-09-21T03:44:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_time", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2359", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "end_weekday": { 2024-09-21T03:44:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "end_weekday", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "0", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "6", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "min_score": { 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_score", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "upmap", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "crush-compat", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "none", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "read", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap-read" 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Balancer mode", 2024-09-21T03:44:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_ids": { 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_ids", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.781 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.782 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_deviation": { 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_deviation", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.783 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "upmap_max_optimizations": { 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "upmap_max_optimizations", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.784 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm", 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_down_multiplier": { 2024-09-21T03:44:15.785 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_down_multiplier", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.786 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_refresh_rate": { 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_refresh_rate", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "20", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.787 INFO:teuthology.orchestra.run.smithi102.stdout: "agent_starting_port": { 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "agent_starting_port", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4721", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_ptrace": { 2024-09-21T03:44:15.788 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_ptrace", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.789 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_interval": { 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_interval", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.790 INFO:teuthology.orchestra.run.smithi102.stdout: "autotune_memory_target_ratio": { 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0.7", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm_log_destination": { 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cephadm_log_destination", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "file", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "file,syslog", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "syslog" 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T03:44:15.792 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "cgroups_split": { 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cgroups_split", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T03:44:15.793 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "config_checks_enabled": { 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_checks_enabled", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.794 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "config_dashboard": { 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_dashboard", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.795 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_alertmanager": { 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_alertmanager", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.796 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_base": { 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_base", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.797 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Container image name, without the tag", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_elasticsearch": { 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_elasticsearch", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.798 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "elasticsearch container image", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_grafana": { 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_grafana", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.799 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_haproxy": { 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_haproxy", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.800 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "HAproxy container image", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_agent": { 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_agent", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.801 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger agent container image", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_collector": { 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_collector", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.802 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger collector container image", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_jaeger_query": { 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_jaeger_query", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.803 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Jaeger query container image", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_keepalived": { 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_keepalived", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.804 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Keepalived container image", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_loki": { 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_loki", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.805 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Loki container image", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nginx": { 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nginx", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.806 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nginx container image", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_node_exporter": { 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_node_exporter", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.807 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_nvmeof": { 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_nvmeof", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.808 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Nvme-of container image", 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_oauth2_proxy": { 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.809 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "oauth2-proxy container image", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_prometheus": { 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_prometheus", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.810 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Prometheus container image", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_promtail": { 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_promtail", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.811 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Promtail container image", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba": { 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.812 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB container image", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_samba_metrics": { 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_samba_metrics", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.813 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "container_image_snmp_gateway": { 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_image_snmp_gateway", 2024-09-21T03:44:15.814 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "SNMP Gateway container image", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "container_init": { 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "container_init", 2024-09-21T03:44:15.815 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "daemon_cache_timeout": { 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "daemon_cache_timeout", 2024-09-21T03:44:15.816 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "default_cephadm_command_timeout": { 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.817 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "900", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "default_registry": { 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "default_registry", 2024-09-21T03:44:15.818 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "docker.io", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "device_cache_timeout": { 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_cache_timeout", 2024-09-21T03:44:15.819 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1800", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache device inventory", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "device_enhanced_scan": { 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_enhanced_scan", 2024-09-21T03:44:15.820 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "facts_cache_timeout": { 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "facts_cache_timeout", 2024-09-21T03:44:15.821 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "seconds to cache host facts data", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "grafana_dashboards_path": { 2024-09-21T03:44:15.822 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "grafana_dashboards_path", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "host_check_interval": { 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "host_check_interval", 2024-09-21T03:44:15.823 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to perform a host check", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "hw_monitoring": { 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hw_monitoring", 2024-09-21T03:44:15.824 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "inventory_list_all": { 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "inventory_list_all", 2024-09-21T03:44:15.825 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.826 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.827 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "log_refresh_metadata": { 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_refresh_metadata", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.828 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T03:44:15.829 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.830 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.831 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.832 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.833 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "*", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "max_count_per_host": { 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_count_per_host", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.834 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of daemons per service per host", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "max_osd_draining_count": { 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_osd_draining_count", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.835 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "migration_current": { 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "migration_current", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.836 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "internal - do not modify", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "mode": { 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mode", 2024-09-21T03:44:15.837 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "root", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm-package", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "root" 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.838 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "oob_default_addr": { 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "oob_default_addr", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "169.254.1.1", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.839 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "prometheus_alerts_path": { 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus_alerts_path", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.840 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_insecure": { 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_insecure", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.841 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_password": { 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_password", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.842 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_url": { 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_url", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.843 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "registry_username": { 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "registry_username", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.844 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "secure_monitoring_stack": { 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secure_monitoring_stack", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T03:44:15.845 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "service_discovery_port": { 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "service_discovery_port", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8765", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.846 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "cephadm service discovery port", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.847 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_config_file": { 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_config_file", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.848 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_count_max": { 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.849 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "ssh_keepalive_interval": { 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssh_keepalive_interval", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.850 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "use_agent": { 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_agent", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T03:44:15.851 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "use_repo_digest": { 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "use_repo_digest", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.852 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_failed_host_check": { 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_failed_host_check", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T03:44:15.853 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_daemons": { 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_daemons", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T03:44:15.854 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_on_stray_hosts": { 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_on_stray_hosts", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T03:44:15.855 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crash", 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.856 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.857 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.858 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.859 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.860 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "retain_interval": { 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retain_interval", 2024-09-21T03:44:15.861 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "31536000", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.862 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_recent_interval": { 2024-09-21T03:44:15.863 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_recent_interval", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1209600", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.864 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dashboard", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.865 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.866 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.867 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_ENABLED": { 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.868 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.869 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.870 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.871 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.872 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.873 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.874 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.875 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.876 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.877 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.878 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.879 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.880 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_URL": { 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_URL", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.881 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.882 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.883 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.884 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "[]", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.887 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "{}", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.888 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.889 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.890 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.891 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.892 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.893 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.894 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.895 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.896 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.897 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.898 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.899 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.900 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.901 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "45", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.902 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.903 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "admin", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.904 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.905 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.906 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.907 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.908 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.909 INFO:teuthology.orchestra.run.smithi102.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.910 INFO:teuthology.orchestra.run.smithi102.stdout: "cross_origin_url": { 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cross_origin_url", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.911 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "crt_file": { 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "crt_file", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.912 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "debug": { 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "debug", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Enable/disable debug options", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.913 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "jwt_token_ttl": { 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "jwt_token_ttl", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "28800", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.914 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.915 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.916 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.917 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.918 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.919 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.920 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "motd": { 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "motd", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "The message of the day", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.921 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect_resolve_ip_addr": { 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.922 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.923 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8080", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.924 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.925 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.926 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl_server_port": { 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl_server_port", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8443", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.927 INFO:teuthology.orchestra.run.smithi102.stdout: "sso_oauth2": { 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sso_oauth2", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:15.928 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "redirect", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "redirect" 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.929 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.930 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "url_prefix": { 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url_prefix", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.931 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "devicehealth", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_monitoring": { 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_monitoring", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.932 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "monitor device health metrics", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.933 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.934 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.935 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.936 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.937 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "mark_out_threshold": { 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mark_out_threshold", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "2419200", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T03:44:15.938 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "pool_name": { 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pool_name", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "device_health_metrics", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T03:44:15.939 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "retention_period": { 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "retention_period", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15552000", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long to retain device health metrics", 2024-09-21T03:44:15.940 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_frequency": { 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_frequency", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.941 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "self_heal": { 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "self_heal", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T03:44:15.942 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T03:44:15.943 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.944 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "warn_threshold": { 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "warn_threshold", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7257600", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.945 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "diskprediction_local", 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.946 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.947 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.948 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.949 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.950 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "predict_interval": { 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predict_interval", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.951 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "86400", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "predictor_model": { 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "predictor_model", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.952 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "prophetstor", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.953 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "600", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.954 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "influx", 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": false, 2024-09-21T03:44:15.955 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "influxdb python module not found", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "batch_size": { 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "batch_size", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5000", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.956 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "database": { 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "database", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "ceph", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.957 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "hostname": { 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "hostname", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server hostname", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.958 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "30", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "5", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.959 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.960 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.961 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.962 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.963 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.964 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "password": { 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "password", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "password of InfluxDB server user", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.965 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "port": { 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "port", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "8086", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "InfluxDB server port", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.966 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.967 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "ssl": { 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ssl", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "false", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.968 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "threads": { 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threads", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "32", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.969 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "username": { 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "username", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "username of InfluxDB server user", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.970 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "verify_ssl": { 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "verify_ssl", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "true", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.971 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "insights", 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.972 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.973 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.974 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.975 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.976 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.977 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "iostat", 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.978 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.979 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.980 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.981 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.982 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.983 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.984 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "k8sevents", 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "ceph_event_retention_days": { 2024-09-21T03:44:15.985 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "ceph_event_retention_days", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "7", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.986 INFO:teuthology.orchestra.run.smithi102.stdout: "config_check_secs": { 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "config_check_secs", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "10", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.987 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.988 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.989 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.990 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.991 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.992 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.993 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "localpool", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "failure_domain": { 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "failure_domain", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "host", 2024-09-21T03:44:15.994 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "failure domain for any created local pool", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:15.995 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.996 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.997 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:15.998 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:15.999 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "min_size": { 2024-09-21T03:44:16.000 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "min_size", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default min_size for any created local pool", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.001 INFO:teuthology.orchestra.run.smithi102.stdout: "num_rep": { 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "num_rep", 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 msgr2=0x7f5be00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 0x7f5be00b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5be4005fd0 tx=0x7f5be4005850 comp rx=0 tx=0).stop 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 msgr2=0x7f5bf41a1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f5bec00eaa0 tx=0x7f5bec00ef60 comp rx=0 tx=0).stop 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 shutdown_connections 2024-09-21T03:44:16.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f5be00b6680 0x7f5be00b8b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5bf410dd40 0x7f5bf41a1ed0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5bf41051c0 0x7f5bf419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 --2- 172.21.15.102:0/3122876847 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f5bf4104790 0x7f5bf419c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3", 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.003 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default replica count for any created local pool", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_num": { 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_num", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "128", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.004 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "prefix": { 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prefix", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.005 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "name prefix for any created local pool", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.006 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "subtree": { 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "subtree", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "rack", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.007 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mds_autoscaler", 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.008 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.009 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.010 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.011 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.012 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.013 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.014 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirroring", 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.015 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.016 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.017 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.018 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.019 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.020 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "nfs", 2024-09-21T03:44:16.021 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.022 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.023 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.024 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.025 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.026 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.027 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "fail_fs": { 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "fail_fs", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.028 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.029 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.030 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.031 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.032 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.033 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator": { 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "orchestrator", 2024-09-21T03:44:16.034 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "cephadm", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "rook", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "test_orchestrator" 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Orchestrator backend", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.035 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.036 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_perf_query", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.037 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.038 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.039 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.040 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.041 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.042 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "osd_support", 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.043 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.044 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.045 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.046 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.047 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.048 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.049 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "pg_autoscaler", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.050 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.051 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.052 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.053 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.054 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.055 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.056 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "threshold": { 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "threshold", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "3.0", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1.0", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "scaling threshold", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T03:44:16.057 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "progress", 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_pg_recovery_event": { 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_pg_recovery_event", 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.058 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:16.059 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.060 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.061 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.062 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.063 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.064 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "max_completed_events": { 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_completed_events", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.065 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "50", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "number of past completed events to remember", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "sleep_interval": { 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sleep_interval", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:16.066 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "how long the module is going to sleep", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.067 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.068 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "prometheus", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "cache": { 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "cache", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.069 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "exclude_perf_counters": { 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "exclude_perf_counters", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T03:44:16.070 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 >> 172.21.15.102:0/3122876847 conn(0x7f5bf40fe380 msgr2=0x7f5bf4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 shutdown_connections 2024-09-21T03:44:16.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:14.683+0000 7f5bfc40a640 1 -- 172.21.15.102:0/3122876847 wait complete. 2024-09-21T03:44:16.072 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1907814423' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:44:16.072 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2884027537' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T03:44:16.072 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:14 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2321384538' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T03:44:16.072 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:14 smithi102 ceph-mon[31392]: pgmap v653: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:16.073 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:15 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3122876847' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:44:16.073 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:15 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3122876847' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.074 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.075 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.076 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.077 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.078 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools": { 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.079 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "300", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.080 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "scrape_interval": { 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "scrape_interval", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15.0", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.081 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "::", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.082 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "9283", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T03:44:16.083 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.084 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "stale_cache_strategy": { 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stale_cache_strategy", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "log", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.085 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_behaviour": { 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_behaviour", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "default", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.086 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "default", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "error" 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "standby_error_status_code": { 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "standby_error_status_code", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.087 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "400", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "599", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_support", 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.088 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.089 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.090 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.091 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.092 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.093 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_snap_create": { 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_snap_create", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.094 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "mirror_snapshot_schedule": { 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.095 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.096 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "trash_purge_schedule": { 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "trash_purge_schedule", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.097 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "restful", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "enable_auth": { 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enable_auth", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.098 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "key_file": { 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "key_file", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.099 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.100 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.101 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.102 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.103 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.104 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "max_requests": { 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_requests", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "500", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.105 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "server_addr": { 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_addr", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.106 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "server_port": { 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "server_port", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.107 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.108 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rgw", 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.109 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.110 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.111 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.112 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.113 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.114 INFO:teuthology.orchestra.run.smithi102.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "5", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.115 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.116 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rook", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.117 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.118 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.119 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.120 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.121 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.122 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "storage_class": { 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "storage_class", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "local", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.123 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "selftest", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.124 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.125 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.126 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.127 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.128 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "roption1": { 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption1", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.129 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "roption2": { 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "roption2", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.130 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "xyz", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption1": { 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption1", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.131 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption2": { 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption2", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.132 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption3": { 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption3", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "float", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.133 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption4": { 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption4", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.134 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption5": { 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption5", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.135 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption6": { 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption6", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.136 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "rwoption7": { 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rwoption7", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.137 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "1", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "42", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.138 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "testkey": { 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testkey", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.139 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "testlkey": { 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testlkey", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.140 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "testnewline": { 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "testnewline", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.141 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "smb", 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.142 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "internal_store_backend": { 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "internal_store_backend", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.143 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.144 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.145 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.146 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.147 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.148 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.149 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "update_orchestration": { 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "update_orchestration", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.150 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snap_schedule", 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.151 INFO:teuthology.orchestra.run.smithi102.stdout: "allow_m_granularity": { 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "allow_m_granularity", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.152 INFO:teuthology.orchestra.run.smithi102.stdout: "dump_on_update": { 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "dump_on_update", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "dump database to debug log on update", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.153 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.154 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.155 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.156 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.157 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.158 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.159 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "stats", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.160 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.161 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.162 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.163 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.164 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.165 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.166 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "status", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.167 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.168 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.169 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.170 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.171 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.172 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telegraf", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.173 INFO:teuthology.orchestra.run.smithi102.stdout: "address": { 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "address", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.174 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "15", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.175 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.176 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.177 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.178 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.179 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.180 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "telemetry", 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.181 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_basic": { 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_basic", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.182 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_crash": { 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_crash", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.183 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_device": { 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_device", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.184 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_ident": { 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_ident", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.185 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "channel_perf": { 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "channel_perf", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T03:44:16.186 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "contact": { 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "contact", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.187 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "description": { 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "description", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.188 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "device_url": { 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "device_url", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.189 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "enabled": { 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "enabled", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.190 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "24", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "8", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.191 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "last_opt_revision": { 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "last_opt_revision", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "1", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.192 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard": { 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.193 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "leaderboard_description": { 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "leaderboard_description", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.194 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.195 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.196 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.197 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.198 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.199 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "organization": { 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "organization", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.200 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "proxy": { 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "proxy", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.201 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.202 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "url": { 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "url", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.203 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "test_orchestrator", 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.204 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.205 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.206 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.207 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.208 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.209 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "volumes", 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.210 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.211 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.212 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.213 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.214 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.215 INFO:teuthology.orchestra.run.smithi102.stdout: "max_concurrent_clones": { 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "max_concurrent_clones", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "4", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "periodic_async_work": { 2024-09-21T03:44:16.216 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "periodic_async_work", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Periodically check for async work", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_delay": { 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_delay", 2024-09-21T03:44:16.217 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "snapshot_clone_no_wait": { 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T03:44:16.218 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "True", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.219 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.220 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "can_run": true, 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "error_string": "", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "module_options": { 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "discovery_interval": { 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "discovery_interval", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "uint", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "100", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.221 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "identifier": { 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "identifier", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.222 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "interval": { 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "interval", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "secs", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "60", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.223 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "log_level": { 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_level", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.224 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster": { 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.225 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_cluster_level": { 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_cluster_level", 2024-09-21T03:44:16.226 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "info", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [ 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "critical", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "debug", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "error", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "info", 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "warning" 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.227 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "log_to_file": { 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "log_to_file", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "bool", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "False", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.228 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "sqlite3_killpoint": { 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "sqlite3_killpoint", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "dev", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 1, 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "0", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.229 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_host": { 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_host", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.230 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_port": { 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_port", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "int", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "10051", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.231 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "zabbix_sender": { 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "zabbix_sender", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "str", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "level": "advanced", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "flags": 0, 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "min": "", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "max": "", 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "enum_allowed": [], 2024-09-21T03:44:16.232 INFO:teuthology.orchestra.run.smithi102.stdout: "desc": "", 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "long_desc": "", 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "tags": [], 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "see_also": [] 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "services": { 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "dashboard": "https://172.21.15.102:8443/" 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "always_on_modules": { 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "octopus": [ 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "balancer", 2024-09-21T03:44:16.233 INFO:teuthology.orchestra.run.smithi102.stdout: "crash", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "devicehealth", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscaler", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "progress", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_support", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "status", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "telemetry", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "volumes" 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "pacific": [ 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "balancer", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "crash", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "devicehealth", 2024-09-21T03:44:16.234 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscaler", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "progress", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_support", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "status", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "telemetry", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "volumes" 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "quincy": [ 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "balancer", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "crash", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "devicehealth", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator", 2024-09-21T03:44:16.235 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscaler", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "progress", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_support", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "status", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "telemetry", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "volumes" 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "reef": [ 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "balancer", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "crash", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "devicehealth", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscaler", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "progress", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_support", 2024-09-21T03:44:16.236 INFO:teuthology.orchestra.run.smithi102.stdout: "status", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "telemetry", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "volumes" 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: ], 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "squid": [ 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "balancer", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "crash", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "devicehealth", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "orchestrator", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "pg_autoscaler", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "progress", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "rbd_support", 2024-09-21T03:44:16.237 INFO:teuthology.orchestra.run.smithi102.stdout: "status", 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "telemetry", 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "volumes" 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "last_failure_osd_epoch": 5, 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "active_clients": [ 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "devicehealth", 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.238 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 3866174137 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "libcephsqlite", 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 1160500341 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.239 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "rbd_support", 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 4044459360 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snap_schedule", 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.240 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2313024569 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "snap_schedule", 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 60877975 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.241 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: "name": "volumes", 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: "addrvec": [ 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: { 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: "type": "v2", 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: "addr": "172.21.15.102:0", 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: "nonce": 2360690256 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout: ] 2024-09-21T03:44:16.242 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:16.248 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T03:44:16.249 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T03:44:16.249 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:15 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3122876847' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T03:44:16.505 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:16.918 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:16 smithi102 ceph-mon[31392]: pgmap v654: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:16.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:16 smithi148 ceph-mon[34651]: pgmap v654: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:17.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:16 smithi121 ceph-mon[34316]: pgmap v654: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 4, 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 4, 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 2992, 2024-09-21T03:44:17.039 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 448, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.003053372, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000033068, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.002146137, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003884728, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001294909 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:17.040 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 157, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 107872, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.014534342, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.011876885, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.001170035, 2024-09-21T03:44:17.041 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 155, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.008399586, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000054190 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:17.042 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 107872 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 212, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 207, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 835344, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 127264, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.037697755, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.019298639, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.024894427, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:17.043 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 206, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.011677111, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000056685 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 835344, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 127264 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-21T03:44:17.044 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:17.045 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:17.046 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 148984, 2024-09-21T03:44:17.047 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 30, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:17.048 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-21T03:44:17.049 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 213, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 805380, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 213, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 213, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 805380, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:17.050 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:17.051 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T03:44:17.727 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T03:44:17.727 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T03:44:17.728 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T03:44:17.973 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:18.220 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:17 smithi102 ceph-mon[31392]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:44:18.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:17 smithi148 ceph-mon[34651]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:44:18.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:17 smithi121 ceph-mon[34316]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T03:44:18.480 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:18.480 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 0, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 2, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 0, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.001120639, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.000275630, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:18.481 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 218, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 213, 2024-09-21T03:44:18.482 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 837040, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 130624, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.037961147, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.018977241, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.025474254, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 212, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.011390899, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000053730 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:18.483 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 837040, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 130624 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 5, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 163, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 3152, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 109024, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.016729908, 2024-09-21T03:44:18.484 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012259579, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.003006553, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 162, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.012548263, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000077458 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.485 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 109024 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:18.486 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:18.487 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:18.488 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 149024, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 31, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-21T03:44:18.489 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-21T03:44:18.490 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 219, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 806224, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 219, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 219, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 806224, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:18.491 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:18.492 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:19.151 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:18 smithi102 ceph-mon[31392]: pgmap v656: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:19.178 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T03:44:19.179 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T03:44:19.179 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T03:44:19.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T03:44:19.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:18 smithi148 ceph-mon[34651]: pgmap v656: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:19.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:18 smithi121 ceph-mon[34316]: pgmap v656: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:19.425 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 0, 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 2, 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:44:19.966 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 0, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.001217429, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.000297266, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:19.967 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 158, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 108048, 2024-09-21T03:44:19.968 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.015596688, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012534750, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.001455552, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 156, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.008344789, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000053492 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.969 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 108048 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 217, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 210, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 838608, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 128352, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.038910360, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.018091452, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.028379337, 2024-09-21T03:44:19.970 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 210, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.015283701, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000072779 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 838608, 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 128352 2024-09-21T03:44:19.971 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:19.972 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:19.973 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 148984, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 30, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:19.974 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-21T03:44:19.975 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 214, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 805510, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 214, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 214, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 805510, 2024-09-21T03:44:19.976 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:19.977 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:20.621 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T03:44:20.621 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T03:44:20.622 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T03:44:20.622 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T03:44:20.622 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T03:44:20.622 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T03:44:20.622 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T03:44:20.622 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T03:44:20.622 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T03:44:20.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:20 smithi121 ceph-mon[34316]: pgmap v657: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:20.866 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:20.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:20 smithi102 ceph-mon[31392]: pgmap v657: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:20.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:20 smithi148 ceph-mon[34651]: pgmap v657: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:21.341 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 219, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 214, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 837312, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 131264, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.040484909, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.017278819, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.031634955, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 213, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.011222602, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000052688 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 837312, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 131264 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 1, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 163, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 108928, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.015779512, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.012860493, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.001263863, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 161, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.009635547, 2024-09-21T03:44:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000059848 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 108928 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_messages": 4, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages": 4, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_bytes": 2992, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_bytes": 448, 2024-09-21T03:44:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_total_time": 0.002220751, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_send_time": 0.000040679, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_recv_time": 0.002175650, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 3, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.003945319, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.001315106 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:21.346 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "cct": { 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "total_workers": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "unhealthy_workers": 0 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "mempool": { 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:21.347 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:21.348 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:21.349 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_bytes": 148967, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_anon_items": 29, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:21.350 INFO:teuthology.orchestra.run.smithi102.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_items": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "pgmap_items": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "mds_co_items": 2, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_1_items": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "unittest_2_items": 0 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: }, 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:21.351 INFO:teuthology.orchestra.run.smithi102.stdout: "val": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "max": 104857600, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "get_started": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "get": 220, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "get_sum": 806354, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "get_or_fail_success": 220, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "take": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "take_sum": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "put": 220, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "put_sum": 806354, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "wait": { 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "avgcount": 0, 2024-09-21T03:44:21.352 INFO:teuthology.orchestra.run.smithi102.stdout: "sum": 0.000000000, 2024-09-21T03:44:21.353 INFO:teuthology.orchestra.run.smithi102.stdout: "avgtime": 0.000000000 2024-09-21T03:44:21.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:21.353 INFO:teuthology.orchestra.run.smithi102.stdout: } 2024-09-21T03:44:21.353 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T03:44:22.008 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T03:44:22.009 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T03:44:22.009 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T03:44:22.269 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:44:22.657 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:22 smithi121 ceph-mon[34316]: pgmap v658: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:22.795 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:22 smithi148 ceph-mon[34651]: pgmap v658: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:22.847 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-21T03:44:22.847 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:22.847 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 11822, 2024-09-21T03:44:22.847 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 11395, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 8425487, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 23792141, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 45, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.834578840, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.405468904, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.413179663, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.072923769, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 11396, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.408939197, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000035884 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.848 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 18167, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002679189, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000147 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 7407, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 7871, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2633856, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 12081152, 2024-09-21T03:44:22.849 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 13, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 5, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.551136757, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.275769046, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.220566274, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.071970355, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 7871, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.273335578, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000034726 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 9156, 2024-09-21T03:44:22.850 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001239025, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000135 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1088, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 367360 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 14905, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 25902, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 6217808, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 19068833, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 13, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 8, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 1.143659719, 2024-09-21T03:44:22.851 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.700198614, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 16.620715146, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.045314050, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 25897, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 36.976331628, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001427822 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 27000, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.004189322, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000155 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.852 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 928160, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 137200 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1149, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 8.479763767, 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.007380125 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.853 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4586, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.817375980, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000178232 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 4289, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 4286, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4286, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 13.348706766, 2024-09-21T03:44:22.854 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003114490 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 65, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 6, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 5189, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 100, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 3753, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 1336, 2024-09-21T03:44:22.855 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 5044, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 1020, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 4, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 7956, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 6822, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 860, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 1000, 2024-09-21T03:44:22.856 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 1, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 2, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 135, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 2, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 3767, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 1962, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 4, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 234, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 6, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 1962, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:22.857 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 174, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 174, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 1788, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 5772, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 4409, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 8927, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 3160, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 23, 2024-09-21T03:44:22.858 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 3580 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 123, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 2254, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 1553, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 1307, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 232, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 205, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 3303, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 3098, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:22.859 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 2, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 6, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:22.860 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 1, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 15197, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 15197, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 21, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-21T03:44:22.861 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 21, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 3, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 42668413, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1270, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 164.182366041, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.129277453 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-09-21T03:44:22.862 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 2513, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 6122, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 3609, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 297, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 797, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 500, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 5189, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 9319, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 4130, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 3305, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 3305, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 169912, 2024-09-21T03:44:22.863 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 385609728 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 5889, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 100, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 4289, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 12, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 204, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 713, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.493068565, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002094065 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-21T03:44:22.864 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.865 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 53, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.044237847, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000834676 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.866 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.867 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.868 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-21T03:44:22.869 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 217, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.163369067, 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000752852 2024-09-21T03:44:22.870 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.871 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 206, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.224515178, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.015652986 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:22.872 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.873 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.874 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3097, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 8.423516109, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002719895 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:22.875 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 1, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 2, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 1, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 2849, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 2849, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 1963, 2024-09-21T03:44:22.876 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:22.877 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:22.878 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 2014205, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 3188, 2024-09-21T03:44:22.879 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 186, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-21T03:44:22.880 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 10311918, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 172194, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 6568, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 40087140, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 30, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 6568, 2024-09-21T03:44:22.881 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6568, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 13.417815927, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002042907 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6568, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 6687 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 6568, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 2002, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 4566, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-21T03:44:22.882 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 10, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 40, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 1310, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 27, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 6, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 3119, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:22.883 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 1962, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 20, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-21T03:44:22.884 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 91, 2024-09-21T03:44:22.885 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 14, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 168, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 25 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-21T03:44:22.886 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 10, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 3098, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 3098, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:22.887 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 34130, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 14188210, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 34130, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 34130, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 14188210, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.888 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 6568, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 40410510, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 6568, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 40410510, 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:22.889 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 6568, 2024-09-21T03:44:22.890 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 6568, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 6568, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 6568, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 3098, 2024-09-21T03:44:22.891 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 323370, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 3098, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 40, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 323370, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55d6c2d53380": { 2024-09-21T03:44:22.892 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 15197, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 38474109, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 15197, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 1270, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 38474109, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:22.893 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:22.894 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-21T03:44:22.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:22 smithi102 ceph-mon[31392]: pgmap v658: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds.exported=2 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds.imported=2 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=123 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=2254 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:44:23.635 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:44:23.636 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T03:44:23.636 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T03:44:23.882 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 299, 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 301, 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 12661281, 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 95146, 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 7, 2024-09-21T03:44:24.388 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.040902996, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.016274792, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.013762652, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.007501068, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 299, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.013201871, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000044153 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.389 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1452, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1434, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 16191612, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 516483, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.168222088, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.067137471, 2024-09-21T03:44:24.390 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.067180912, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.034908801, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1433, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.075723392, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000052842 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 915888, 2024-09-21T03:44:24.391 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 134560 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 788, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 947, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 8654773, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 616674, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.131750345, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.058480249, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.032070982, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.030575253, 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:24.392 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 946, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.062987297, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000066582 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 367680 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-21T03:44:24.393 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3757, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.117603968, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000031302 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:24.394 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-09-21T03:44:24.395 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 8807, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 8807, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 8807, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 1, 2024-09-21T03:44:24.396 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:24.397 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-21T03:44:24.398 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-21T03:44:24.399 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-21T03:44:24.400 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-21T03:44:24.401 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 14197, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 20, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 3, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-21T03:44:24.402 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 40136318, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 40134230, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 14197 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 2489, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 6321, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 3832, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 218, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 257, 2024-09-21T03:44:24.403 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 39, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 8807, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 9259, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 452, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 134628, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 337186816 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-09-21T03:44:24.404 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.405 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.406 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:24.407 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-21T03:44:24.408 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-21T03:44:24.409 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.410 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.411 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.412 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:24.413 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.414 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.415 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 3, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-21T03:44:24.416 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 2, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 1964, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:24.417 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:24.418 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:24.419 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 312198, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 2707, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 186, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:24.420 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 12294318, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 155842, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 2283, 2024-09-21T03:44:24.421 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 21, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 3, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 2283, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2283, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.493979503, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000654393 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2283, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2284 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 2283, 2024-09-21T03:44:24.422 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 2283, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 1479, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 802, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-09-21T03:44:24.423 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 1, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-21T03:44:24.424 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-21T03:44:24.425 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 91, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 14, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 8, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 8, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-21T03:44:24.426 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.427 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2535, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 37263689, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2535, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2535, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 37263689, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.428 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2283, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 35945114, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2283, 2024-09-21T03:44:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 35945114, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:24.430 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2283, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 2283, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2283, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2283, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:24.431 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.432 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55a8567dd450": { 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:24.433 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:24.434 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-21T03:44:24.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:24 smithi121 ceph-mon[34316]: pgmap v659: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:24.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:24 smithi102 ceph-mon[31392]: pgmap v659: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:24.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:24 smithi148 ceph-mon[34651]: pgmap v659: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:25.268 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T03:44:25.268 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T03:44:25.269 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T03:44:25.269 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T03:44:25.269 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-21T03:44:25.269 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:44:25.269 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:44:25.269 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T03:44:25.269 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T03:44:25.517 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:44:26.038 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-21T03:44:26.038 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:26.038 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1108, 2024-09-21T03:44:26.038 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1108, 2024-09-21T03:44:26.038 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 33908264, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 351530, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 7, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.158246008, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.070252608, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.045064452, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.031568413, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1107, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.056506460, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000051044 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.039 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1361, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1343, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 29097131, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 486962, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-09-21T03:44:26.040 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.142290603, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.052095789, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.066833876, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.027015011, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1342, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.057805074, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000043073 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.041 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 915168, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 133280 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 278, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 438, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 25236790, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 455159, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 6, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 5, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.055938545, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.020588513, 2024-09-21T03:44:26.042 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.023174159, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.008532480, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 436, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.018927392, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000043411 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 367072 2024-09-21T03:44:26.043 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4027, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.106730783, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000026503 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-09-21T03:44:26.044 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.045 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 9215, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 9215, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 9215, 2024-09-21T03:44:26.046 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 2, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-09-21T03:44:26.047 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 4, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 234, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 6, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:44:26.048 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-09-21T03:44:26.049 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-09-21T03:44:26.050 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_started": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "uninline_write_failed": 0 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-09-21T03:44:26.051 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 36755, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 47, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 4, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 90800563, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 90800451, 2024-09-21T03:44:26.052 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 36755 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 2147, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 13652, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 11505, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 228, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 750, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 522, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 9215, 2024-09-21T03:44:26.053 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 16940, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 7725, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 142452, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 354181120 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-09-21T03:44:26.054 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.055 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.056 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.057 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.058 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.059 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.060 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.061 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.062 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.063 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.064 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.065 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.066 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 3, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 1, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 2, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-09-21T03:44:26.067 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 1966, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:26.068 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:26.069 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:26.070 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 307402, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 2363, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 186, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:26.071 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 11789528, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 132619, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 2493, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 26, 2024-09-21T03:44:26.072 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 4, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 2493, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2493, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.536978892, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000616517 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2493, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2494 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 2493, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 2493, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-09-21T03:44:26.073 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 1602, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 888, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-09-21T03:44:26.074 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 2, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:26.075 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-09-21T03:44:26.076 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 91, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 14, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 9, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 9, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.077 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:26.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2743, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 87979598, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2743, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2743, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 87979598, 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:26.079 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:26.080 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2493, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 86627109, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2493, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 86627109, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:26.081 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2493, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 2493, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2493, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2493, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:26.082 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.083 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x561074d33450": { 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-09-21T03:44:26.084 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "trackedop": { 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:26.085 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-21T03:44:26.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:26 smithi121 ceph-mon[34316]: pgmap v660: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:44:26.886 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:44:26.887 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T03:44:26.887 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T03:44:26.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:26 smithi102 ceph-mon[31392]: pgmap v660: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:26.994 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:26 smithi148 ceph-mon[34651]: pgmap v660: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-09-21T03:44:27.131 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 222, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 217, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 838128, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 133184, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.043634640, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.020416333, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.030681709, 2024-09-21T03:44:27.683 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 216, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014981213, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000069357 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 838128, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 133184 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 5, 2024-09-21T03:44:27.684 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 166, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3152, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 109552, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.016759275, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.011870608, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.002872557, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 165, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.015439321, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000093571 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:27.685 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 109552 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.000343014, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T03:44:27.686 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000267545, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.687 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:27.688 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:27.689 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148967, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 29, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:27.690 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-09-21T03:44:27.691 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 223, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 806744, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 223, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 223, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 806744, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-09-21T03:44:27.692 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-09-21T03:44:27.693 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:27.693 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-09-21T03:44:27.693 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-09-21T03:44:28.413 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T03:44:28.413 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T03:44:28.413 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T03:44:28.413 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T03:44:28.413 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T03:44:28.414 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T03:44:28.414 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T03:44:28.414 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T03:44:28.414 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T03:44:28.680 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:44:28.744 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:28 smithi148 ceph-mon[34651]: pgmap v661: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-21T03:44:28.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:28 smithi121 ceph-mon[34316]: pgmap v661: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-21T03:44:28.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:28 smithi102 ceph-mon[31392]: pgmap v661: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-09-21T03:44:29.358 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T03:44:29.358 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:29.358 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 12346, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 25498, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 4950543, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 21315511, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 19, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 5, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 1.241954678, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.749564939, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.712841247, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.051786935, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 25497, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.748130278, 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000068562 2024-09-21T03:44:29.359 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 27154, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.005168984, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000190 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 927456, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 172176 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 6902, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 6754, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 2500934, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 17570952, 2024-09-21T03:44:29.360 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 44, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 10, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.569782056, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.297118808, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.229327486, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.064530193, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 6752, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.248680678, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000036830 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 9161, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.001323575, 2024-09-21T03:44:29.361 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000144 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 368976 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 13354, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 18265, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 8653070, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 12255171, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 9, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 6, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 1.180321730, 2024-09-21T03:44:29.362 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.647553558, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.514666117, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.072033848, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 18264, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.446811641, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000024464 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 26709, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.004417553, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000165 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 6288, 2024-09-21T03:44:29.363 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 12640 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 1, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-MDSRank": { 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 1251, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 6.646172442, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.005312687 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.364 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 5528, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.090287550, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000197230 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "request": 5558, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "reply": 5555, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "reply_latency": { 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 5555, 2024-09-21T03:44:29.365 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 10.909747415, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001963950 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_reply": 0, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "forward": 3, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_commit": 20, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_split": 1, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_merge": 0, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes": 5023, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_top": 0, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_bottom": 1, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pin_tail": 5022, 2024-09-21T03:44:29.366 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pinned": 5022, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_expired": 1253, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_with_caps": 1, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": 1, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "subtrees": 3, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse": 9443, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_hit": 7682, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_forward": 1, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_discover": 847, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_lock": 0, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "load_cent": 0, 2024-09-21T03:44:29.367 INFO:teuthology.orchestra.run.smithi148.stdout: "q": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "exported": 6, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "exported_inodes": 311, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "imported": 6, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "imported_inodes": 3460, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_backtrace_fetch": 1146, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rfiles": 4, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rbytes": 234, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rsnaps": 6, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_fetch": 1146, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:29.368 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_inodes": 44, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dirfrag_rstats": 44, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_file_inodes": 1102, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_revoke": 2932, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_grant": 5388, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps": 5467, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps_dirty": 2535, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_cap_release": 26, 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: "process_request_cap_release": 4259 2024-09-21T03:44:29.369 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_cache": { 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update": 55, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update_receipt": 2243, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_try_discover": 1542, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_send_discover": 1310, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_handle_discover": 90, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays": 166, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_created": 3896, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_enqueued": 3730, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:29.370 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_migrated": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_started": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_completed": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_exportdir": 6, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_flush": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragmentdir": 1, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:29.371 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_write_failed": 0 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_log": { 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evlrg": 2, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evadd": 14197, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evex": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evtrm": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "ev": 14197, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evexg": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "evexd": 0, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "segadd": 20, 2024-09-21T03:44:29.372 INFO:teuthology.orchestra.run.smithi148.stdout: "segex": 0, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "segtrm": 0, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "seg": 20, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "segmjr": 3, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "segexg": 0, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "segexd": 0, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "expos": 4194304, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "wrpos": 40136318, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "rdpos": 0, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "jlat": { 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 563, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 3.873005349, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.006879227 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.373 INFO:teuthology.orchestra.run.smithi148.stdout: "replayed": 0 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_mem": { 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 2437, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ino+": 6772, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "ino-": 4335, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dir": 222, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dir+": 808, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dir-": 586, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dn": 5023, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dn+": 10117, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "dn-": 5094, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "cap": 1, 2024-09-21T03:44:29.374 INFO:teuthology.orchestra.run.smithi148.stdout: "cap+": 3899, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "cap-": 3898, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "rss": 157004, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "heap": 386740224 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_server": { 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_client_request": 8854, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_server_request": 2, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_request": 5558, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_session": 22, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_peer_request": 7, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "req_create_latency": { 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 1232, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.914368210, 2024-09-21T03:44:29.375 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001553870 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getattr_latency": { 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000618365, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000206121 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "req_link_latency": { 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.376 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookup_latency": { 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 325, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.106392657, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000327362 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupino_latency": { 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.377 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupname_latency": { 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:29.378 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lssnap_latency": { 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.379 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mkdir_latency": { 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mknod_latency": { 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.380 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mksnap_latency": { 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "req_open_latency": { 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "req_readdir_latency": { 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 99, 2024-09-21T03:44:29.381 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.079142184, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000799416 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rename_latency": { 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.382 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmdir_latency": { 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 177, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 2.953303919, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.016685332 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.383 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setattr_latency": { 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.384 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setlayout_latency": { 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setxattr_latency": { 2024-09-21T03:44:29.385 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "req_symlink_latency": { 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "req_unlink_latency": { 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3719, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 5.855922080, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001574595 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:29.386 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_sessions": { 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "session_count": 2, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "session_add": 3, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "session_remove": 1, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_open": 2, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_stale": 0, 2024-09-21T03:44:29.387 INFO:teuthology.orchestra.run.smithi148.stdout: "total_load": 3980, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "average_load": 1990, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "avg_session_uptime": 637, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:29.388 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:29.389 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 1716199, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 2992, 2024-09-21T03:44:29.390 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 528, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 6, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 186, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T03:44:29.391 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 9765571, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 158346, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "objecter": { 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_active": 0, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_laggy": 0, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send": 5702, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send_bytes": 36770822, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_resend": 33, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_reply": 5702, 2024-09-21T03:44:29.392 INFO:teuthology.orchestra.run.smithi148.stdout: "op_latency": { 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 5702, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 14.908636790, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.002614632 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op_inflight": 0, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "oplen_avg": { 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 5702, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 5777 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op": 5702, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op_r": 1215, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op_w": 4487, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op_rmw": 0, 2024-09-21T03:44:29.393 INFO:teuthology.orchestra.run.smithi148.stdout: "op_pg": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_stat": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_create": 10, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_read": 69, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_write": 632, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writefull": 42, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writesame": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_append": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_zero": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_truncate": 1, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_delete": 3750, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_mapext": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:29.394 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_getxattr": 1146, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_setxattr": 20, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_call": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_watch": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_notify": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_other": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_active": 0, 2024-09-21T03:44:29.395 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_send": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_resend": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_ping": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_active": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_send": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_resend": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_active": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_send": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_resend": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_active": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_send": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_resend": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "command_active": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "command_send": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "command_resend": 0, 2024-09-21T03:44:29.396 INFO:teuthology.orchestra.run.smithi148.stdout: "map_epoch": 91, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "map_full": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "map_inc": 14, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_sessions": 12, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_open": 12, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_close": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_laggy": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_wr": 86, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_rd": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_del": 21 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "oft": { 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_objs": 1, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_updates": 0, 2024-09-21T03:44:29.397 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_removes": 0 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "purge_queue": { 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing": 0, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_high_water": 10, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed_ops": 3730, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed": 3730, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:29.398 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 32598, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 13152468, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 32598, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 32598, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 13152468, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.399 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 5702, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 37166496, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 5702, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 37166496, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.400 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 1024, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 5702, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 5702, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 5702, 2024-09-21T03:44:29.401 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 5702, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 3730, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 395674, 2024-09-21T03:44:29.402 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 3730, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 69, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 395674, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle-0x55e99ae37380": { 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:29.403 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 14197, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 35942014, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 14197, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 563, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 35942014, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.404 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:29.405 INFO:teuthology.orchestra.run.smithi148.stdout: "trackedop": { 2024-09-21T03:44:29.405 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_ops_count": 0 2024-09-21T03:44:29.405 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:29.405 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T03:44:30.272 INFO:tasks.check_counter:Daemon mds.c mds.exported=6 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds.imported=6 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=55 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=2243 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:44:30.273 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:44:30.273 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T03:44:30.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T03:44:30.535 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:44:30.781 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:30 smithi148 ceph-mon[34651]: pgmap v662: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:44:30.785 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:30 smithi121 ceph-mon[34316]: pgmap v662: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:44:30.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:30 smithi102 ceph-mon[31392]: pgmap v662: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T03:44:31.018 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1208, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 1210, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 21344387, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 384151, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 7, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.171303123, 2024-09-21T03:44:31.019 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.069455670, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.045461526, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.044496975, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 1208, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.061542948, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000050946 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.020 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1091, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 1253, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 13593401, 2024-09-21T03:44:31.021 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 715754, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 6, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 5, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.117978431, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.051527063, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.032545756, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.025250861, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 1251, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.067580225, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000054020 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:31.022 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 369072 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 273, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 253, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 5117852, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 141054, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 3, 2024-09-21T03:44:31.023 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.049638608, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.020361817, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.038342743, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000372553, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 253, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.019643528, 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000077642 2024-09-21T03:44:31.024 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 919152, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 135648 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.025 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 1, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-MDSRank": { 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3801, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.123190074, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000032409 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:31.026 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "request": 0, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "reply": 0, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "reply_latency": { 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.027 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_reply": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "forward": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_commit": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_split": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_merge": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes": 8340, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_top": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_bottom": 8340, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pin_tail": 0, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pinned": 8340, 2024-09-21T03:44:31.028 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_expired": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_with_caps": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "subtrees": 1, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_hit": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_forward": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_discover": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_lock": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "load_cent": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "q": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "exported": 0, 2024-09-21T03:44:31.029 INFO:teuthology.orchestra.run.smithi148.stdout: "exported_inodes": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "imported": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "imported_inodes": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_backtrace_fetch": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rfiles": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rbytes": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rsnaps": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_inodes": 0, 2024-09-21T03:44:31.030 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_file_inodes": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_inode_file_caps": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_grant": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps_dirty": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_cap_release": 0, 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: "process_request_cap_release": 0 2024-09-21T03:44:31.031 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_cache": { 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update_receipt": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_try_discover": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_send_discover": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_handle_discover": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_created": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_enqueued": 0, 2024-09-21T03:44:31.032 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_migrated": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_started": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_completed": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_exportdir": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_flush": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragmentdir": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:31.033 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_write_failed": 0 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_log": { 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "evlrg": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "evadd": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "evex": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "evtrm": 0, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "ev": 15197, 2024-09-21T03:44:31.034 INFO:teuthology.orchestra.run.smithi148.stdout: "evexg": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "evexd": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segadd": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segex": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segtrm": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "seg": 21, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segmjr": 3, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segexg": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "segexd": 0, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "expos": 4194304, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "wrpos": 42668413, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "rdpos": 42663872, 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "jlat": { 2024-09-21T03:44:31.035 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "replayed": 15197 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_mem": { 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 2556, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "ino+": 5710, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "ino-": 3154, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "dir": 272, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "dir+": 303, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "dir-": 31, 2024-09-21T03:44:31.036 INFO:teuthology.orchestra.run.smithi148.stdout: "dn": 8340, 2024-09-21T03:44:31.037 INFO:teuthology.orchestra.run.smithi148.stdout: "dn+": 8501, 2024-09-21T03:44:31.037 INFO:teuthology.orchestra.run.smithi148.stdout: "dn-": 161, 2024-09-21T03:44:31.037 INFO:teuthology.orchestra.run.smithi148.stdout: "cap": 0, 2024-09-21T03:44:31.037 INFO:teuthology.orchestra.run.smithi148.stdout: "cap+": 0, 2024-09-21T03:44:31.037 INFO:teuthology.orchestra.run.smithi148.stdout: "cap-": 0, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "rss": 136540, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "heap": 343547904 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_server": { 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_client_request": 0, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_server_request": 0, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_request": 0, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_session": 0, 2024-09-21T03:44:31.038 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_peer_request": 0, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "req_create_latency": { 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getattr_latency": { 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:31.039 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "req_link_latency": { 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookup_latency": { 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.040 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupino_latency": { 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupname_latency": { 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.041 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lssnap_latency": { 2024-09-21T03:44:31.042 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mkdir_latency": { 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.043 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mknod_latency": { 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mksnap_latency": { 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "req_open_latency": { 2024-09-21T03:44:31.044 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "req_readdir_latency": { 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.045 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rename_latency": { 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.046 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmdir_latency": { 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.047 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setattr_latency": { 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:31.048 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setlayout_latency": { 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.049 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setxattr_latency": { 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "req_symlink_latency": { 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "req_unlink_latency": { 2024-09-21T03:44:31.050 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.051 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_sessions": { 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "session_count": 1, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "session_add": 2, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "session_remove": 1, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_open": 1, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_stale": 0, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "total_load": 0, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "average_load": 0, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "avg_session_uptime": 1960, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.052 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:31.053 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:31.054 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:31.055 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 316046, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 2811, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:31.056 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 186, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 12251772, 2024-09-21T03:44:31.057 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 163983, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "objecter": { 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "op_active": 0, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "op_laggy": 0, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send": 2315, 2024-09-21T03:44:31.058 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send_bytes": 21, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "op_resend": 3, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "op_reply": 2315, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "op_latency": { 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 2315, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.452964735, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000627630 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "op_inflight": 0, 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "oplen_avg": { 2024-09-21T03:44:31.059 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 2315, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 2316 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "op": 2315, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "op_r": 2315, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "op_w": 0, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "op_rmw": 0, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "op_pg": 0, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_stat": 1511, 2024-09-21T03:44:31.060 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_create": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_read": 802, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_write": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writefull": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writesame": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_append": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_zero": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_truncate": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_delete": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_mapext": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:31.061 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_getxattr": 1, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_setxattr": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_call": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_watch": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_notify": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_other": 0, 2024-09-21T03:44:31.062 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_active": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_send": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_resend": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_ping": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_active": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_send": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_resend": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_active": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_send": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_resend": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_active": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_send": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_resend": 0, 2024-09-21T03:44:31.063 INFO:teuthology.orchestra.run.smithi148.stdout: "command_active": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "command_send": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "command_resend": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "map_epoch": 91, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "map_full": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "map_inc": 14, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_sessions": 8, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_open": 8, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_close": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_laggy": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_wr": 0, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_rd": 2, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_del": 0 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.064 INFO:teuthology.orchestra.run.smithi148.stdout: "oft": { 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_objs": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_updates": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_removes": 0 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "purge_queue": { 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_high_water": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed_ops": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed": 0, 2024-09-21T03:44:31.065 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 2568, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 39808641, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 2568, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 2568, 2024-09-21T03:44:31.066 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 39808641, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:31.067 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 2315, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 38476404, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 2315, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 38476404, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:31.068 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 1024, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 2315, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 2315, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 2315, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 2315, 2024-09-21T03:44:31.069 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:31.070 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle-0x55fb247b5380": { 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:31.071 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.072 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:31.073 INFO:teuthology.orchestra.run.smithi148.stdout: "trackedop": { 2024-09-21T03:44:31.073 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_ops_count": 0 2024-09-21T03:44:31.073 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:31.073 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T03:44:31.824 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T03:44:31.825 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T03:44:31.825 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T03:44:31.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T03:44:32.072 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 48136, 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 77554, 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 16170970, 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 82178256, 2024-09-21T03:44:32.579 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 21, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 6, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 3.702746550, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 2.118146758, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 3.341440963, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.246837705, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 77549, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 2.666309010, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000034382 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 99744, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.016511583, 2024-09-21T03:44:32.580 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000165 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 383056, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 130096 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 21381, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 16478, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 9460408, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 38810119, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 149, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 5, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 1.434760143, 2024-09-21T03:44:32.581 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.715783950, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.708260265, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.132599882, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 16481, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.130589793, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000068599 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 27227, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003586350, 2024-09-21T03:44:32.582 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000131 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 945168, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 164384 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 11813, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 12396, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 4131117, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 9345444, 2024-09-21T03:44:32.583 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 8, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 6, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.890420009, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.453766611, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.395866032, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.084380805, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 12394, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.815068676, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000065763 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 18096, 2024-09-21T03:44:32.584 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003076888, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000170 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 377472 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 1, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-MDSRank": { 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:32.585 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 4405, 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 23.453853422, 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.005324370 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "finisher-PurgeQueue": { 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "queue_len": 0, 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "complete_latency": { 2024-09-21T03:44:32.586 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 6677, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 2.125436234, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000318322 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "mds": { 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "request": 15710, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "reply": 15604, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "reply_latency": { 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 15604, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 36.994669307, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.002370845 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.587 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_reply": 0, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "forward": 106, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_complete": 0, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_fetch_keys": 0, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_commit": 138, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_split": 14, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_merge": 1, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes": 5513, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_top": 683, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_bottom": 4179, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pin_tail": 651, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_pinned": 4537, 2024-09-21T03:44:32.588 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_expired": 7665, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "inodes_with_caps": 3, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "caps": 4, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "subtrees": 4, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse": 25618, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_hit": 20213, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_forward": 0, 2024-09-21T03:44:32.589 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_discover": 176, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_dir_fetch": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_remote_ino": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "traverse_lock": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "load_cent": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "q": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "exported": 8, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "exported_inodes": 7227, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "imported": 8, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "imported_inodes": 446, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_dir_fetch": 0, 2024-09-21T03:44:32.590 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_backtrace_fetch": 4493, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "openino_peer_discover": 0, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rfiles": 4, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rbytes": 234, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "root_rsnaps": 6, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_fetch": 4493, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_set_tag": 0, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_inotable_repaired": 0, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_inodes": 491, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dir_base_inodes": 20, 2024-09-21T03:44:32.591 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_dirfrag_rstats": 471, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "scrub_file_inodes": 4002, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_inode_file_caps": 8, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_revoke": 10434, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_grant": 15594, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps": 28068, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_caps_dirty": 16624, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_cap_release": 872, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "process_request_cap_release": 6317 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.592 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_cache": { 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update": 1402, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_update_receipt": 480, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_try_discover": 302, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_send_discover": 322, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "dir_handle_discover": 2617, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays": 176, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_delayed": 0, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "num_strays_enqueuing": 0, 2024-09-21T03:44:32.593 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_created": 4562, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_enqueued": 4386, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_reintegrated": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "strays_migrated": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_processing": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_enqueued": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "num_recovering_prioritized": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_started": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "recovery_completed": 0, 2024-09-21T03:44:32.594 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_path": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_quiesce_inode": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_enqueue_scrub": 20, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_exportdir": 11, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_flush": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragmentdir": 15, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_fragstats": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "ireq_inodestats": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_started": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_succeeded": 0, 2024-09-21T03:44:32.595 INFO:teuthology.orchestra.run.smithi148.stdout: "uninline_write_failed": 0 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_log": { 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evlrg": 0, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evadd": 36755, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evex": 0, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evtrm": 0, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "ev": 36755, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evexg": 0, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "evexd": 0, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "segadd": 47, 2024-09-21T03:44:32.596 INFO:teuthology.orchestra.run.smithi148.stdout: "segex": 0, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "segtrm": 0, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "seg": 47, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "segmjr": 4, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "segexg": 0, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "segexd": 0, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "expos": 4194304, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "wrpos": 90800563, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "rdpos": 0, 2024-09-21T03:44:32.597 INFO:teuthology.orchestra.run.smithi148.stdout: "jlat": { 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3043, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 49.116807543, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.016140916 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "replayed": 0 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_mem": { 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino": 3025, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino+": 14230, 2024-09-21T03:44:32.598 INFO:teuthology.orchestra.run.smithi148.stdout: "ino-": 11205, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dir": 326, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dir+": 983, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dir-": 657, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dn": 5558, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dn+": 18157, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dn-": 12599, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "cap": 4, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "cap+": 9831, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "cap-": 9827, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "rss": 183812, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "heap": 425603072 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_server": { 2024-09-21T03:44:32.599 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_client_request": 18218, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "dispatch_server_request": 7, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_request": 15710, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_client_session": 31, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "handle_peer_request": 120, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "req_create_latency": { 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 9203, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 15.425724387, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001676162 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getattr_latency": { 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 111, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.038603485, 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000347779 2024-09-21T03:44:32.600 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getfilelock_latency": { 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "req_link_latency": { 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookup_latency": { 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 281, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.104578732, 2024-09-21T03:44:32.601 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000372166 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookuphash_latency": { 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupino_latency": { 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 2, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000304025, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000152012 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupname_latency": { 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.602 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupparent_latency": { 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.603 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lookupsnap_latency": { 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "req_lssnap_latency": { 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 11, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003544753, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000322250 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.604 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mkdir_latency": { 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 623, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.473806451, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000760523 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mknod_latency": { 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "req_mksnap_latency": { 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 11, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 2.046287318, 2024-09-21T03:44:32.605 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.186026119 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "req_open_latency": { 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 1, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000190914, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000190914 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "req_readdir_latency": { 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 781, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 1.311858718, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001679716 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.606 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rename_latency": { 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 2, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.002098657, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001049328 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "req_renamesnap_latency": { 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "req_snapdiff_latency": { 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.607 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmdir_latency": { 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 234, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 4.629384974, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.019783696 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmsnap_latency": { 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 5, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.024136577, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.004827315 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "req_rmxattr_latency": { 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.608 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setattr_latency": { 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 2, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.078489787, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.039244893 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setdirlayout_latency": { 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setfilelock_latency": { 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.609 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setlayout_latency": { 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "req_setxattr_latency": { 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 9, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.022222319, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.002469146 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.610 INFO:teuthology.orchestra.run.smithi148.stdout: "req_symlink_latency": { 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "req_unlink_latency": { 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 4328, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 12.833438210, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.002965212 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_revoke_eviction": 0, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "cap_acquisition_throttle": 0, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "req_getvxattr_latency": { 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.611 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_sessions": { 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "session_count": 2, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "session_add": 3, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "session_remove": 1, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_open": 2, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "sessions_stale": 0, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "total_load": 71, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "average_load": 35, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "avg_session_uptime": 642, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "mdthresh_evicted": 0 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.612 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:32.613 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:32.614 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:32.615 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 1745507, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 3465, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:32.616 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 8448, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 186, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 11760276, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 176477, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "objecter": { 2024-09-21T03:44:32.617 INFO:teuthology.orchestra.run.smithi148.stdout: "op_active": 0, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_laggy": 0, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send": 12969, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_send_bytes": 90318068, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_resend": 37, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_reply": 12969, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_latency": { 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 12969, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 53.100708475, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.004094433 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "op_inflight": 0, 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "oplen_avg": { 2024-09-21T03:44:32.618 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 12969, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 13223 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "op": 12969, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "op_r": 4602, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "op_w": 8367, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "op_rmw": 0, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "op_pg": 0, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_stat": 0, 2024-09-21T03:44:32.619 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_create": 11, 2024-09-21T03:44:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_read": 89, 2024-09-21T03:44:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_write": 3112, 2024-09-21T03:44:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writefull": 54, 2024-09-21T03:44:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_writesame": 0, 2024-09-21T03:44:32.620 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_append": 0, 2024-09-21T03:44:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_zero": 0, 2024-09-21T03:44:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_truncate": 14, 2024-09-21T03:44:32.621 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_delete": 4964, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_mapext": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_sparse_read": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_clonerange": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_getxattr": 4513, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_setxattr": 22, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_cmpxattr": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_rmxattr": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_resetxattrs": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_call": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_watch": 0, 2024-09-21T03:44:32.622 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_notify": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_pgls_filter": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "osdop_other": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_active": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_send": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_resend": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "linger_ping": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_active": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_send": 0, 2024-09-21T03:44:32.623 INFO:teuthology.orchestra.run.smithi148.stdout: "poolop_resend": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_active": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_send": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "poolstat_resend": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_active": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_send": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "statfs_resend": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "command_active": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "command_send": 0, 2024-09-21T03:44:32.624 INFO:teuthology.orchestra.run.smithi148.stdout: "command_resend": 0, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "map_epoch": 91, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "map_full": 0, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "map_inc": 14, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_sessions": 12, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_open": 12, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_session_close": 0, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_laggy": 0, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_wr": 391, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_rd": 0, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_del": 53 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "oft": { 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_objs": 1, 2024-09-21T03:44:32.625 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_kv_pairs": 0, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_updates": 0, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "omap_total_removes": 0 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "purge_queue": { 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops": 0, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_ops_high_water": 20, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing": 0, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executing_high_water": 10, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed_ops": 4424, 2024-09-21T03:44:32.626 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_executed": 4386, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "pq_item_in_journal": 0 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 81326, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 22383206, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 81326, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:32.627 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 81326, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 22383206, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.628 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_bytes": { 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 12969, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 90784430, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 12969, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 90784430, 2024-09-21T03:44:32.629 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-objecter_ops": { 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 1024, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 0, 2024-09-21T03:44:32.630 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 0, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 0, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 12969, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 12969, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 12969, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 12969, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.631 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle": { 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 4386, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 466362, 2024-09-21T03:44:32.632 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 4386, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 69, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 466362, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.633 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-write_buf_throttle-0x55d98d3a3380": { 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 3758096384, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 36755, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 86606259, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:32.634 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 36755, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 3043, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 86606259, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "trackedop": { 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: "slow_ops_count": 0 2024-09-21T03:44:32.635 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:32.636 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T03:44:32.636 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:32 smithi148 ceph-mon[34651]: pgmap v663: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:44:32.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:32 smithi121 ceph-mon[34316]: pgmap v663: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:44:32.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:32 smithi102 ceph-mon[31392]: pgmap v663: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds.exported=8 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds.imported=8 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1402 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=480 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=11 2024-09-21T03:44:33.299 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=5 2024-09-21T03:44:33.299 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T03:44:33.300 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T03:44:33.548 INFO:teuthology.orchestra.run.smithi148.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:44:34.090 INFO:teuthology.orchestra.run.smithi148.stdout:{ 2024-09-21T03:44:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T03:44:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 4, 2024-09-21T03:44:34.090 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 4, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 2992, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 448, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 4, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 0, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.003046870, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.000042419, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.002171362, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 3, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.003912675, 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.001304225 2024-09-21T03:44:34.091 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 1, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 166, 2024-09-21T03:44:34.092 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 160, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 109456, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 3, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 2, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.014508906, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.011572753, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.000973264, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 164, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.010759086, 2024-09-21T03:44:34.093 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000065604 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 109456 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_messages": 224, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages": 219, 2024-09-21T03:44:34.094 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_bytes": 838672, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_bytes": 134464, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_created_connections": 2, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_active_connections": 1, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_total_time": 0.040845209, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_send_time": 0.019043550, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_recv_time": 0.031377115, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 218, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.013339744, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000061191 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.095 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_handle_ack_lat": { 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_recv_encrypted_bytes": 838672, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "msgr_send_encrypted_bytes": 134464 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "cct": { 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "total_workers": 0, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "unhealthy_workers": 0 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "mempool": { 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_bytes": 0, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "bloom_filter_items": 0, 2024-09-21T03:44:34.096 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_alloc_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_data_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_other_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_bytes": 0, 2024-09-21T03:44:34.097 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_extent_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_blob_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_fsck_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_txc_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T03:44:34.098 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluestore_writing_items": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_items": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_reader_items": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "bluefs_file_writer_items": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_bytes": 148967, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_anon_items": 29, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "buffer_meta_items": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_bytes": 0, 2024-09-21T03:44:34.099 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_bytes": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_mapbl_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_bytes": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osd_pglog_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_bytes": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "osdmap_mapping_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_bytes": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "pgmap_items": 0, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_bytes": 968, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "mds_co_items": 2, 2024-09-21T03:44:34.100 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_bytes": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_1_items": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_bytes": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "unittest_2_items": 0 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: }, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "val": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "max": 104857600, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "get_started": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "get": 225, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "get_sum": 807004, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_fail": 0, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "get_or_fail_success": 225, 2024-09-21T03:44:34.101 INFO:teuthology.orchestra.run.smithi148.stdout: "take": 0, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "take_sum": 0, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "put": 225, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "put_sum": 807004, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "wait": { 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "avgcount": 0, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "sum": 0.000000000, 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: "avgtime": 0.000000000 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout: } 2024-09-21T03:44:34.102 INFO:teuthology.orchestra.run.smithi148.stdout:} 2024-09-21T03:44:34.786 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:34 smithi121 ceph-mon[34316]: pgmap v664: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:44:34.906 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:34 smithi148 ceph-mon[34651]: pgmap v664: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T03:44:34.937 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T03:44:34.938 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T03:44:34.954 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T03:44:34.955 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:44:34.955 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:44:34.955 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:34 smithi102 ceph-mon[31392]: pgmap v664: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 7 op/s 2024-09-21T03:44:34.975 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-21T03:44:34.975 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T03:44:35.035 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T03:44:35.331 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.887+0000 7f3d42cba640 1 -- 172.21.15.102:0/1849071769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c1094a0 msgr2=0x7f3d3c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.887+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1849071769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c1098b0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009ca0 tx=0x7f3d2402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 -- 172.21.15.102:0/1849071769 shutdown_connections 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1849071769 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c1098b0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1849071769 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c109df0 0x7f3d3c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1849071769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c103b60 0x7f3d3c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 -- 172.21.15.102:0/1849071769 >> 172.21.15.102:0/1849071769 conn(0x7f3d3c07b850 msgr2=0x7f3d3c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 -- 172.21.15.102:0/1849071769 shutdown_connections 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 -- 172.21.15.102:0/1849071769 wait complete. 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 Processor -- start 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 -- start start 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.888+0000 7f3d42cba640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c103b60 0x7f3d3c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c113bd0 con 0x7f3d3c109df0 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c113a50 con 0x7f3d3c1094a0 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f3d3c113d50 con 0x7f3d3c103b60 2024-09-21T03:44:35.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36208/0 (socket says 172.21.15.102:36208) 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 -- 172.21.15.102:0/1047430421 learned_addr learned my addr 172.21.15.102:0/1047430421 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d3bfff640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d40a56640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c103b60 0x7f3d3c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 -- 172.21.15.102:0/1047430421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c103b60 msgr2=0x7f3d3c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c103b60 0x7f3d3c19a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 -- 172.21.15.102:0/1047430421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 msgr2=0x7f3d3c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 -- 172.21.15.102:0/1047430421 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3c1a0590 con 0x7f3d3c109df0 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d3bfff640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:35.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d41257640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c970 tx=0x7f3d3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34007bb0 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3c1a0880 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f3d34007d50 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.889+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d340187c0 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.890+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d3c1a70a0 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.890+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c103f70 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.892+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f3d3400fa40 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.893+0000 7f3d39ffb640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 0x7f3d280b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.893+0000 7f3d40a56640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 0x7f3d280b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.893+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8586+0+0 (secure 0 0 0) 0x7f3d340e78e0 con 0x7f3d3c109df0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.893+0000 7f3d40a56640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 0x7f3d280b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c009470 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:35.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:35.896+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d34014030 con 0x7f3d3c109df0 2024-09-21T03:44:36.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.088+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3d3c19b810 con 0x7f3d3c109df0 2024-09-21T03:44:36.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.089+0000 7f3d39ffb640 1 -- 172.21.15.102:0/1047430421 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v91) ==== 81+0+901 (secure 0 0 0) 0x7f3d340ade80 con 0x7f3d3c109df0 2024-09-21T03:44:36.091 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/4149087988 2024-09-22T03:25:04.133377+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/3263495485 2024-09-22T03:23:38.629653+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/2843523961 2024-09-22T03:23:38.629653+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/300734679 2024-09-22T03:23:38.629653+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6801/3956447939 2024-09-22T03:24:03.539725+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6800/2870558437 2024-09-22T03:23:38.629653+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6800/3956447939 2024-09-22T03:24:03.539725+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6801/4066875674 2024-09-22T03:25:04.133377+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/2031600970 2024-09-22T03:24:03.539725+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6800/4066875674 2024-09-22T03:25:04.133377+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/2561662143 2024-09-22T03:24:03.539725+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:6801/2870558437 2024-09-22T03:23:38.629653+0000 2024-09-21T03:44:36.092 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/1964871279 2024-09-22T03:25:04.133377+0000 2024-09-21T03:44:36.093 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/427898860 2024-09-22T03:25:04.133377+0000 2024-09-21T03:44:36.093 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102:0/1752373453 2024-09-22T03:24:03.539725+0000 2024-09-21T03:44:36.093 INFO:teuthology.orchestra.run.smithi102.stderr:listed 15 entries 2024-09-21T03:44:36.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 msgr2=0x7f3d280b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:36.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 0x7f3d280b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c005fd0 tx=0x7f3d2c009470 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 msgr2=0x7f3d3c19ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3d3400c970 tx=0x7f3d3400ce30 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 shutdown_connections 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f3d280b66b0 0x7f3d280b8bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3d3c109df0 0x7f3d3c19ff20 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3d3c1094a0 0x7f3d3c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 --2- 172.21.15.102:0/1047430421 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f3d3c103b60 0x7f3d3c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 >> 172.21.15.102:0/1047430421 conn(0x7f3d3c07b850 msgr2=0x7f3d3c107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 shutdown_connections 2024-09-21T03:44:36.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:36.091+0000 7f3d42cba640 1 -- 172.21.15.102:0/1047430421 wait complete. 2024-09-21T03:44:36.446 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:36 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/1047430421' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:44:36.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:36 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/1047430421' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:44:36.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:36 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/1047430421' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T03:44:36.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T03:44:36.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:44:36.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T03:44:36.785 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:44:36.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:44:36.785 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T03:44:36.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:44:36.829 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-21T03:44:36.866 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T03:44:36.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:44:36.867 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T03:44:36.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T03:44:36.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-21T03:44:37.038 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T03:44:37.048 INFO:tasks.cephadm:Teardown begin 2024-09-21T03:44:37.049 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T03:44:37.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:37.300 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:37.419 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:37 smithi102 ceph-mon[31392]: pgmap v665: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:44:37.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:37 smithi148 ceph-mon[34651]: pgmap v665: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:44:37.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:37 smithi121 ceph-mon[34316]: pgmap v665: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T03:44:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- 172.21.15.102:0/4139156143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8074108cf0 msgr2=0x7f807410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 --2- 172.21.15.102:0/4139156143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8074108cf0 0x7f807410f520 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f806c009ca0 tx=0x7f806c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- 172.21.15.102:0/4139156143 shutdown_connections 2024-09-21T03:44:37.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 --2- 172.21.15.102:0/4139156143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8074108cf0 0x7f807410f520 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 --2- 172.21.15.102:0/4139156143 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f80741083a0 0x7f80741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 --2- 172.21.15.102:0/4139156143 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 0x7f8074102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- 172.21.15.102:0/4139156143 >> 172.21.15.102:0/4139156143 conn(0x7f8074079730 msgr2=0x7f8074079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- 172.21.15.102:0/4139156143 shutdown_connections 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- 172.21.15.102:0/4139156143 wait complete. 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 Processor -- start 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.841+0000 7f8079749640 1 -- start start 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 0x7f807419b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8074108cf0 0x7f807419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112a80 con 0x7f80741083a0 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112900 con 0x7f8074102a60 2024-09-21T03:44:37.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8079749640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f8074112c00 con 0x7f8074108cf0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36232/0 (socket says 172.21.15.102:36232) 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 -- 172.21.15.102:0/2104109119 learned_addr learned my addr 172.21.15.102:0/2104109119 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f80737fe640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8074108cf0 0x7f807419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8072ffd640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 0x7f807419b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 -- 172.21.15.102:0/2104109119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8074108cf0 msgr2=0x7f807419bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8074108cf0 0x7f807419bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 -- 172.21.15.102:0/2104109119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 msgr2=0x7f807419b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 0x7f807419b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 -- 172.21.15.102:0/2104109119 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80741a6600 con 0x7f80741083a0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f806bfff640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f805c00d770 tx=0x7f805c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.842+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c017070 con 0x7f80741083a0 2024-09-21T03:44:37.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.843+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80741a68f0 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.843+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f805c009c30 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.843+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c00f620 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.843+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80741a6e80 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.844+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8074102e70 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.845+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f805c01a070 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.846+0000 7f8070ff9640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 0x7f80600b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.846+0000 7f8072ffd640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 0x7f80600b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.846+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8586+0+0 (secure 0 0 0) 0x7f805c0e70a0 con 0x7f80741083a0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.847+0000 7f8072ffd640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 0x7f80600b8bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f80640058c0 tx=0x7f806400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:37.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:37.849+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f805c0b1990 con 0x7f80741083a0 2024-09-21T03:44:38.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.061+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f807406b270 con 0x7f80741083a0 2024-09-21T03:44:38.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.062+0000 7f8070ff9640 1 -- 172.21.15.102:0/2104109119 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f807406b270 con 0x7f80741083a0 2024-09-21T03:44:38.064 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:38.064 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:44:38.065 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:44:38.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 msgr2=0x7f80600b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 0x7f80600b8bc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f80640058c0 tx=0x7f806400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 msgr2=0x7f807419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f805c00d770 tx=0x7f805c00dc30 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 shutdown_connections 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f80600b66b0 0x7f80600b8bc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f80741083a0 0x7f807419b8b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f8074108cf0 0x7f807419bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 --2- 172.21.15.102:0/2104109119 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8074102a60 0x7f807419b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 >> 172.21.15.102:0/2104109119 conn(0x7f8074079730 msgr2=0x7f8074104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 shutdown_connections 2024-09-21T03:44:38.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:38.064+0000 7f8079749640 1 -- 172.21.15.102:0/2104109119 wait complete. 2024-09-21T03:44:38.432 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:38 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2104109119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:38.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:38 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2104109119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:38.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:38 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2104109119' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:38.724 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:44:38.974 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:39.353 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:39 smithi102 ceph-mon[31392]: pgmap v666: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:44:39.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 -- 172.21.15.102:0/1218277194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 msgr2=0x7f6a40110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:39.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 --2- 172.21.15.102:0/1218277194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a40110300 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009900 tx=0x7f6a3802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:39.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 -- 172.21.15.102:0/1218277194 shutdown_connections 2024-09-21T03:44:39.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 --2- 172.21.15.102:0/1218277194 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a40110300 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 --2- 172.21.15.102:0/1218277194 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 0x7f6a4010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 --2- 172.21.15.102:0/1218277194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a40104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 -- 172.21.15.102:0/1218277194 >> 172.21.15.102:0/1218277194 conn(0x7f6a40079730 msgr2=0x7f6a40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 -- 172.21.15.102:0/1218277194 shutdown_connections 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.440+0000 7f6a4878b640 1 -- 172.21.15.102:0/1218277194 wait complete. 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 Processor -- start 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 -- start start 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a4019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 0x7f6a4019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113bb0 con 0x7f6a4010de30 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113a30 con 0x7f6a40104880 2024-09-21T03:44:39.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a4878b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f6a40113d30 con 0x7f6a401052b0 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36258/0 (socket says 172.21.15.102:36258) 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 -- 172.21.15.102:0/2923049888 learned_addr learned my addr 172.21.15.102:0/2923049888 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a45d26640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 0x7f6a4019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46527640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a4019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 -- 172.21.15.102:0/2923049888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 msgr2=0x7f6a4019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 0x7f6a4019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 -- 172.21.15.102:0/2923049888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 msgr2=0x7f6a4019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a4019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46d28640 1 -- 172.21.15.102:0/2923049888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a401a04d0 con 0x7f6a4010de30 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.441+0000 7f6a46527640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a4019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a46d28640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005ab0 tx=0x7f6a380042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:39.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3803f030 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a401a0760 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f6a38003cd0 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38035070 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.442+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a401a0c40 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.443+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a40104c90 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.444+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f6a38042030 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.445+0000 7f6a3f7fe640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 0x7f6a280b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.445+0000 7f6a46527640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 0x7f6a280b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.445+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8586+0+0 (secure 0 0 0) 0x7f6a38107e90 con 0x7f6a4010de30 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.446+0000 7f6a46527640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 0x7f6a280b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6a4006bbc0 tx=0x7f6a30007870 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:39.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.448+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6a380ce3a0 con 0x7f6a4010de30 2024-09-21T03:44:39.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:39 smithi148 ceph-mon[34651]: pgmap v666: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:44:39.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:39 smithi121 ceph-mon[34316]: pgmap v666: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T03:44:39.665 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.663+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a401a7040 con 0x7f6a4010de30 2024-09-21T03:44:39.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.664+0000 7f6a3f7fe640 1 -- 172.21.15.102:0/2923049888 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11933 (secure 0 0 0) 0x7f6a380d2780 con 0x7f6a4010de30 2024-09-21T03:44:39.666 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:39.667 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":35,"btime":"2024-09-21T03:39:02:592512+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6835/1688882523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":1688882523},{"type":"v1","addr":"172.21.15.102:6835","nonce":1688882523}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2970785732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6836","nonce":2970785732},{"type":"v1","addr":"172.21.15.102:6837","nonce":2970785732}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14832,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6839/3219085509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6838","nonce":3219085509},{"type":"v1","addr":"172.21.15.102:6839","nonce":3219085509}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14844,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6841/4025152844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6840","nonce":4025152844},{"type":"v1","addr":"172.21.15.102:6841","nonce":4025152844}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24584,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/172872234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":172872234},{"type":"v1","addr":"172.21.15.121:6833","nonce":172872234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24595,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.148:6833/1886877979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":1886877979},{"type":"v1","addr":"172.21.15.148:6833","nonce":1886877979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T03:31:41.100708+0000","modified":"2024-09-21T03:39:01.621180+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24661,"mds_1":24659,"mds_2":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24611":{"gid":24611,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/2193609869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":2193609869},{"type":"v1","addr":"172.21.15.121:6835","nonce":2193609869}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24628":{"gid":24628,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.148:6835/4203175374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6834","nonce":4203175374},{"type":"v1","addr":"172.21.15.148:6835","nonce":4203175374}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24632":{"gid":24632,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/3016052537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":3016052537},{"type":"v1","addr":"172.21.15.121:6837","nonce":3016052537}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"c","rank":2,"incarnation":20,"state":"up:active","state_seq":10,"addr":"172.21.15.148:6837/1009058837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6836","nonce":1009058837},{"type":"v1","addr":"172.21.15.148:6837","nonce":1009058837}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":1,"incarnation":18,"state":"up:active","state_seq":6,"addr":"172.21.15.121:6839/891322364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":891322364},{"type":"v1","addr":"172.21.15.121:6839","nonce":891322364}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24661":{"gid":24661,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.148:6839/3369184447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6838","nonce":3369184447},{"type":"v1","addr":"172.21.15.148:6839","nonce":3369184447}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24661,"qdb_cluster":[24637,24659,24661]},"id":1}]} 2024-09-21T03:44:39.667 INFO:teuthology.orchestra.run.smithi102.stderr:dumped fsmap epoch 35 2024-09-21T03:44:39.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 msgr2=0x7f6a280b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:39.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 0x7f6a280b8bc0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6a4006bbc0 tx=0x7f6a30007870 comp rx=0 tx=0).stop 2024-09-21T03:44:39.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 msgr2=0x7f6a4019fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:39.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005ab0 tx=0x7f6a380042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 shutdown_connections 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f6a280b66b0 0x7f6a280b8bc0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6a4010de30 0x7f6a4019fe60 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f6a401052b0 0x7f6a4019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 --2- 172.21.15.102:0/2923049888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a40104880 0x7f6a4019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 >> 172.21.15.102:0/2923049888 conn(0x7f6a40079730 msgr2=0x7f6a40107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 shutdown_connections 2024-09-21T03:44:39.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:39.666+0000 7f6a4878b640 1 -- 172.21.15.102:0/2923049888 wait complete. 2024-09-21T03:44:40.351 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:40 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2923049888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:40.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:44:40.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:40 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2923049888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:40.536 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:40 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2923049888' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:44:40.596 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:41.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 -- 172.21.15.102:0/1477406482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 msgr2=0x7f18bc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:41.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/1477406482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc102ef0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009900 tx=0x7f18b002a410 comp rx=0 tx=0).stop 2024-09-21T03:44:41.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 -- 172.21.15.102:0/1477406482 shutdown_connections 2024-09-21T03:44:41.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/1477406482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc108d20 0x7f18bc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/1477406482 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc1083d0 0x7f18bc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/1477406482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc102ef0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 -- 172.21.15.102:0/1477406482 >> 172.21.15.102:0/1477406482 conn(0x7f18bc079760 msgr2=0x7f18bc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 -- 172.21.15.102:0/1477406482 shutdown_connections 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.171+0000 7f18c2b3b640 1 -- 172.21.15.102:0/1477406482 wait complete. 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 Processor -- start 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 -- start start 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc1083d0 0x7f18bc1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc108d20 0x7f18bc19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112ad0 con 0x7f18bc102ae0 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112950 con 0x7f18bc1083d0 2024-09-21T03:44:41.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c2b3b640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f18bc112c50 con 0x7f18bc108d20 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.172+0000 7f18c08d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36276/0 (socket says 172.21.15.102:36276) 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 -- 172.21.15.102:0/2767220248 learned_addr learned my addr 172.21.15.102:0/2767220248 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18bbfff640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc1083d0 0x7f18bc1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c10d8640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc108d20 0x7f18bc19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 -- 172.21.15.102:0/2767220248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc108d20 msgr2=0x7f18bc19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc108d20 0x7f18bc19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 -- 172.21.15.102:0/2767220248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc1083d0 msgr2=0x7f18bc1999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc1083d0 0x7f18bc1999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 -- 172.21.15.102:0/2767220248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18bc19f390 con 0x7f18bc102ae0 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c08d7640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005ab0 tx=0x7f18b00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:41.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b003f030 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18bc19f620 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f18b0003cd0 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0035070 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.173+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18bc1a5de0 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.175+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18bc103d10 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.176+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f18b0042030 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.176+0000 7f18b9ffb640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 0x7f18ac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.177+0000 7f18bbfff640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 0x7f18ac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.177+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8586+0+0 (secure 0 0 0) 0x7f18b0108060 con 0x7f18bc102ae0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.177+0000 7f18bbfff640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 0x7f18ac0b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f18bc079c40 tx=0x7f18a8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:41.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.181+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18b00ce570 con 0x7f18bc102ae0 2024-09-21T03:44:41.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.361+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18bc10ab50 con 0x7f18bc102ae0 2024-09-21T03:44:41.364 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:41 smithi102 ceph-mon[31392]: pgmap v667: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:44:41.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.363+0000 7f18b9ffb640 1 -- 172.21.15.102:0/2767220248 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+23382 (secure 0 0 0) 0x7f18b00d2950 con 0x7f18bc102ae0 2024-09-21T03:44:41.365 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-21T03:44:41.366 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":91,"fsid":"a5dfbe26-77c8-11ef-baf5-efdc52797490","created":"2024-09-21T03:23:16.722760+0000","modified":"2024-09-21T03:44:16.955534+0000","last_up_change":"2024-09-21T03:30:49.505388+0000","last_in_change":"2024-09-21T03:30:27.399161+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:27:06.439475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T03:31:37.203364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T03:31:39.048176+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":90,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"aa4011b8-e09e-475a-9c72-baa73d3c2bc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6803","nonce":3173439186}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6805","nonce":3173439186}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6809","nonce":3173439186}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3173439186},{"type":"v1","addr":"172.21.15.102:6807","nonce":3173439186}]},"public_addr":"172.21.15.102:6803/3173439186","cluster_addr":"172.21.15.102:6805/3173439186","heartbeat_back_addr":"172.21.15.102:6809/3173439186","heartbeat_front_addr":"172.21.15.102:6807/3173439186","state":["exists","up"]},{"osd":1,"uuid":"2419af68-299f-44c9-bb97-66c3a6ef0f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6801","nonce":864903414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6803","nonce":864903414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6807","nonce":864903414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":864903414},{"type":"v1","addr":"172.21.15.121:6805","nonce":864903414}]},"public_addr":"172.21.15.121:6801/864903414","cluster_addr":"172.21.15.121:6803/864903414","heartbeat_back_addr":"172.21.15.121:6807/864903414","heartbeat_front_addr":"172.21.15.121:6805/864903414","state":["exists","up"]},{"osd":2,"uuid":"4b9b4159-420e-4fcf-bf82-eeb15e5674c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6801","nonce":807337613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6803","nonce":807337613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6807","nonce":807337613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":807337613},{"type":"v1","addr":"172.21.15.148:6805","nonce":807337613}]},"public_addr":"172.21.15.148:6801/807337613","cluster_addr":"172.21.15.148:6803/807337613","heartbeat_back_addr":"172.21.15.148:6807/807337613","heartbeat_front_addr":"172.21.15.148:6805/807337613","state":["exists","up"]},{"osd":3,"uuid":"a79de33f-eac7-49a7-9045-be22d0ae933c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6811","nonce":4062411354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6813","nonce":4062411354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6817","nonce":4062411354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":4062411354},{"type":"v1","addr":"172.21.15.102:6815","nonce":4062411354}]},"public_addr":"172.21.15.102:6811/4062411354","cluster_addr":"172.21.15.102:6813/4062411354","heartbeat_back_addr":"172.21.15.102:6817/4062411354","heartbeat_front_addr":"172.21.15.102:6815/4062411354","state":["exists","up"]},{"osd":4,"uuid":"7fb68fd9-b5d3-4847-b717-10a7e9ac1319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6809","nonce":3405274815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6811","nonce":3405274815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6815","nonce":3405274815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3405274815},{"type":"v1","addr":"172.21.15.121:6813","nonce":3405274815}]},"public_addr":"172.21.15.121:6809/3405274815","cluster_addr":"172.21.15.121:6811/3405274815","heartbeat_back_addr":"172.21.15.121:6815/3405274815","heartbeat_front_addr":"172.21.15.121:6813/3405274815","state":["exists","up"]},{"osd":5,"uuid":"921fdc95-272e-4059-912a-76c97e920465","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6809","nonce":1887027995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6811","nonce":1887027995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6815","nonce":1887027995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1887027995},{"type":"v1","addr":"172.21.15.148:6813","nonce":1887027995}]},"public_addr":"172.21.15.148:6809/1887027995","cluster_addr":"172.21.15.148:6811/1887027995","heartbeat_back_addr":"172.21.15.148:6815/1887027995","heartbeat_front_addr":"172.21.15.148:6813/1887027995","state":["exists","up"]},{"osd":6,"uuid":"0d2ec93c-5842-4c44-83a6-85b40ea4dfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6819","nonce":3311755502}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6821","nonce":3311755502}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6825","nonce":3311755502}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3311755502},{"type":"v1","addr":"172.21.15.102:6823","nonce":3311755502}]},"public_addr":"172.21.15.102:6819/3311755502","cluster_addr":"172.21.15.102:6821/3311755502","heartbeat_back_addr":"172.21.15.102:6825/3311755502","heartbeat_front_addr":"172.21.15.102:6823/3311755502","state":["exists","up"]},{"osd":7,"uuid":"57d52535-2844-4895-b02c-543c561ee54b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6817","nonce":2625959446}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6819","nonce":2625959446}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6823","nonce":2625959446}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2625959446},{"type":"v1","addr":"172.21.15.121:6821","nonce":2625959446}]},"public_addr":"172.21.15.121:6817/2625959446","cluster_addr":"172.21.15.121:6819/2625959446","heartbeat_back_addr":"172.21.15.121:6823/2625959446","heartbeat_front_addr":"172.21.15.121:6821/2625959446","state":["exists","up"]},{"osd":8,"uuid":"0c9af4a2-c599-4c13-916a-482f92ff1ef6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6817","nonce":1644910051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6818","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6819","nonce":1644910051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6822","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6823","nonce":1644910051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1644910051},{"type":"v1","addr":"172.21.15.148:6821","nonce":1644910051}]},"public_addr":"172.21.15.148:6817/1644910051","cluster_addr":"172.21.15.148:6819/1644910051","heartbeat_back_addr":"172.21.15.148:6823/1644910051","heartbeat_front_addr":"172.21.15.148:6821/1644910051","state":["exists","up"]},{"osd":9,"uuid":"42776936-bb0a-4c50-8985-7362fc3d88cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6827","nonce":171485892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6829","nonce":171485892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6833","nonce":171485892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":171485892},{"type":"v1","addr":"172.21.15.102:6831","nonce":171485892}]},"public_addr":"172.21.15.102:6827/171485892","cluster_addr":"172.21.15.102:6829/171485892","heartbeat_back_addr":"172.21.15.102:6833/171485892","heartbeat_front_addr":"172.21.15.102:6831/171485892","state":["exists","up"]},{"osd":10,"uuid":"127447a0-18cf-4a03-a1da-4d4a1a3c2268","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6825","nonce":3942483179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6827","nonce":3942483179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6831","nonce":3942483179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":3942483179},{"type":"v1","addr":"172.21.15.121:6829","nonce":3942483179}]},"public_addr":"172.21.15.121:6825/3942483179","cluster_addr":"172.21.15.121:6827/3942483179","heartbeat_back_addr":"172.21.15.121:6831/3942483179","heartbeat_front_addr":"172.21.15.121:6829/3942483179","state":["exists","up"]},{"osd":11,"uuid":"17bb6286-d812-42d3-b399-87e75901b950","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6825","nonce":3639095642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6826","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6827","nonce":3639095642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6830","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6831","nonce":3639095642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":3639095642},{"type":"v1","addr":"172.21.15.148:6829","nonce":3639095642}]},"public_addr":"172.21.15.148:6825/3639095642","cluster_addr":"172.21.15.148:6827/3639095642","heartbeat_back_addr":"172.21.15.148:6831/3639095642","heartbeat_front_addr":"172.21.15.148:6829/3639095642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:11.459686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:26:58.418292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:02.303140+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:26.677061+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:27:52.702322+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:17.786750+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:28:43.512290+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:09.393568+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:34.298994+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:29:58.989706+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:23.933456+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:30:47.965071+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":7,"to":4}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"2.12","mappings":[{"from":5,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":6}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":6}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.102:0/4149087988":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/3263495485":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/2843523961":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/300734679":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6801/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:6800/3956447939":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2031600970":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6800/4066875674":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/2561662143":"2024-09-22T03:24:03.539725+0000","172.21.15.102:6801/2870558437":"2024-09-22T03:23:38.629653+0000","172.21.15.102:0/1964871279":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/427898860":"2024-09-22T03:25:04.133377+0000","172.21.15.102:0/1752373453":"2024-09-22T03:24:03.539725+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:44:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 msgr2=0x7f18ac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 0x7f18ac0b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f18bc079c40 tx=0x7f18a8005f90 comp rx=0 tx=0).stop 2024-09-21T03:44:41.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 msgr2=0x7f18bc199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005ab0 tx=0x7f18b00042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 shutdown_connections 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f18ac0b6680 0x7f18ac0b8b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f18bc108d20 0x7f18bc19ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18bc1083d0 0x7f18bc1999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 --2- 172.21.15.102:0/2767220248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18bc102ae0 0x7f18bc199420 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 >> 172.21.15.102:0/2767220248 conn(0x7f18bc079760 msgr2=0x7f18bc101480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 shutdown_connections 2024-09-21T03:44:41.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:41.365+0000 7f18c2b3b640 1 -- 172.21.15.102:0/2767220248 wait complete. 2024-09-21T03:44:41.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:41 smithi148 ceph-mon[34651]: pgmap v667: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:44:41.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:41 smithi121 ceph-mon[34316]: pgmap v667: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-21T03:44:42.038 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T03:44:42.281 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:42.401 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:42 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/2767220248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:42.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:42 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/2767220248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:42.535 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:42 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/2767220248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:44:42.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 -- 172.21.15.102:0/938359259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50075dd0 msgr2=0x7f7b500761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/938359259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50075dd0 0x7f7b500761e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f7b40009900 tx=0x7f7b4002a410 comp rx=0 tx=0).stop 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 -- 172.21.15.102:0/938359259 shutdown_connections 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/938359259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50075dd0 0x7f7b500761e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/938359259 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 0x7f7b50116900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/938359259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50077380 0x7f7b500757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 -- 172.21.15.102:0/938359259 >> 172.21.15.102:0/938359259 conn(0x7f7b5007b850 msgr2=0x7f7b5007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 -- 172.21.15.102:0/938359259 shutdown_connections 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.719+0000 7f7b57f2d640 1 -- 172.21.15.102:0/938359259 wait complete. 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 Processor -- start 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 -- start start 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50075dd0 0x7f7b501a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:42.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 0x7f7b501a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5011a190 con 0x7f7b50077380 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5011a010 con 0x7f7b50075dd0 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b57f2d640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5011a310 con 0x7f7b50114430 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36306/0 (socket says 172.21.15.102:36306) 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 -- 172.21.15.102:0/3549603910 learned_addr learned my addr 172.21.15.102:0/3549603910 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b564ca640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 0x7f7b501a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b55cc9640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50075dd0 0x7f7b501a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 -- 172.21.15.102:0/3549603910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 msgr2=0x7f7b501a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 0x7f7b501a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 -- 172.21.15.102:0/3549603910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50075dd0 msgr2=0x7f7b501a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50075dd0 0x7f7b501a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.720+0000 7f7b554c8640 1 -- 172.21.15.102:0/3549603910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b501a6a70 con 0x7f7b50077380 2024-09-21T03:44:42.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b554c8640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7b40005940 tx=0x7f7b400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4003f030 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7f7b40031910 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b501a6d00 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b40035070 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.721+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b501ad4c0 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.722+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b500761e0 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.723+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7f7b40042030 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.724+0000 7f7b46ffd640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 0x7f7b3c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.724+0000 7f7b55cc9640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 0x7f7b3c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.725+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8586+0+0 (secure 0 0 0) 0x7f7b40108110 con 0x7f7b50077380 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.725+0000 7f7b55cc9640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 0x7f7b3c0b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005fd0 tx=0x7f7b4c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:42.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.728+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b400ce5c0 con 0x7f7b50077380 2024-09-21T03:44:42.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.943+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7b501ad6c0 con 0x7f7b50077380 2024-09-21T03:44:42.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.945+0000 7f7b46ffd640 1 -- 172.21.15.102:0/3549603910 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f7b400d29a0 con 0x7f7b50077380 2024-09-21T03:44:42.948 INFO:teuthology.orchestra.run.smithi102.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T03:44:42.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 msgr2=0x7f7b3c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:42.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 0x7f7b3c0b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c005fd0 tx=0x7f7b4c005850 comp rx=0 tx=0).stop 2024-09-21T03:44:42.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 msgr2=0x7f7b501a10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7b40005940 tx=0x7f7b400042f0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 shutdown_connections 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7f7b3c0b6700 0x7f7b3c0b8c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b50077380 0x7f7b501a10a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7f7b50114430 0x7f7b501a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 --2- 172.21.15.102:0/3549603910 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b50075dd0 0x7f7b501a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 >> 172.21.15.102:0/3549603910 conn(0x7f7b5007b850 msgr2=0x7f7b50113040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 shutdown_connections 2024-09-21T03:44:42.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:42.948+0000 7f7b57f2d640 1 -- 172.21.15.102:0/3549603910 wait complete. 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a[31388]: 2024-09-21T03:44:42.943+0000 7fd1af4f2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: pgmap v668: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:44:43.172 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:43 smithi102 ceph-mon[31392]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mds[63449]: -- 172.21.15.121:0/28308395 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559de45df860 con 0x559de8787600 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: starting mds.h at 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: pgmap v668: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:44:43.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mon[34316]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mds[63714]: -- 172.21.15.121:0/3793911798 <== mon.0 v2:172.21.15.102:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559626a2fc20 con 0x55962abd7a80 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: starting mds.b at 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.287 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-mds[63168]: -- 172.21.15.121:0/3833302790 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559ab8a75860 con 0x559abcc1d180 2024-09-21T03:44:43.288 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:44:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: starting mds.e at 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: pgmap v668: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3549603910' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T03:44:43.494 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mon[34651]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T03:44:43.495 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.495 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.495 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mds[63505]: -- 172.21.15.148:0/2473915126 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581aef5b860 con 0x5581b3103180 2024-09-21T03:44:43.495 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: starting mds.f at 2024-09-21T03:44:43.495 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mds[63772]: -- 172.21.15.148:0/2923316433 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590e7817860 con 0x5590eb9bf180 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: starting mds.c at 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: ignoring --setuser ceph since I am not root 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: ignoring --setgroup ceph since I am not root 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-mds[64051]: -- 172.21.15.148:0/2476648710 <== mon.1 v2:172.21.15.148:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561981d41860 con 0x561985ee9180 2024-09-21T03:44:43.496 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:44:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: starting mds.i at 2024-09-21T03:44:43.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T03:44:44.186 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 -- 172.21.15.102:0/1388708600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108420 msgr2=0x7feeb0108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 --2- 172.21.15.102:0/1388708600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108420 0x7feeb0108830 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fee98009900 tx=0x7fee9802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 -- 172.21.15.102:0/1388708600 shutdown_connections 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 --2- 172.21.15.102:0/1388708600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108420 0x7feeb0108830 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 --2- 172.21.15.102:0/1388708600 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108d70 0x7feeb010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 --2- 172.21.15.102:0/1388708600 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 0x7feeb0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 -- 172.21.15.102:0/1388708600 >> 172.21.15.102:0/1388708600 conn(0x7feeb0079770 msgr2=0x7feeb0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 -- 172.21.15.102:0/1388708600 shutdown_connections 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.661+0000 7feeb60bf640 1 -- 172.21.15.102:0/1388708600 wait complete. 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 Processor -- start 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 -- start start 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 0x7feeb019b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 0x7feeb019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0112b50 con 0x7feeb0108d70 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01129d0 con 0x7feeb0108420 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.662+0000 7feeb60bf640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0112cd0 con 0x7feeb0102ae0 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44708/0 (socket says 172.21.15.102:44708) 2024-09-21T03:44:44.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 -- 172.21.15.102:0/3853056899 learned_addr learned my addr 172.21.15.102:0/3853056899 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaf7fe640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 0x7feeb019b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaeffd640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 0x7feeb019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 -- 172.21.15.102:0/3853056899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 msgr2=0x7feeb019b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 0x7feeb019b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 -- 172.21.15.102:0/3853056899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 msgr2=0x7feeb019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 0x7feeb019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 -- 172.21.15.102:0/3853056899 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb01a6600 con 0x7feeb0108d70 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaeffd640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 0x7feeb019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeaffff640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7feea800eb10 tx=0x7feea800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8004b20 con 0x7feeb0108d70 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7feea8004cc0 con 0x7feeb0108d70 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea8010720 con 0x7feeb0108d70 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.663+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb01a68f0 con 0x7feeb0108d70 2024-09-21T03:44:44.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.664+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb01a6e30 con 0x7feeb0108d70 2024-09-21T03:44:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.664+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb0103d60 con 0x7feeb0108d70 2024-09-21T03:44:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.666+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7feea80108c0 con 0x7feeb0108d70 2024-09-21T03:44:44.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.667+0000 7feeacff9640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 0x7fee9c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:44.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.667+0000 7feeaf7fe640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 0x7fee9c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:44.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.667+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8800+0+0 (secure 0 0 0) 0x7feea80e8070 con 0x7feeb0108d70 2024-09-21T03:44:44.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.667+0000 7feeaf7fe640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 0x7fee9c0b8c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feea0005e10 tx=0x7feea0005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:44.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.670+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feea8056710 con 0x7feeb0108d70 2024-09-21T03:44:44.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.883+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7feeb002e640 con 0x7feeb0108d70 2024-09-21T03:44:44.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.953+0000 7feeacff9640 1 -- 172.21.15.102:0/3853056899 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v38) ==== 104+0+0 (secure 0 0 0) 0x7feea80ae4b0 con 0x7feeb0108d70 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 msgr2=0x7fee9c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 0x7fee9c0b8c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7feea0005e10 tx=0x7feea0005da0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 msgr2=0x7feeb019be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7feea800eb10 tx=0x7feea800c2d0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 shutdown_connections 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fee9c0b6730 0x7fee9c0b8c40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feeb0108d70 0x7feeb019be80 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7feeb0108420 0x7feeb019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 --2- 172.21.15.102:0/3853056899 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7feeb0102ae0 0x7feeb019b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 >> 172.21.15.102:0/3853056899 conn(0x7feeb0079770 msgr2=0x7feeb0106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 shutdown_connections 2024-09-21T03:44:44.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:44.955+0000 7feeb60bf640 1 -- 172.21.15.102:0/3853056899 wait complete. 2024-09-21T03:44:45.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6835/2366376831,v1:172.21.15.121:6838/2366376831] up:boot 2024-09-21T03:44:45.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6834/1330118392,v1:172.21.15.121:6837/1330118392] up:boot 2024-09-21T03:44:45.203 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.121:6836/2615829578,v1:172.21.15.121:6839/2615829578] up:boot 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6834/3557361977,v1:172.21.15.148:6835/3557361977] up:boot 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6836/1186995136,v1:172.21.15.148:6837/1186995136] up:boot 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: mds.? [v2:172.21.15.148:6838/1991598216,v1:172.21.15.148:6839/1991598216] up:boot 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:44:45.204 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:44:45.205 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: pgmap v670: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T03:44:45.205 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:44 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:44:45.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6835/2366376831,v1:172.21.15.121:6838/2366376831] up:boot 2024-09-21T03:44:45.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6834/1330118392,v1:172.21.15.121:6837/1330118392] up:boot 2024-09-21T03:44:45.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.121:6836/2615829578,v1:172.21.15.121:6839/2615829578] up:boot 2024-09-21T03:44:45.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6834/3557361977,v1:172.21.15.148:6835/3557361977] up:boot 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6836/1186995136,v1:172.21.15.148:6837/1186995136] up:boot 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: mds.? [v2:172.21.15.148:6838/1991598216,v1:172.21.15.148:6839/1991598216] up:boot 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: pgmap v670: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T03:44:45.245 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:44 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6835/2366376831,v1:172.21.15.121:6838/2366376831] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6834/1330118392,v1:172.21.15.121:6837/1330118392] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.121:6836/2615829578,v1:172.21.15.121:6839/2615829578] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6834/3557361977,v1:172.21.15.148:6835/3557361977] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6836/1186995136,v1:172.21.15.148:6837/1186995136] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: mds.? [v2:172.21.15.148:6838/1991598216,v1:172.21.15.148:6839/1991598216] up:boot 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:44:45.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:44:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:44:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='mgr.14223 172.21.15.102:0/3793177351' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:44:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: pgmap v670: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 7 op/s 2024-09-21T03:44:45.287 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:44 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:44:45.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T03:44:45.987 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:46.106 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:45 smithi102 ceph-mon[31392]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:44:46.107 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:45 smithi102 ceph-mon[31392]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:44:46.107 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:45 smithi102 ceph-mon[31392]: Cluster is now healthy 2024-09-21T03:44:46.107 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:45 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:44:46.107 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:45 smithi102 ceph-mon[31392]: fsmap 12 up:standby 2024-09-21T03:44:46.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:45 smithi148 ceph-mon[34651]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:44:46.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:45 smithi148 ceph-mon[34651]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:44:46.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:45 smithi148 ceph-mon[34651]: Cluster is now healthy 2024-09-21T03:44:46.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:45 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:44:46.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:45 smithi148 ceph-mon[34651]: fsmap 12 up:standby 2024-09-21T03:44:46.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:45 smithi121 ceph-mon[34316]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T03:44:46.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:45 smithi121 ceph-mon[34316]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T03:44:46.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:45 smithi121 ceph-mon[34316]: Cluster is now healthy 2024-09-21T03:44:46.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:45 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3853056899' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:44:46.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:45 smithi121 ceph-mon[34316]: fsmap 12 up:standby 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.608+0000 7fe974bbb640 1 -- 172.21.15.102:0/3206472222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970105290 msgr2=0x7fe97010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.608+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3206472222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970105290 0x7fe97010d8d0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe958009900 tx=0x7fe95802a410 comp rx=0 tx=0).stop 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 -- 172.21.15.102:0/3206472222 shutdown_connections 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3206472222 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970105290 0x7fe97010d8d0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3206472222 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe970110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3206472222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970104860 0x7fe970104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 -- 172.21.15.102:0/3206472222 >> 172.21.15.102:0/3206472222 conn(0x7fe970079740 msgr2=0x7fe970079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 -- 172.21.15.102:0/3206472222 shutdown_connections 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 -- 172.21.15.102:0/3206472222 wait complete. 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 Processor -- start 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.609+0000 7fe974bbb640 1 -- start start 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970105290 0x7fe97019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe97019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe970113bb0 con 0x7fe970104860 2024-09-21T03:44:46.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe970113a30 con 0x7fe970105290 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe974bbb640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7fe970113d30 con 0x7fe97010de10 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44728/0 (socket says 172.21.15.102:44728) 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 -- 172.21.15.102:0/3989339338 learned_addr learned my addr 172.21.15.102:0/3989339338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96dd9b640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970105290 0x7fe97019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96ed9d640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe97019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 -- 172.21.15.102:0/3989339338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 msgr2=0x7fe97019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe97019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 -- 172.21.15.102:0/3989339338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970105290 msgr2=0x7fe97019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970105290 0x7fe97019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 -- 172.21.15.102:0/3989339338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9701a04d0 con 0x7fe970104860 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96ed9d640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe97019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.610+0000 7fe96e59c640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe96000d770 tx=0x7fe96000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:46.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.611+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960017070 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.611+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9701a07c0 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.611+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7fe960009c30 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.611+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960003d70 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.611+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9701a6f20 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.612+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe97006c1e0 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.613+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7fe960003f10 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.614+0000 7fe9677fe640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 0x7fe95c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.614+0000 7fe96dd9b640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 0x7fe95c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.614+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8800+0+0 (secure 0 0 0) 0x7fe9600e75f0 con 0x7fe970104860 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.615+0000 7fe96dd9b640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 0x7fe95c0b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe958005940 tx=0x7fe9580058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:46.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.617+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe9600ada30 con 0x7fe970104860 2024-09-21T03:44:46.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.795+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe9701a71c0 con 0x7fe970104860 2024-09-21T03:44:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.960+0000 7fe9677fe640 1 -- 172.21.15.102:0/3989339338 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7fe960009de0 con 0x7fe970104860 2024-09-21T03:44:46.962 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_metadata' removed 2024-09-21T03:44:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 msgr2=0x7fe95c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 0x7fe95c0b8b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe958005940 tx=0x7fe9580058d0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 msgr2=0x7fe97019a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:46.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe96000d770 tx=0x7fe96000dc30 comp rx=0 tx=0).stop 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 shutdown_connections 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7fe95c0b6680 0x7fe95c0b8b90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7fe97010de10 0x7fe97019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe970105290 0x7fe97019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 --2- 172.21.15.102:0/3989339338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe970104860 0x7fe97019a560 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.963+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 >> 172.21.15.102:0/3989339338 conn(0x7fe970079740 msgr2=0x7fe9701007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:46.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.964+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 shutdown_connections 2024-09-21T03:44:46.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:46.964+0000 7fe974bbb640 1 -- 172.21.15.102:0/3989339338 wait complete. 2024-09-21T03:44:47.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:46 smithi148 ceph-mon[34651]: pgmap v671: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-21T03:44:47.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:46 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:47.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:46 smithi121 ceph-mon[34316]: pgmap v671: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-21T03:44:47.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:46 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:47.339 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:46 smithi102 ceph-mon[31392]: pgmap v671: 97 pgs: 97 active+clean; 156 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 921 B/s wr, 6 op/s 2024-09-21T03:44:47.339 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:46 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:47.733 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T03:44:47.980 INFO:teuthology.orchestra.run.smithi102.stderr:Inferring config /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:44:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:47 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:48.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:47 smithi148 ceph-mon[34651]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T03:44:48.277 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:47 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:48.277 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:47 smithi102 ceph-mon[31392]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T03:44:48.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:47 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3989339338' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:48.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:47 smithi121 ceph-mon[34316]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T03:44:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 -- 172.21.15.102:0/649725952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58109e40 msgr2=0x7ffa58110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/649725952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58109e40 0x7ffa58110670 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009ca0 tx=0x7ffa5002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 -- 172.21.15.102:0/649725952 shutdown_connections 2024-09-21T03:44:48.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/649725952 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58109e40 0x7ffa58110670 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/649725952 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa581094f0 0x7ffa58109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/649725952 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa58103bb0 0x7ffa58103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 -- 172.21.15.102:0/649725952 >> 172.21.15.102:0/649725952 conn(0x7ffa580ff600 msgr2=0x7ffa58101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 -- 172.21.15.102:0/649725952 shutdown_connections 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 -- 172.21.15.102:0/649725952 wait complete. 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.519+0000 7ffa5dd69640 1 Processor -- start 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 -- start start 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 0x7ffa5819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 --2- >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa58109e40 0x7ffa5819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113c40 con 0x7ffa58103bb0 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113ac0 con 0x7ffa581094f0 2024-09-21T03:44:48.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa5dd69640 1 -- --> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113dc0 con 0x7ffa58109e40 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:44738/0 (socket says 172.21.15.102:44738) 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 -- 172.21.15.102:0/3792032566 learned_addr learned my addr 172.21.15.102:0/3792032566 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa57fff640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa58109e40 0x7ffa5819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa56ffd640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 0x7ffa5819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 -- 172.21.15.102:0/3792032566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa58109e40 msgr2=0x7ffa5819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa58109e40 0x7ffa5819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 -- 172.21.15.102:0/3792032566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 msgr2=0x7ffa5819aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 0x7ffa5819aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa577fe640 1 -- 172.21.15.102:0/3792032566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581a04c0 con 0x7ffa58103bb0 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.520+0000 7ffa56ffd640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 0x7ffa5819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa577fe640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c890 tx=0x7ffa4800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:48.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48004220 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(27 keys) ==== 1135+0+0 (secure 0 0 0) 0x7ffa480043c0 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa581a07b0 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa480049c0 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.521+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa580755f0 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.522+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa58103fc0 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.523+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 24) ==== 154644+0+0 (secure 0 0 0) 0x7ffa48005140 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.524+0000 7ffa54ff9640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 0x7ffa400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.524+0000 7ffa56ffd640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 0x7ffa400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.524+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8159+0+0 (secure 0 0 0) 0x7ffa480e7280 con 0x7ffa58103bb0 2024-09-21T03:44:48.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.524+0000 7ffa56ffd640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 0x7ffa400b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c005fd0 tx=0x7ffa4c005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:44:48.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.528+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa48014030 con 0x7ffa58103bb0 2024-09-21T03:44:48.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.709+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa5819b680 con 0x7ffa58103bb0 2024-09-21T03:44:48.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.967+0000 7ffa54ff9640 1 -- 172.21.15.102:0/3792032566 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7ffa480ad990 con 0x7ffa58103bb0 2024-09-21T03:44:48.969 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'cephfs_data' removed 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.970+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 msgr2=0x7ffa400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.970+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 0x7ffa400b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c005fd0 tx=0x7ffa4c005ea0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.970+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 msgr2=0x7ffa5819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.970+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800c890 tx=0x7ffa4800cd50 comp rx=0 tx=0).stop 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 shutdown_connections 2024-09-21T03:44:48.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:6800/1995339284,v1:172.21.15.102:6801/1995339284] conn(0x7ffa400b6680 0x7ffa400b8b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] conn(0x7ffa58109e40 0x7ffa5819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa581094f0 0x7ffa5819aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 --2- 172.21.15.102:0/3792032566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa58103bb0 0x7ffa5819a550 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 >> 172.21.15.102:0/3792032566 conn(0x7ffa580ff600 msgr2=0x7ffa58108b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 shutdown_connections 2024-09-21T03:44:48.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-21T03:44:48.971+0000 7ffa5dd69640 1 -- 172.21.15.102:0/3792032566 wait complete. 2024-09-21T03:44:49.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:48 smithi148 ceph-mon[34651]: pgmap v673: 65 pgs: 65 active+clean; 577 KiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:44:49.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:48 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:49.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:48 smithi121 ceph-mon[34316]: pgmap v673: 65 pgs: 65 active+clean; 577 KiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:44:49.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:48 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:49.290 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:48 smithi102 ceph-mon[31392]: pgmap v673: 65 pgs: 65 active+clean; 577 KiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:44:49.291 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:48 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T03:44:49.694 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:44:49.721 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:44:49.753 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:44:49.784 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T03:44:49.784 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:44:49.800 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:44:49.817 DEBUG:teuthology.orchestra.run.smithi148:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:44:49.841 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T03:44:49.841 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T03:44:49.841 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:44:49.953 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:49 smithi102 systemd[1]: Stopping Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:50.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:49 smithi121 ceph-mon[34316]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:50.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:49 smithi121 ceph-mon[34316]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T03:44:50.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:49 smithi148 ceph-mon[34651]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:50.244 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:49 smithi148 ceph-mon[34651]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T03:44:50.356 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:49 smithi102 ceph-mon[31392]: from='client.? 172.21.15.102:0/3792032566' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T03:44:50.356 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:49 smithi102 ceph-mon[31392]: osdmap e94: 12 total, 12 up, 12 in 2024-09-21T03:44:50.356 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a[31388]: 2024-09-21T03:44:50.159+0000 7fd1b4cfd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:50.356 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a[31388]: 2024-09-21T03:44:50.159+0000 7fd1b4cfd640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T03:44:50.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 podman[108452]: 2024-09-21 03:44:50.35456094 +0000 UTC m=+0.327698606 container stop 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:44:50.703 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 podman[108452]: 2024-09-21 03:44:50.380325874 +0000 UTC m=+0.353463585 container died 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T03:44:51.039 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 podman[108452]: 2024-09-21 03:44:50.827745585 +0000 UTC m=+0.800883251 container cleanup 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:44:51.039 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:50 smithi102 bash[108452]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:44:51.265 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T03:44:51.290 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:51 smithi102 podman[108463]: 2024-09-21 03:44:51.037591953 +0000 UTC m=+0.675708804 container remove 99eda1481348e61abafbc689d6b0d134e7ba51142c554adce9b6fdf191ecf574 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:44:51.290 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:51 smithi102 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T03:44:51.290 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:51 smithi102 systemd[1]: Stopped Ceph mon.a for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:44:51.290 INFO:journalctl@ceph.mon.a.smithi102.stdout:Sep 21 03:44:51 smithi102 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.a.service: Consumed 20.694s CPU time. 2024-09-21T03:44:51.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:51.323 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T03:44:51.324 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T03:44:51.324 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.b 2024-09-21T03:44:51.646 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:51 smithi121 systemd[1]: Stopping Ceph mon.b for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:52.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-b[34312]: 2024-09-21T03:44:51.643+0000 7f5cd8bf2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:52.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-b[34312]: 2024-09-21T03:44:51.643+0000 7f5cd8bf2640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:44:52.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:51 smithi121 podman[67100]: 2024-09-21 03:44:51.745188325 +0000 UTC m=+0.222276805 container died f2839885bf23c7ba34cfcacbc1dfdefba1ef19999f823b661ed4b15e2019b97e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:44:52.363 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:52 smithi121 podman[67100]: 2024-09-21 03:44:52.16000072 +0000 UTC m=+0.637089210 container cleanup f2839885bf23c7ba34cfcacbc1dfdefba1ef19999f823b661ed4b15e2019b97e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T03:44:52.405 INFO:journalctl@ceph.mon.b.smithi121.stdout:Sep 21 03:44:52 smithi121 bash[67100]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-b 2024-09-21T03:44:52.577 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T03:44:52.618 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:52.618 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T03:44:52.618 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T03:44:52.619 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.c 2024-09-21T03:44:52.946 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:52 smithi148 systemd[1]: Stopping Ceph mon.c for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:53.214 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c[34647]: 2024-09-21T03:44:53.057+0000 7f4679316640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:53.214 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c[34647]: 2024-09-21T03:44:53.057+0000 7f4679316640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T03:44:53.214 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 podman[67305]: 2024-09-21 03:44:53.099916653 +0000 UTC m=+0.276411179 container died 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:44:53.989 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 podman[67305]: 2024-09-21 03:44:53.500698165 +0000 UTC m=+0.677192690 container cleanup 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T03:44:53.989 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 bash[67305]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c 2024-09-21T03:44:53.989 INFO:journalctl@ceph.mon.c.smithi148.stdout:Sep 21 03:44:53 smithi148 podman[67318]: 2024-09-21 03:44:53.735990579 +0000 UTC m=+0.639484480 container remove 851b4c797c3012d777af640485066c632ab922508f068a46884aefc26c7170d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T03:44:54.004 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T03:44:54.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:54.047 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T03:44:54.048 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T03:44:54.048 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:44:54.368 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 systemd[1]: Stopping Ceph mgr.x for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:54.703 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:44:54.365+0000 7fc089e48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:54.703 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x[31621]: 2024-09-21T03:44:54.365+0000 7fc089e48640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T03:44:54.703 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 podman[108569]: 2024-09-21 03:44:54.406732886 +0000 UTC m=+0.163082601 container died 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:44:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 podman[108569]: 2024-09-21 03:44:54.992373114 +0000 UTC m=+0.748722857 container cleanup 89d0b031c55441cd6460035e00850ac2a6fcf0ca6c2b35ef32003ed41b7f6cc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T03:44:55.203 INFO:journalctl@ceph.mgr.x.smithi102.stdout:Sep 21 03:44:54 smithi102 bash[108569]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-x 2024-09-21T03:44:55.375 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T03:44:55.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:55.409 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T03:44:55.409 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T03:44:55.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.y 2024-09-21T03:44:55.754 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:55 smithi121 systemd[1]: Stopping Ceph mgr.y for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:56.036 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:55 smithi121 podman[67237]: 2024-09-21 03:44:55.752510716 +0000 UTC m=+0.155782674 container died d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:44:56.536 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:56 smithi121 podman[67237]: 2024-09-21 03:44:56.132175462 +0000 UTC m=+0.535447422 container cleanup d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T03:44:56.536 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:56 smithi121 bash[67237]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y 2024-09-21T03:44:56.536 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:56 smithi121 podman[67249]: 2024-09-21 03:44:56.342190865 +0000 UTC m=+0.580873859 container remove d8e4d65a5d71a0fa982b4d3cda1018931f42367cd779a9bc9403e7a01c191294 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-y, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:44:56.537 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Sep 21 03:44:56 smithi121 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T03:44:56.567 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T03:44:56.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:56.603 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T03:44:56.603 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T03:44:56.603 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.z 2024-09-21T03:44:56.970 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:56 smithi148 systemd[1]: Stopping Ceph mgr.z for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:57.244 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:56 smithi148 podman[67436]: 2024-09-21 03:44:56.968175309 +0000 UTC m=+0.166870940 container died 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T03:44:57.631 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:57 smithi148 podman[67436]: 2024-09-21 03:44:57.272519648 +0000 UTC m=+0.471215279 container cleanup 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:44:57.634 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:57 smithi148 bash[67436]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z 2024-09-21T03:44:57.634 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:57 smithi148 podman[67450]: 2024-09-21 03:44:57.507783484 +0000 UTC m=+0.534198655 container remove 42928696b39589696185a22991bd90c75f0fdca47b00c808731b9f24e820bde7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mgr-z, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:44:57.634 INFO:journalctl@ceph.mgr.z.smithi148.stdout:Sep 21 03:44:57 smithi148 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T03:44:57.654 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T03:44:57.694 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:44:57.694 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T03:44:57.694 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T03:44:57.695 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.0 2024-09-21T03:44:58.008 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:44:57 smithi102 systemd[1]: Stopping Ceph osd.0 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:44:58.453 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:44:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:44:58.005+0000 7f0f99d02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:44:58.453 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:44:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:44:58.005+0000 7f0f99d02640 -1 osd.0 94 *** Got signal Terminated *** 2024-09-21T03:44:58.453 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:44:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0[48878]: 2024-09-21T03:44:58.005+0000 7f0f99d02640 -1 osd.0 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:03.703 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:03 smithi102 podman[108689]: 2024-09-21 03:45:03.423899658 +0000 UTC m=+5.544591666 container died 280aae514856e4fefc912ba96f63464eaa2a1cf3781c1027650d85b85c2f48be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:45:04.101 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:03 smithi102 podman[108689]: 2024-09-21 03:45:03.847953146 +0000 UTC m=+5.968645146 container cleanup 280aae514856e4fefc912ba96f63464eaa2a1cf3781c1027650d85b85c2f48be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:45:04.101 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:03 smithi102 bash[108689]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0 2024-09-21T03:45:04.453 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108704]: 2024-09-21 03:45:04.099308659 +0000 UTC m=+0.673926576 container remove 280aae514856e4fefc912ba96f63464eaa2a1cf3781c1027650d85b85c2f48be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T03:45:04.763 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.416706968 +0000 UTC m=+0.015692042 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:04.763 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.525614338 +0000 UTC m=+0.124599411 container create 8c99eee6d2b415b48465eafaab611dcf1787128c3ea05d87b4a6d4abb3182b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:04.763 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.761570828 +0000 UTC m=+0.360555898 container init 8c99eee6d2b415b48465eafaab611dcf1787128c3ea05d87b4a6d4abb3182b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T03:45:05.203 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.7651719 +0000 UTC m=+0.364156971 container start 8c99eee6d2b415b48465eafaab611dcf1787128c3ea05d87b4a6d4abb3182b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:45:05.203 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.861742697 +0000 UTC m=+0.460727773 container attach 8c99eee6d2b415b48465eafaab611dcf1787128c3ea05d87b4a6d4abb3182b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:45:05.203 INFO:journalctl@ceph.osd.0.smithi102.stdout:Sep 21 03:45:04 smithi102 podman[108792]: 2024-09-21 03:45:04.953607278 +0000 UTC m=+0.552592358 container died 8c99eee6d2b415b48465eafaab611dcf1787128c3ea05d87b4a6d4abb3182b48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:45:05.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T03:45:05.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:05.705 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T03:45:05.705 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T03:45:05.705 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1 2024-09-21T03:45:06.005 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:05 smithi121 systemd[1]: Stopping Ceph osd.1 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:06.286 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:45:06.002+0000 7f518d76f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:06.286 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:45:06.002+0000 7f518d76f640 -1 osd.1 94 *** Got signal Terminated *** 2024-09-21T03:45:06.286 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1[42079]: 2024-09-21T03:45:06.002+0000 7f518d76f640 -1 osd.1 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:11.786 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:11 smithi121 podman[67361]: 2024-09-21 03:45:11.514535048 +0000 UTC m=+5.616936915 container died e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:45:12.163 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:11 smithi121 podman[67361]: 2024-09-21 03:45:11.910961717 +0000 UTC m=+6.013363586 container cleanup e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:12.164 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:11 smithi121 bash[67361]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1 2024-09-21T03:45:12.480 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67376]: 2024-09-21 03:45:12.16241986 +0000 UTC m=+0.650806348 container remove e1b7d23aac368042959dc8c0982688691ef061b1977ddd4296ebb65b95996cf5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:45:12.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.381786765 +0000 UTC m=+0.015690400 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:12.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.505025353 +0000 UTC m=+0.138928986 container create 090a7c7cf1efae31a0c9a178c49e872ae489d754b68a060c30957ab762798687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T03:45:12.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.749568332 +0000 UTC m=+0.383471965 container init 090a7c7cf1efae31a0c9a178c49e872ae489d754b68a060c30957ab762798687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T03:45:13.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.753129992 +0000 UTC m=+0.387033622 container start 090a7c7cf1efae31a0c9a178c49e872ae489d754b68a060c30957ab762798687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T03:45:13.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.857925143 +0000 UTC m=+0.491828802 container attach 090a7c7cf1efae31a0c9a178c49e872ae489d754b68a060c30957ab762798687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T03:45:13.036 INFO:journalctl@ceph.osd.1.smithi121.stdout:Sep 21 03:45:12 smithi121 podman[67459]: 2024-09-21 03:45:12.952128619 +0000 UTC m=+0.586032259 container died 090a7c7cf1efae31a0c9a178c49e872ae489d754b68a060c30957ab762798687 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T03:45:13.568 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T03:45:13.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:13.608 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T03:45:13.608 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T03:45:13.608 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.2 2024-09-21T03:45:13.921 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:13 smithi148 systemd[1]: Stopping Ceph osd.2 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:14.244 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:45:13.919+0000 7f1f8e331640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:14.244 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:45:13.919+0000 7f1f8e331640 -1 osd.2 94 *** Got signal Terminated *** 2024-09-21T03:45:14.244 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2[39810]: 2024-09-21T03:45:13.919+0000 7f1f8e331640 -1 osd.2 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:19.674 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:19 smithi148 podman[67561]: 2024-09-21 03:45:19.330951158 +0000 UTC m=+5.524566719 container died f16a4a48ee9629e28a35e5bd2546b015c0730137476a52ed7bcd588992edc4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T03:45:19.963 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:19 smithi148 podman[67561]: 2024-09-21 03:45:19.760604961 +0000 UTC m=+5.954220516 container cleanup f16a4a48ee9629e28a35e5bd2546b015c0730137476a52ed7bcd588992edc4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:19.964 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:19 smithi148 bash[67561]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2 2024-09-21T03:45:20.244 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:19 smithi148 podman[67578]: 2024-09-21 03:45:19.962366148 +0000 UTC m=+0.631066413 container remove f16a4a48ee9629e28a35e5bd2546b015c0730137476a52ed7bcd588992edc4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T03:45:20.659 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.28179344 +0000 UTC m=+0.016106657 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:20.659 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.404851222 +0000 UTC m=+0.139164573 container create 1176938345f644ff0f8f6fa1086ebfe5f33f163b4a999d84d23e8583ad08e97a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:45:20.659 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.65771431 +0000 UTC m=+0.392027513 container init 1176938345f644ff0f8f6fa1086ebfe5f33f163b4a999d84d23e8583ad08e97a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:45:20.994 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.661140006 +0000 UTC m=+0.395453213 container start 1176938345f644ff0f8f6fa1086ebfe5f33f163b4a999d84d23e8583ad08e97a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:45:20.994 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.732848884 +0000 UTC m=+0.467162103 container attach 1176938345f644ff0f8f6fa1086ebfe5f33f163b4a999d84d23e8583ad08e97a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T03:45:20.994 INFO:journalctl@ceph.osd.2.smithi148.stdout:Sep 21 03:45:20 smithi148 podman[67663]: 2024-09-21 03:45:20.850062658 +0000 UTC m=+0.584375879 container died 1176938345f644ff0f8f6fa1086ebfe5f33f163b4a999d84d23e8583ad08e97a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:45:21.457 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T03:45:21.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:21.496 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T03:45:21.496 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T03:45:21.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.3 2024-09-21T03:45:21.804 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:21 smithi102 systemd[1]: Stopping Ceph osd.3 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:22.203 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:21 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:45:21.801+0000 7fb28221b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:22.203 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:21 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:45:21.801+0000 7fb28221b640 -1 osd.3 94 *** Got signal Terminated *** 2024-09-21T03:45:22.203 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:21 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3[55412]: 2024-09-21T03:45:21.801+0000 7fb28221b640 -1 osd.3 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:24.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:24.158+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:24.536 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:24 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:24.271+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:24.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:24 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:24.439+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:25.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:24 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:24.935+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:25.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:25.164+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:25.535 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:25 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:25.280+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:25.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:25 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:25.458+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:26.453 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:25 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:25.951+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:26.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:26.185+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:26.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:26 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:26.325+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:26.911 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:26 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:26.451+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:26.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:26.652+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:27.179 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:26 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:26.908+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:27.454 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:27 smithi102 podman[108895]: 2024-09-21 03:45:27.178273208 +0000 UTC m=+5.490494948 container died 8e330fd000150492a666bc3f9a24e00020f040338674c5d2a6437f67ef4beabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T03:45:27.454 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:27 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:27.422+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:27.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:27.161+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:27.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:27 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:27.337+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:27.882 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:27 smithi102 podman[108895]: 2024-09-21 03:45:27.660225133 +0000 UTC m=+5.972446863 container cleanup 8e330fd000150492a666bc3f9a24e00020f040338674c5d2a6437f67ef4beabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:45:27.883 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:27 smithi102 bash[108895]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3 2024-09-21T03:45:27.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:27.662+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:28.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:27 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:27.880+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:28.203 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:27 smithi102 podman[108911]: 2024-09-21 03:45:27.91186192 +0000 UTC m=+0.734377888 container remove 8e330fd000150492a666bc3f9a24e00020f040338674c5d2a6437f67ef4beabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:45:28.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:28.113+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:28.499 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:28 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:28.407+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:28.500 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.132709591 +0000 UTC m=+0.015551312 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:28.500 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.254448341 +0000 UTC m=+0.137290054 container create 16e4b245ea58ccb46e30bbe28d6d713b798389fe2f26cc35e465bcf0cebcc965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T03:45:28.500 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.498775559 +0000 UTC m=+0.381617282 container init 16e4b245ea58ccb46e30bbe28d6d713b798389fe2f26cc35e465bcf0cebcc965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T03:45:28.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:28 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:28.323+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:28.870 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.50212406 +0000 UTC m=+0.384965782 container start 16e4b245ea58ccb46e30bbe28d6d713b798389fe2f26cc35e465bcf0cebcc965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T03:45:28.871 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.624123426 +0000 UTC m=+0.506965159 container attach 16e4b245ea58ccb46e30bbe28d6d713b798389fe2f26cc35e465bcf0cebcc965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:28.871 INFO:journalctl@ceph.osd.3.smithi102.stdout:Sep 21 03:45:28 smithi102 podman[108999]: 2024-09-21 03:45:28.691477214 +0000 UTC m=+0.574318933 container died 16e4b245ea58ccb46e30bbe28d6d713b798389fe2f26cc35e465bcf0cebcc965 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:45:28.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:28.679+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:29.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:28 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:28.868+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:29.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T03:45:29.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:29.148+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:29.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:29.528 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T03:45:29.528 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T03:45:29.528 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.4 2024-09-21T03:45:29.555 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:29 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:29.289+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:29.854 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:29 smithi121 systemd[1]: Stopping Ceph osd.4 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:29.877 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:29 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:29.453+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:29.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:29.680+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:30.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:29 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:29.875+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:30.286 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:29 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:45:29.851+0000 7fe6d4dff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:30.286 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:29 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:45:29.851+0000 7fe6d4dff640 -1 osd.4 94 *** Got signal Terminated *** 2024-09-21T03:45:30.286 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:29 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:45:29.851+0000 7fe6d4dff640 -1 osd.4 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:30.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:30 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:30.111+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:30.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:30 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:30.406+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:30.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:30 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:30.299+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:30.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:30 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:30.667+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:31.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:30 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:30.857+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:31.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:31 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:31.109+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:31.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:31 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:31.415+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:31.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:31 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:31.345+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:31.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:31 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:31.642+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:31.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:31 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:31.642+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:32.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:31 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:31.815+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:32.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:32 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:32.079+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:32.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:32 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:32.385+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:32.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:32 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:32.372+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:32.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:32 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:32.500+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:32.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:32 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:32.594+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:32.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:32 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:32.594+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:33.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:32 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:32.837+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:33.473 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:33 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:33.092+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:33.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:33 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:33.382+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:33.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:33 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:33.470+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:33.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:33 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:33.599+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:33.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:33 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:33.599+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:33.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:33 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:33.334+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:33.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:33 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:33.334+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:34.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:33 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:33.845+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:34.286 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:34 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:34.028+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:34.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:34 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:34.089+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:34.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:34 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:34.089+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:34.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:34 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:34.412+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:34.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:34 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:34.356+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:34.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:34 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:34.356+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:34.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:34 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:34.497+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:34.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:34 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:34.592+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:34.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:34 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:34.592+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:35.072 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:34 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4[45560]: 2024-09-21T03:45:34.806+0000 7fe6d13ea640 -1 osd.4 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.683333+0000 front 2024-09-21T03:45:09.683298+0000 (oldest deadline 2024-09-21T03:45:34.383452+0000) 2024-09-21T03:45:35.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:34 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:34.853+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:35.340 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:35 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:35.070+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:35.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:35.123+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:35.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:35.123+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:35.632 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:35 smithi121 podman[67579]: 2024-09-21 03:45:35.338863991 +0000 UTC m=+5.610797966 container died 9b8acba1013dd6c0e0417803d669cd58f95b2fa52eba1fe063c2b31f875b1f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:35.633 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:35 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:35.382+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:35.633 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:35 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:35.382+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:35.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:35 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:35.406+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:35.932 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:35 smithi121 podman[67579]: 2024-09-21 03:45:35.730017494 +0000 UTC m=+6.001951460 container cleanup 9b8acba1013dd6c0e0417803d669cd58f95b2fa52eba1fe063c2b31f875b1f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:45:35.933 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:35 smithi121 bash[67579]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4 2024-09-21T03:45:35.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:35.536+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:35.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:35.557+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:35.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:35 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:35.557+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:36.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:35 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:35.805+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:36.286 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:35 smithi121 podman[67595]: 2024-09-21 03:45:35.93126736 +0000 UTC m=+0.593681283 container remove 9b8acba1013dd6c0e0417803d669cd58f95b2fa52eba1fe063c2b31f875b1f4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T03:45:36.286 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:36 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:36.067+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:36.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:36 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:36.166+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:36.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:36 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:36.166+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:36.611 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:36 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:36.389+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:36.611 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:36 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:36.389+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:36.611 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.235653434 +0000 UTC m=+0.015586039 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:36.611 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.340503549 +0000 UTC m=+0.120436153 container create 6bc8dcf2b9e68ed9790832e25660c795560169b0d446a00ceb5c7dd842ae0707 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T03:45:36.611 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.60960057 +0000 UTC m=+0.389533174 container init 6bc8dcf2b9e68ed9790832e25660c795560169b0d446a00ceb5c7dd842ae0707 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T03:45:36.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:36 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:36.379+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:36.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:36 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:36.379+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:36.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:36 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:36.529+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:36.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:36 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:36.597+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:36.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:36 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:36.597+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:37.036 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.612864106 +0000 UTC m=+0.392796711 container start 6bc8dcf2b9e68ed9790832e25660c795560169b0d446a00ceb5c7dd842ae0707 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T03:45:37.036 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.718086502 +0000 UTC m=+0.498019121 container attach 6bc8dcf2b9e68ed9790832e25660c795560169b0d446a00ceb5c7dd842ae0707 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T03:45:37.036 INFO:journalctl@ceph.osd.4.smithi121.stdout:Sep 21 03:45:36 smithi121 podman[67683]: 2024-09-21 03:45:36.803359035 +0000 UTC m=+0.583291643 container died 6bc8dcf2b9e68ed9790832e25660c795560169b0d446a00ceb5c7dd842ae0707 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T03:45:37.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:36 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:36.765+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:37.422 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:37 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:37.038+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:37.489 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T03:45:37.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:37.167+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:37.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:37.167+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:37.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:37.575 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T03:45:37.575 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T03:45:37.575 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.5 2024-09-21T03:45:37.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:37.389+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:37.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:37.389+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:37.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:37 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:37.420+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:37.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:37 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:37.420+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:37.891 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 systemd[1]: Stopping Ceph osd.5 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:37.892 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:37.507+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:37.892 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:37.600+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:37.892 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:37.600+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:38.161 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:37.889+0000 7ffa6c05b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:38.161 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:37.889+0000 7ffa6c05b640 -1 osd.5 94 *** Got signal Terminated *** 2024-09-21T03:45:38.162 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:37 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:37.889+0000 7ffa6c05b640 -1 osd.5 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:38.162 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:38 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:38.159+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:38.162 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:38 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:38.159+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:38.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:37.786+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:38.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:37.786+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:38.467 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:38 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:38.038+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:38.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:38 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:38.394+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:38.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:38 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:38.394+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:38.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:38 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:38.465+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:38.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:38 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:38.465+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:38.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:38 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:38.517+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:38.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:38 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:38.616+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:38.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:38 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:38.616+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:39.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:38 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:38.789+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:39.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:38 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:38.789+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:39.475 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:39 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:39.084+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:39.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:39 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:39.123+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:39.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:39 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:39.123+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:39.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:39.385+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:39.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:39.385+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:39.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:39 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:39.473+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:39.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:39 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:39.473+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:39.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:39 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:39.554+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:39.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:39 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:39.618+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:39.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:39 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:39.618+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:40.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:39.829+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:40.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:39 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:39.829+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:40.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:40.083+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:40.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:40.083+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:40.514 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:40 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:40.116+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:40.514 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:40 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:40.116+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:40.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:40 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:40.395+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:40.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:40 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:40.395+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:40.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:40 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:40.512+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:40.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:40 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:40.512+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:40.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:40.560+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:40.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:40.581+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:40.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:40.581+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:40.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:40 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:40.581+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:41.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:40 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:40.787+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:41.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:40 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:40.787+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:41.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:41.050+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:41.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:41.050+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:41.512 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:41 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:41.069+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:41.512 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:41 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:41.069+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:41.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:41.444+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:41.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:41.444+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:41.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:41.444+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:41.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:41 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:41.510+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:41.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:41 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:41.511+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:41.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:41 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:41.511+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:41.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:41.535+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:41.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:41.593+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:41.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:41.593+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:41.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:41 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:41.593+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:42.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:41.785+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:42.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:41.785+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:42.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:41 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:41.785+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:42.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:42.053+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.594686+0000 front 2024-09-21T03:45:00.594764+0000 (oldest deadline 2024-09-21T03:45:23.494755+0000) 2024-09-21T03:45:42.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5[45961]: 2024-09-21T03:45:42.053+0000 7ffa68646640 -1 osd.5 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:08.795833+0000 front 2024-09-21T03:45:08.795957+0000 (oldest deadline 2024-09-21T03:45:33.495782+0000) 2024-09-21T03:45:42.525 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:42 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:42.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:42.525 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:42 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:42.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:42.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:42 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:42.523+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:42.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:42 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:42.523+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:42.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:42 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:42.523+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:42.804 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:42.485+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:42.804 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:42.485+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:42.804 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:42.485+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:42.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:42.560+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:42.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:42.560+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:42.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:42.609+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:42.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:42.609+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:42.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:42 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:42.609+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:43.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:42.802+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:43.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:42.802+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:43.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:42.802+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:43.494 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:43 smithi148 podman[67779]: 2024-09-21 03:45:43.21611501 +0000 UTC m=+5.437149371 container died b9cd6b7cc97ff0d090033893340da168e3dba84d6814e566cecdf673db39cd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T03:45:43.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:43.125+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:43.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:43.125+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:43.837 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:43.531+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:43.838 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:43.531+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:43.838 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:43.531+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:43.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:43.558+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:43.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:43.558+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:43.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:43.577+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:43.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:43.578+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:43.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:43 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:43.578+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:43.995 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:43 smithi148 podman[67779]: 2024-09-21 03:45:43.573079463 +0000 UTC m=+5.794113892 container cleanup b9cd6b7cc97ff0d090033893340da168e3dba84d6814e566cecdf673db39cd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:45:43.995 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:43 smithi148 bash[67779]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5 2024-09-21T03:45:43.995 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:43 smithi148 podman[67795]: 2024-09-21 03:45:43.749202068 +0000 UTC m=+0.532869325 container remove b9cd6b7cc97ff0d090033893340da168e3dba84d6814e566cecdf673db39cd23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:45:44.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:43.560+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:44.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:43.560+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:44.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:43 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:43.560+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:44.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:43.833+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:44.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:43.833+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:44.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:43 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:43.833+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:44.463 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.088570006 +0000 UTC m=+0.016224578 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:44.463 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.200320218 +0000 UTC m=+0.127974789 container create a330e807c1707ed6f19ba6524863dbb579dd47007a4fc2b73d84bb4360f36d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:45:44.463 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.461099381 +0000 UTC m=+0.388753965 container init a330e807c1707ed6f19ba6524863dbb579dd47007a4fc2b73d84bb4360f36d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:44.535 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:44 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:44.165+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:44.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:44 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:44.165+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:44.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:44 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:44.613+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:44.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:44 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:44.613+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:44.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:44 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:44.613+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:44.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:44 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:44.527+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:44.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:44 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:44.527+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:44.745 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.46447934 +0000 UTC m=+0.392133919 container start a330e807c1707ed6f19ba6524863dbb579dd47007a4fc2b73d84bb4360f36d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:45:44.745 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.561359089 +0000 UTC m=+0.489013662 container attach a330e807c1707ed6f19ba6524863dbb579dd47007a4fc2b73d84bb4360f36d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:45:44.745 INFO:journalctl@ceph.osd.5.smithi148.stdout:Sep 21 03:45:44 smithi148 podman[67887]: 2024-09-21 03:45:44.660187134 +0000 UTC m=+0.587841706 container died a330e807c1707ed6f19ba6524863dbb579dd47007a4fc2b73d84bb4360f36d1e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T03:45:44.846 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:44.576+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:44.846 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:44.576+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:44.846 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:44.576+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:45.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:44 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:44.549+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:45.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:44 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:44.549+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:45.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:44 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:44.549+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:45.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:44.844+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:45.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:44.844+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:45.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:44 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:44.844+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:45.293 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T03:45:45.333 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:45.334 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T03:45:45.334 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T03:45:45.334 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.6 2024-09-21T03:45:45.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:45 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:45.204+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:45.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:45 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:45.204+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:45.657 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 systemd[1]: Stopping Ceph osd.6 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:45.658 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.541+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:45.658 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.541+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:45.658 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.541+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:45.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:45.798+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:45.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:45.798+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:45.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:45.798+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:45.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.655+0000 7fe8a620b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:45.954 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.655+0000 7fe8a620b640 -1 osd.6 94 *** Got signal Terminated *** 2024-09-21T03:45:45.954 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:45.655+0000 7fe8a620b640 -1 osd.6 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:45.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:45 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:45.529+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:45.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:45 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:45.529+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:45.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:45 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:45.568+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:45.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:45 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:45.568+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:45.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:45 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:45.568+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:46.035 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:45 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:45.544+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:46.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:45 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:45.544+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:46.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:45 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:45.544+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:46.504 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:46 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:46.171+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:46.504 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:46 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:46.171+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:46.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:46 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:46.502+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:46.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:46 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:46.502+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:46.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:46 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:46.502+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:46.817 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:46.494+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:46.817 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:46.494+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:46.817 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:46.494+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:46.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:46.532+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:46.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:46.532+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:46.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:46.556+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:46.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:46.556+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:46.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:46 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:46.556+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:47.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:46.816+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:47.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:46.816+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:47.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:46 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:46.816+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:47.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:47 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:47.122+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:47.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:47 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:47.122+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:47.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:47.524+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:47.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:47.524+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:47.953 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:47.524+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:47.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:47.771+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:47.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:47.771+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:47.954 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:47 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:47.771+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:47.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:47.552+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:47.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:47.552+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:47.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:47.509+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:47.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:47.509+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:47.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:47.509+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:47.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:47 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:47.509+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:48.035 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:47 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:47.545+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:48.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:47 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:47.545+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:48.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:47 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:47.545+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:48.535 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:48.086+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:48.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:48.086+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:48.475+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:48.475+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:48.475+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:48.475+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:48.549+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:48.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:48 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:48.549+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:48.812 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:48.548+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:48.812 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:48.548+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:48.812 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:48.548+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:49.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:48.538+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:49.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:48.538+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:49.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:48.538+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:49.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:48 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:48.538+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:49.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:48.811+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:49.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:48.811+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:49.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:48.811+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:49.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:48 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:48.811+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:49.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:49.129+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:49.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:49.129+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:49.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:49.533+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:49.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:49.533+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:49.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:49.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:49.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:49.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:49.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:49.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:49.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:49 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:49.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:49.809 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:49.516+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:49.809 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:49.516+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:49.809 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:49.516+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:50.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:49.564+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:50.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:49.564+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:50.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:49.564+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:50.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:49 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:49.564+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:50.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:49.806+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:50.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:49.806+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:50.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:49.806+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:50.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:49 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:49.806+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:50.519 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:50.147+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:50.520 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:50.147+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:50.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:50.517+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:50.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:50.517+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:50.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:50.517+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:50.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:50.442+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:50.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:50.442+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:50.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:50.442+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:50.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:50 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:50.442+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:50.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:50.518+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:50.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:50.518+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:50.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:50.518+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:50.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:50.518+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:50.828 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:50.522+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:02.135212+0000 front 2024-09-21T03:45:02.135192+0000 (oldest deadline 2024-09-21T03:45:24.435353+0000) 2024-09-21T03:45:50.828 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:50.522+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:09.736346+0000 front 2024-09-21T03:45:09.736101+0000 (oldest deadline 2024-09-21T03:45:35.636208+0000) 2024-09-21T03:45:50.828 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6[61969]: 2024-09-21T03:45:50.522+0000 7fe8a27f6640 -1 osd.6 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:15.636948+0000 front 2024-09-21T03:45:15.636881+0000 (oldest deadline 2024-09-21T03:45:41.437356+0000) 2024-09-21T03:45:51.203 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:50 smithi102 podman[109104]: 2024-09-21 03:45:50.997358751 +0000 UTC m=+5.465152611 container died 8257ac31a83bbf3936af19427f729c93ae59d0d8616a173f032c40bb21034e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2) 2024-09-21T03:45:51.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:50.826+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:51.204 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:50.826+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:51.204 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:50.826+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:51.204 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:50 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:50.826+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:51.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:51.110+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:51.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:51.110+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:51.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:51 smithi102 podman[109104]: 2024-09-21 03:45:51.480822978 +0000 UTC m=+5.948616828 container cleanup 8257ac31a83bbf3936af19427f729c93ae59d0d8616a173f032c40bb21034e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T03:45:51.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:51 smithi102 bash[109104]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6 2024-09-21T03:45:51.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:51.479+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:51.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:51.479+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:51.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:51.479+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:51.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:51.427+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:51.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:51.427+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:51.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:51.427+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:51.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:51 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:51.427+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:52.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:51.565+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:52.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:51.565+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:52.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:51.565+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:52.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:51 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:51.565+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:52.042 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:51 smithi102 podman[109120]: 2024-09-21 03:45:51.732212359 +0000 UTC m=+0.732986028 container remove 8257ac31a83bbf3936af19427f729c93ae59d0d8616a173f032c40bb21034e20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T03:45:52.042 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:51 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:51.810+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:52.043 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:51 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:51.810+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:52.043 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:51 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:51.810+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:52.043 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:51 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:51.810+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:52.295 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:52.041375002 +0000 UTC m=+0.106829093 container create dcaf1f0a7916293d3cd5114b54bc54c1a82c48036cab3ec8697e404c0d3e895d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T03:45:52.295 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:51.950495077 +0000 UTC m=+0.015949185 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:45:52.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:52.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:52.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:52.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:52.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:52.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:52.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:52.293689154 +0000 UTC m=+0.359143253 container init dcaf1f0a7916293d3cd5114b54bc54c1a82c48036cab3ec8697e404c0d3e895d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:45:52.703 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:52.296949654 +0000 UTC m=+0.362403748 container start dcaf1f0a7916293d3cd5114b54bc54c1a82c48036cab3ec8697e404c0d3e895d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T03:45:52.704 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:52.377233495 +0000 UTC m=+0.442687605 container attach dcaf1f0a7916293d3cd5114b54bc54c1a82c48036cab3ec8697e404c0d3e895d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:45:52.704 INFO:journalctl@ceph.osd.6.smithi102.stdout:Sep 21 03:45:52 smithi102 podman[109206]: 2024-09-21 03:45:52.486052699 +0000 UTC m=+0.551506803 container died dcaf1f0a7916293d3cd5114b54bc54c1a82c48036cab3ec8697e404c0d3e895d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:52.474+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:52.474+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:52.474+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:52.476+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:52.476+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:52.476+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:52.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:52 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:52.476+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:53.035 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:52.568+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:53.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:52.568+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:53.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:52.568+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:53.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:52 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:52.568+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:53.057 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:52 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:52.842+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:53.058 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:52 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:52.842+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:53.058 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:52 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:52.842+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:53.058 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:52 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:52.842+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:53.079 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T03:45:53.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:45:53.121 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T03:45:53.121 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T03:45:53.122 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.7 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.142+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.142+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.142+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 systemd[1]: Stopping Ceph osd.7 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.432+0000 7fa4eff5f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.432+0000 7fa4eff5f640 -1 osd.7 94 *** Got signal Terminated *** 2024-09-21T03:45:53.434 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:53.432+0000 7fa4eff5f640 -1 osd.7 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:45:53.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:53.438+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:53.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:53.438+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:53.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:53.438+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:53.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:53.487+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:53.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:53.487+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:53.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:53.487+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:53.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:53 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:53.487+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:53.785 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:53.574+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:53.785 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:53.574+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:53.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:53.574+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:53.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:53 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:53.574+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:54.181 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:53 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:53.805+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:54.181 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:53 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:53.805+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:54.181 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:53 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:53.805+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:54.181 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:53 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:53.805+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:54.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:54.151+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:54.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:54.151+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:54.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:54.151+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:54.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:54.462+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:54.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:54.462+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:54.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:54.462+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:54.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:54.512+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:54.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:54.512+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:54.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:54.512+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:54.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:54 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:54.512+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:54.812 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:54.621+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:54.812 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:54.622+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:54.812 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:54.622+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:54.812 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:54 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:54.622+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:55.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:54.791+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:55.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:54.791+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:55.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:54.791+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:55.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:54 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:54.791+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:55.535 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:55.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:55.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:55.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:55.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:55.103+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:55.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:55.466+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:55.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:55.466+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:55.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:55.466+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:55.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:55.538+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:55.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:55.538+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:55.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:55.538+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:55.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:55.538+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:55.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:55 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:55.538+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:45:56.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:55.620+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:56.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:55.620+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:56.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:55.620+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:56.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:55.620+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:56.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:55 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:55.749+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:56.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:55 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:55.749+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:56.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:55 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:55.749+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:56.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:55 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:55.749+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:56.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:56.131+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:56.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:56.131+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:56.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:56.131+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:56.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:56.131+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.259644+0000 front 2024-09-21T03:45:31.259584+0000 (oldest deadline 2024-09-21T03:45:55.959716+0000) 2024-09-21T03:45:56.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:56.444+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:56.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:56.444+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:56.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:56.444+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:56.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:56.508+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:56.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:56.508+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:56.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:56.508+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:56.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:56.508+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:56.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:56 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:56.508+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:45:57.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:56.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:57.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:56.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:57.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:56.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:57.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:56.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:57.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:56 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:56.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:45:57.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:56 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:56.765+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:57.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:56 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:56.765+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:57.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:56 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:56.765+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:57.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:56 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:56.765+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:57.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:57.155+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:57.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:57.155+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:57.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:57.155+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:57.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:57.155+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.259644+0000 front 2024-09-21T03:45:31.259584+0000 (oldest deadline 2024-09-21T03:45:55.959716+0000) 2024-09-21T03:45:57.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:57.417+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:57.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:57.417+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:57.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:57.417+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:57.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:57.545+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:57.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:57.545+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:57.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:57.545+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:57.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:57.545+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:57.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:57 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:57.545+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:45:58.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:57.634+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:58.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:57.634+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:58.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:57.634+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:58.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:57.634+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:58.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:57 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:57.634+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:45:58.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:57 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:57.737+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:58.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:57 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:57.737+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:58.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:57 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:57.737+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:58.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:57 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:57.737+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:58.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:58.199+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:07.757003+0000 front 2024-09-21T03:45:07.757131+0000 (oldest deadline 2024-09-21T03:45:33.557758+0000) 2024-09-21T03:45:58.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:58.199+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:13.558433+0000 front 2024-09-21T03:45:13.558268+0000 (oldest deadline 2024-09-21T03:45:39.458230+0000) 2024-09-21T03:45:58.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:58.199+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:25.359219+0000 front 2024-09-21T03:45:25.359135+0000 (oldest deadline 2024-09-21T03:45:51.259133+0000) 2024-09-21T03:45:58.536 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7[52162]: 2024-09-21T03:45:58.199+0000 7fa4e8542640 -1 osd.7 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.259644+0000 front 2024-09-21T03:45:31.259584+0000 (oldest deadline 2024-09-21T03:45:55.959716+0000) 2024-09-21T03:45:58.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:58.457+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:58.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:58.457+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:58.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:58.457+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:58.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:58.527+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:58.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:58.527+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:58.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:58.527+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:58.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:58.527+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:58.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:58 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:58.527+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:45:59.036 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:58 smithi121 podman[67786]: 2024-09-21 03:45:58.79490602 +0000 UTC m=+5.486055361 container died e3fe6ddaa79b355be3a1918c030aa11f3aef86236f0a23aa4669858373ed95fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:45:59.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:58.640+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:59.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:58.640+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:59.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:58.640+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:59.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:58.640+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:59.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:58 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:58.640+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:45:59.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:58.768+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:45:59.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:58.768+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:45:59.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:58.768+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:45:59.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:58 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:58.768+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:45:59.443 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:59 smithi121 podman[67786]: 2024-09-21 03:45:59.198672991 +0000 UTC m=+5.889822326 container cleanup e3fe6ddaa79b355be3a1918c030aa11f3aef86236f0a23aa4669858373ed95fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T03:45:59.443 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:59 smithi121 bash[67786]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7 2024-09-21T03:45:59.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:59.443+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:45:59.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:59.443+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:45:59.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:59.443+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:45:59.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:45:59.443+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:45:59.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:59.541+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:45:59.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:59.541+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:45:59.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:59.541+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:45:59.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:59.541+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:45:59.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:45:59 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:45:59.541+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:45:59.767 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:59 smithi121 podman[67814]: 2024-09-21 03:45:59.441640621 +0000 UTC m=+0.641957868 container remove e3fe6ddaa79b355be3a1918c030aa11f3aef86236f0a23aa4669858373ed95fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T03:45:59.768 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:59.650+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:45:59.768 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:59.650+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:45:59.768 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:59.650+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:45:59.768 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:59.650+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:45:59.768 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:45:59 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:45:59.650+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:00.036 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:59 smithi121 podman[67901]: 2024-09-21 03:45:59.669120164 +0000 UTC m=+0.015700187 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:00.036 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:45:59 smithi121 podman[67901]: 2024-09-21 03:45:59.767296649 +0000 UTC m=+0.113876664 container create f73fbe115a645a425add90f71efb878515ecfbfb01dca608ed0055145c515168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T03:46:00.036 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:46:00 smithi121 podman[67901]: 2024-09-21 03:46:00.011522297 +0000 UTC m=+0.358102311 container init f73fbe115a645a425add90f71efb878515ecfbfb01dca608ed0055145c515168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:00.036 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:46:00 smithi121 podman[67901]: 2024-09-21 03:46:00.015062764 +0000 UTC m=+0.361642778 container start f73fbe115a645a425add90f71efb878515ecfbfb01dca608ed0055145c515168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T03:46:00.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:59.748+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:00.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:59.748+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:00.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:59.748+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:00.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:45:59 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:45:59.748+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:00.507 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:46:00 smithi121 podman[67901]: 2024-09-21 03:46:00.128468098 +0000 UTC m=+0.475048128 container attach f73fbe115a645a425add90f71efb878515ecfbfb01dca608ed0055145c515168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:00.507 INFO:journalctl@ceph.osd.7.smithi121.stdout:Sep 21 03:46:00 smithi121 podman[67901]: 2024-09-21 03:46:00.206432722 +0000 UTC m=+0.553012736 container died f73fbe115a645a425add90f71efb878515ecfbfb01dca608ed0055145c515168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:46:00.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:00.401+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:00.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:00.401+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:00.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:00.401+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:00.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:00.401+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:00.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:00.497+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:00.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:00.497+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:00.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:00.497+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:00.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:00.497+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:00.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:00 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:00.497+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:00.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:00.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:00.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:00.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:00.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:00.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:00.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:00.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:00.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:00.648+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:00.820 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T03:46:00.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:00.859 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T03:46:00.859 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T03:46:00.859 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.8 2024-09-21T03:46:01.160 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:00 smithi148 systemd[1]: Stopping Ceph osd.8 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:01.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:00.709+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:01.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:00.709+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:01.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:00.709+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:01.203 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:00 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:00.709+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:01.422 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.159+0000 7fe60b3bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:01.422 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.159+0000 7fe60b3bf640 -1 osd.8 94 *** Got signal Terminated *** 2024-09-21T03:46:01.422 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.159+0000 7fe60b3bf640 -1 osd.8 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:46:01.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:01.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:01.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:01.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:01.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:01.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:01.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:01.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:01.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:01.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:01.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.420+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:01.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.420+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:01.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.420+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:01.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:01 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:01.420+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:01.922 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:01 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:01.666+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:01.922 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:01 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:01.666+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:01.922 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:01 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:01.666+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:01.922 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:01 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:01.666+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:01.922 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:01 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:01.666+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:01.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:01 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:01.672+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:01.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:01 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:01.672+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:01.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:01 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:01.672+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:01.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:01 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:01.672+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:01.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:01 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:01.672+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:02.431+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:02.431+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:02.431+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:02.431+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:02.436+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:02.436+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:02.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:02.436+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:02.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:02.436+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:02.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:02 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:02.436+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:02.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:02 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:02.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:02.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:02 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:02.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:02.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:02 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:02.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:02.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:02 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:02.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:02.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:02 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:02.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:03.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:02.709+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:03.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:02.709+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:03.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:02.709+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:03.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:02.709+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:03.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:02 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:02.709+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:03.426+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:03.426+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:03.426+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:03.426+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:03.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:03.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:03.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:03.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:03.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:03.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:03.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:03.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:03 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:03.443+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:03.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:03 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:03.679+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:03.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:03 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:03.679+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:03.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:03 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:03.679+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:03.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:03 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:03.679+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:03.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:03 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:03.679+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:04.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:03 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:03.711+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:04.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:03 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:03.711+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:04.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:03 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:03.711+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:04.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:03 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:03.711+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:04.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:03 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:03.711+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:04.401+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:04.401+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:04.401+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:04.401+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:04.401+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:04.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:04.380+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:04.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:04.380+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:04.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:04.380+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:04.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:04.380+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:04.745 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:04 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:04.380+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.339446+0000 front 2024-09-21T03:45:42.339418+0000 (oldest deadline 2024-09-21T03:46:03.439666+0000) 2024-09-21T03:46:04.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:04.680+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:04.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:04.680+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:04.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:04.680+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:04.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:04.680+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:04.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:04 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:04.680+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:05.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:04.706+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:05.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:04.706+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:05.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:04.706+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:05.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:04.706+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:05.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:04.706+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:05.351+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:05.232300+0000 front 2024-09-21T03:45:05.232326+0000 (oldest deadline 2024-09-21T03:45:32.232944+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:05.351+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.435762+0000 front 2024-09-21T03:45:18.435791+0000 (oldest deadline 2024-09-21T03:45:42.436374+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:05.351+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:22.436867+0000 front 2024-09-21T03:45:22.436960+0000 (oldest deadline 2024-09-21T03:45:50.037248+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:05.351+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:34.138503+0000 front 2024-09-21T03:45:34.138588+0000 (oldest deadline 2024-09-21T03:45:58.838369+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8[52600]: 2024-09-21T03:46:05.351+0000 7fe6079aa640 -1 osd.8 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.339446+0000 front 2024-09-21T03:45:42.339418+0000 (oldest deadline 2024-09-21T03:46:03.439666+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:05.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:05.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:05.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:05.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:05.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:05.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:05.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:05.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:05 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:05.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:05.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:05.646+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:05.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:05.646+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:05.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:05.646+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:05.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:05.646+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:05.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:05 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:05.646+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:06.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:05 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:05.675+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:06 smithi148 podman[67990]: 2024-09-21 03:46:06.469250703 +0000 UTC m=+5.413738203 container died 3e71e5ddfd9f894cbe65bb02d48effcbfa90673899ff9b219a117802ceab3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:06 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:06.451+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:06 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:06.451+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:06 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:06.451+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:06 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:06.451+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:06.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:06 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:06.451+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:06.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:06 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:06.612+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:07.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:06 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:06.708+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:07.070 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:06 smithi148 podman[67990]: 2024-09-21 03:46:06.883940509 +0000 UTC m=+5.828428038 container cleanup 3e71e5ddfd9f894cbe65bb02d48effcbfa90673899ff9b219a117802ceab3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T03:46:07.070 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:06 smithi148 bash[67990]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8 2024-09-21T03:46:07.483 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68006]: 2024-09-21 03:46:07.068509368 +0000 UTC m=+0.592190788 container remove 3e71e5ddfd9f894cbe65bb02d48effcbfa90673899ff9b219a117802ceab3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.401919202 +0000 UTC m=+0.016121215 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.502540017 +0000 UTC m=+0.116742024 container create e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.730015277 +0000 UTC m=+0.344217291 container init e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.733245021 +0000 UTC m=+0.347447024 container start e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:07.482+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:07.482+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:07.482+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:07.735 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:07.482+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:07.736 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:07.482+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:07.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:07 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:07.630+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:07.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.821668302 +0000 UTC m=+0.435870309 container attach e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:07.994 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:07 smithi148 podman[68097]: 2024-09-21 03:46:07.929781115 +0000 UTC m=+0.543983121 container died e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:08.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:07 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:07.730+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:08.501 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T03:46:08.524 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:08 smithi148 podman[68120]: 2024-09-21 03:46:08.483770425 +0000 UTC m=+0.547586566 container remove e98d528ddb5ba619dd8b9aeac79c577a45081337da700fc247b63dea9bfc6f75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:46:08.524 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:08 smithi148 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.8.service: Deactivated successfully. 2024-09-21T03:46:08.524 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:08 smithi148 systemd[1]: Stopped Ceph osd.8 for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:46:08.524 INFO:journalctl@ceph.osd.8.smithi148.stdout:Sep 21 03:46:08 smithi148 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.8.service: Consumed 20.985s CPU time. 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:08.525 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:08 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:08.456+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:08.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:08.540 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T03:46:08.540 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T03:46:08.540 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.9 2024-09-21T03:46:08.844 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 systemd[1]: Stopping Ceph osd.9 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:08.844 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:08.844 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:08.844 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:08.844 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:08.845 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:08.845 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.620+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:08.845 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.841+0000 7f2043fa5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:08.845 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.841+0000 7f2043fa5640 -1 osd.9 94 *** Got signal Terminated *** 2024-09-21T03:46:08.845 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:08 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:08.841+0000 7f2043fa5640 -1 osd.9 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:09.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:08 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:08.760+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:09.708 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:09.708 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:09.709 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:09.709 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:09.709 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:09.709 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:09 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:09.420+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:09.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:09.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:09.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:09.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:09.954 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:09.954 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:09 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:09.586+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:10.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:09 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:09.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:10.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:10 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:10.375+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:10.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:10 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:10.575+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:11.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:10 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:10.748+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:11.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:11.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:11.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:11.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:11.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:11.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:11 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:11.355+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:11.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:11 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:11.598+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:12.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:11 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:11.743+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:12.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:12.403+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:12.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:12.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:12.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:12.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:12.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:12.954 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:12 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:12.647+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:13.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:12 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:12.745+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:13.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:13 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:13.441+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:44:59.291181+0000 front 2024-09-21T03:44:59.291296+0000 (oldest deadline 2024-09-21T03:45:24.591423+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:10.993004+0000 front 2024-09-21T03:45:10.993218+0000 (oldest deadline 2024-09-21T03:45:36.793459+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:16.793976+0000 front 2024-09-21T03:45:16.793952+0000 (oldest deadline 2024-09-21T03:45:41.493939+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:26.794850+0000 front 2024-09-21T03:45:26.794923+0000 (oldest deadline 2024-09-21T03:45:47.895017+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.796404+0000 front 2024-09-21T03:45:30.796588+0000 (oldest deadline 2024-09-21T03:46:00.796819+0000) 2024-09-21T03:46:13.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:13 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9[68347]: 2024-09-21T03:46:13.678+0000 7f203c588640 -1 osd.9 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:40.797623+0000 front 2024-09-21T03:45:40.797640+0000 (oldest deadline 2024-09-21T03:46:06.097410+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:14.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:13 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:13.737+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:14.653 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:14 smithi102 podman[109321]: 2024-09-21 03:46:14.350817234 +0000 UTC m=+5.614708132 container died 45a4cef0423b4fc26f9738781b068ebe770fe54d62c92455d1dea33c6fcf8733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:14.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:14.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:14.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:14.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:14.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:14.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:14 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:14.439+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:14.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:14 smithi102 podman[109321]: 2024-09-21 03:46:14.83350178 +0000 UTC m=+6.097392723 container cleanup 45a4cef0423b4fc26f9738781b068ebe770fe54d62c92455d1dea33c6fcf8733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T03:46:14.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:14 smithi102 bash[109321]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:15.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:14 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:14.767+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:15.388 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109336]: 2024-09-21 03:46:15.076846433 +0000 UTC m=+0.722200641 container remove 45a4cef0423b4fc26f9738781b068ebe770fe54d62c92455d1dea33c6fcf8733 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True) 2024-09-21T03:46:15.664 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.289979722 +0000 UTC m=+0.015745883 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:15.664 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.394151855 +0000 UTC m=+0.119918020 container create feb56945c5fd98d79d190bed02a29e23e9e83bdea0a13ae95c42d93355b40718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:15.664 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.596553261 +0000 UTC m=+0.322319427 container init feb56945c5fd98d79d190bed02a29e23e9e83bdea0a13ae95c42d93355b40718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T03:46:15.664 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.599743077 +0000 UTC m=+0.325509246 container start feb56945c5fd98d79d190bed02a29e23e9e83bdea0a13ae95c42d93355b40718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T03:46:15.665 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.663111316 +0000 UTC m=+0.388877494 container attach feb56945c5fd98d79d190bed02a29e23e9e83bdea0a13ae95c42d93355b40718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:15.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:15 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:15.480+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:15.953 INFO:journalctl@ceph.osd.9.smithi102.stdout:Sep 21 03:46:15 smithi102 podman[109426]: 2024-09-21 03:46:15.790161509 +0000 UTC m=+0.515927669 container died feb56945c5fd98d79d190bed02a29e23e9e83bdea0a13ae95c42d93355b40718 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:16.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:15 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:15.765+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:16.433 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T03:46:16.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:16.473 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T03:46:16.473 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T03:46:16.473 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.10 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:16.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:16.469+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:16.753 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 systemd[1]: Stopping Ceph osd.10 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.751+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.791+0000 7fd8f1f15640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.791+0000 7fd8f1f15640 -1 osd.10 94 *** Got signal Terminated *** 2024-09-21T03:46:17.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:16 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:16.791+0000 7fd8f1f15640 -1 osd.10 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:17.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:17 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:17.486+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:18.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:17 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:17.755+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:18.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:18.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:18.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:18.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:18.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:18.995 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:18 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:18.520+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:19.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:19.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:19.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:19.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:19.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:19.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:19.037 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:18 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:18.756+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:19.781 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:19.781 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:19.782 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:19.782 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:19.782 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:19.782 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:19 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:19.522+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:20.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:20.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:20.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:20.287 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:20.287 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:20.287 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:20.287 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:19 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:19.790+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:20.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:20.495+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:21.286 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:20 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:20.814+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:21.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:21 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:21.491+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.296591+0000 front 2024-09-21T03:45:00.296553+0000 (oldest deadline 2024-09-21T03:45:23.796510+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.597850+0000 front 2024-09-21T03:45:06.597951+0000 (oldest deadline 2024-09-21T03:45:32.998652+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:18.200244+0000 front 2024-09-21T03:45:18.200094+0000 (oldest deadline 2024-09-21T03:45:41.099993+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.401866+0000 front 2024-09-21T03:45:24.401847+0000 (oldest deadline 2024-09-21T03:45:47.901852+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:30.202538+0000 front 2024-09-21T03:45:30.202555+0000 (oldest deadline 2024-09-21T03:45:56.102617+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:42.404557+0000 front 2024-09-21T03:45:42.404646+0000 (oldest deadline 2024-09-21T03:46:05.304566+0000) 2024-09-21T03:46:22.036 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:21 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10[58384]: 2024-09-21T03:46:21.779+0000 7fd8ee500640 -1 osd.10 94 heartbeat_check: no reply from 172.21.15.102:6822 osd.6 since back 2024-09-21T03:45:45.805505+0000 front 2024-09-21T03:45:45.805458+0000 (oldest deadline 2024-09-21T03:46:11.705474+0000) 2024-09-21T03:46:22.443 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:22 smithi121 podman[68005]: 2024-09-21 03:46:22.18228703 +0000 UTC m=+5.508483403 container died 6c0443b1a8aea6b44e51eae917a60a0b5d1e04de5b7ad5b24f874231c57fdac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:46:22.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:22.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:22.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:22.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:22.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:22.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:22.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:22 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:22.473+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:22.787 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:22 smithi121 podman[68005]: 2024-09-21 03:46:22.541199609 +0000 UTC m=+5.867395972 container cleanup 6c0443b1a8aea6b44e51eae917a60a0b5d1e04de5b7ad5b24f874231c57fdac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T03:46:22.787 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:22 smithi121 bash[68005]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10 2024-09-21T03:46:23.132 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:22 smithi121 podman[68020]: 2024-09-21 03:46:22.825765708 +0000 UTC m=+0.636996877 container remove 6c0443b1a8aea6b44e51eae917a60a0b5d1e04de5b7ad5b24f874231c57fdac4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T03:46:23.388 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.033792158 +0000 UTC m=+0.015596941 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:23.388 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.168509398 +0000 UTC m=+0.150314182 container create e8d067baf96545b061a6c5b07bacaae4b5902c01e3224dd177a0bdf1c79d2e81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T03:46:23.389 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.387195173 +0000 UTC m=+0.368999957 container init e8d067baf96545b061a6c5b07bacaae4b5902c01e3224dd177a0bdf1c79d2e81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:23.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:23 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:23.440+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:23.785 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.39069745 +0000 UTC m=+0.372502239 container start e8d067baf96545b061a6c5b07bacaae4b5902c01e3224dd177a0bdf1c79d2e81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T03:46:23.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.46227585 +0000 UTC m=+0.444080649 container attach e8d067baf96545b061a6c5b07bacaae4b5902c01e3224dd177a0bdf1c79d2e81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:46:23.786 INFO:journalctl@ceph.osd.10.smithi121.stdout:Sep 21 03:46:23 smithi121 podman[68111]: 2024-09-21 03:46:23.576478459 +0000 UTC m=+0.558283251 container died e8d067baf96545b061a6c5b07bacaae4b5902c01e3224dd177a0bdf1c79d2e81 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T03:46:24.177 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T03:46:24.214 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:24.214 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T03:46:24.214 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T03:46:24.215 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.11 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 systemd[1]: Stopping Ceph osd.11 for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:24.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:24.495 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.410+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:24.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.526+0000 7f42ee9ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:24.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.526+0000 7f42ee9ce640 -1 osd.11 94 *** Got signal Terminated *** 2024-09-21T03:46:24.994 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:24 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:24.526+0000 7f42ee9ce640 -1 osd.11 94 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:25.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:25 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:25.429+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:26.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:26 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:26.437+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:27.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:27 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:27.477+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:28.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:28.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:28.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:28.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:28.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:28.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:28.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:28 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:28.489+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:29.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6806 osd.0 since back 2024-09-21T03:45:00.326810+0000 front 2024-09-21T03:45:00.326648+0000 (oldest deadline 2024-09-21T03:45:26.226842+0000) 2024-09-21T03:46:29.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-09-21T03:45:06.227394+0000 front 2024-09-21T03:45:06.227529+0000 (oldest deadline 2024-09-21T03:45:31.527284+0000) 2024-09-21T03:46:29.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6804 osd.2 since back 2024-09-21T03:45:14.428180+0000 front 2024-09-21T03:45:14.428316+0000 (oldest deadline 2024-09-21T03:45:39.728333+0000) 2024-09-21T03:46:29.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.102:6814 osd.3 since back 2024-09-21T03:45:24.329962+0000 front 2024-09-21T03:45:24.329947+0000 (oldest deadline 2024-09-21T03:45:47.229893+0000) 2024-09-21T03:46:29.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-09-21T03:45:31.930738+0000 front 2024-09-21T03:45:31.930761+0000 (oldest deadline 2024-09-21T03:45:55.430876+0000) 2024-09-21T03:46:29.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6812 osd.5 since back 2024-09-21T03:45:38.232568+0000 front 2024-09-21T03:45:38.232499+0000 (oldest deadline 2024-09-21T03:46:08.233086+0000) 2024-09-21T03:46:29.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-09-21T03:45:56.135650+0000 front 2024-09-21T03:45:56.135593+0000 (oldest deadline 2024-09-21T03:46:20.235506+0000) 2024-09-21T03:46:29.745 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11[59099]: 2024-09-21T03:46:29.462+0000 7f42e6fb1640 -1 osd.11 94 heartbeat_check: no reply from 172.21.15.148:6820 osd.8 since back 2024-09-21T03:46:05.536172+0000 front 2024-09-21T03:46:05.536193+0000 (oldest deadline 2024-09-21T03:46:29.036183+0000) 2024-09-21T03:46:30.140 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:29 smithi148 podman[68211]: 2024-09-21 03:46:29.877916425 +0000 UTC m=+5.468058503 container died 53642f093db4e29d03e9eb1711a1f664766ca0e716a085ef416445e8adea41fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:46:30.471 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68211]: 2024-09-21 03:46:30.243686505 +0000 UTC m=+5.833828570 container cleanup 53642f093db4e29d03e9eb1711a1f664766ca0e716a085ef416445e8adea41fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:46:30.471 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 bash[68211]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11 2024-09-21T03:46:30.744 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68229]: 2024-09-21 03:46:30.469738212 +0000 UTC m=+0.591425428 container remove 53642f093db4e29d03e9eb1711a1f664766ca0e716a085ef416445e8adea41fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T03:46:31.058 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68318]: 2024-09-21 03:46:30.688661722 +0000 UTC m=+0.015755712 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:46:31.058 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68318]: 2024-09-21 03:46:30.795723529 +0000 UTC m=+0.122817519 container create 948b251019d7a246e52e1b5f0a22b947ad465784e73bf246c178189db222bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:31.058 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68318]: 2024-09-21 03:46:30.989824637 +0000 UTC m=+0.316918626 container init 948b251019d7a246e52e1b5f0a22b947ad465784e73bf246c178189db222bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T03:46:31.058 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:30 smithi148 podman[68318]: 2024-09-21 03:46:30.993178373 +0000 UTC m=+0.320272363 container start 948b251019d7a246e52e1b5f0a22b947ad465784e73bf246c178189db222bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-21T03:46:31.058 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:31 smithi148 podman[68318]: 2024-09-21 03:46:31.056370495 +0000 UTC m=+0.383464493 container attach 948b251019d7a246e52e1b5f0a22b947ad465784e73bf246c178189db222bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:46:31.494 INFO:journalctl@ceph.osd.11.smithi148.stdout:Sep 21 03:46:31 smithi148 podman[68318]: 2024-09-21 03:46:31.183586964 +0000 UTC m=+0.510680953 container died 948b251019d7a246e52e1b5f0a22b947ad465784e73bf246c178189db222bdda (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T03:46:31.827 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T03:46:31.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:31.866 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T03:46:31.866 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T03:46:31.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.a 2024-09-21T03:46:32.203 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:31 smithi102 systemd[1]: Stopping Ceph mds.a for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:32.703 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:32 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a[75215]: 2024-09-21T03:46:32.223+0000 7f2677e96640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:32.703 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:32 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a[75215]: 2024-09-21T03:46:32.223+0000 7f2677e96640 -1 mds.a *** got signal Terminated *** 2024-09-21T03:46:36.453 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:36 smithi102 podman[109554]: 2024-09-21 03:46:36.168517287 +0000 UTC m=+4.109645117 container died f717343ee920feaf41c67396bc9eb4a01a2abbae40706dab12d9fc9b8589fb11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T03:46:36.896 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:36 smithi102 podman[109554]: 2024-09-21 03:46:36.618717081 +0000 UTC m=+4.559844911 container cleanup f717343ee920feaf41c67396bc9eb4a01a2abbae40706dab12d9fc9b8589fb11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T03:46:36.896 INFO:journalctl@ceph.mds.a.smithi102.stdout:Sep 21 03:46:36 smithi102 bash[109554]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-a 2024-09-21T03:46:37.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T03:46:37.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:37.089 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T03:46:37.089 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T03:46:37.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.d 2024-09-21T03:46:37.408 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:37 smithi102 systemd[1]: Stopping Ceph mds.d for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:37.703 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d[74094]: 2024-09-21T03:46:37.405+0000 7fd392c63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:37.703 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:37 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d[74094]: 2024-09-21T03:46:37.405+0000 7fd392c63640 -1 mds.d *** got signal Terminated *** 2024-09-21T03:46:41.203 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:40 smithi102 podman[109678]: 2024-09-21 03:46:40.9384373 +0000 UTC m=+3.634515360 container died 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:41.575 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:41 smithi102 podman[109678]: 2024-09-21 03:46:41.380960231 +0000 UTC m=+4.077038293 container cleanup 8f811a034a8d4ae681bee02972b178674ef8ba0910fb772f09beb4ca07feccb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T03:46:41.575 INFO:journalctl@ceph.mds.d.smithi102.stdout:Sep 21 03:46:41 smithi102 bash[109678]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-d 2024-09-21T03:46:41.802 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T03:46:41.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:41.834 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T03:46:41.834 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T03:46:41.835 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.g 2024-09-21T03:46:42.145 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:41 smithi102 systemd[1]: Stopping Ceph mds.g for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:42.453 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g[74836]: 2024-09-21T03:46:42.142+0000 7fd5e484c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:42.453 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:42 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g[74836]: 2024-09-21T03:46:42.142+0000 7fd5e484c640 -1 mds.g *** got signal Terminated *** 2024-09-21T03:46:44.912 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:44 smithi102 podman[109800]: 2024-09-21 03:46:44.632501438 +0000 UTC m=+2.583625369 container died d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T03:46:45.203 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:45 smithi102 podman[109800]: 2024-09-21 03:46:45.001269943 +0000 UTC m=+2.952393873 container cleanup d4683057eb1a5643e7fc37b4c624a965ff1612ac3df600e38780b6347a474446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T03:46:45.203 INFO:journalctl@ceph.mds.g.smithi102.stdout:Sep 21 03:46:45 smithi102 bash[109800]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-g 2024-09-21T03:46:45.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T03:46:45.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:45.423 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T03:46:45.423 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T03:46:45.423 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.j 2024-09-21T03:46:45.703 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:45 smithi102 systemd[1]: Stopping Ceph mds.j for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:46.203 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j[73727]: 2024-09-21T03:46:45.746+0000 7f75e7f76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:46.203 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:45 smithi102 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j[73727]: 2024-09-21T03:46:45.746+0000 7f75e7f76640 -1 mds.j *** got signal Terminated *** 2024-09-21T03:46:49.703 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:49 smithi102 podman[109921]: 2024-09-21 03:46:49.372794121 +0000 UTC m=+3.739916218 container died ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T03:46:49.974 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:49 smithi102 podman[109921]: 2024-09-21 03:46:49.804823961 +0000 UTC m=+4.171946051 container cleanup ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T03:46:49.974 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:49 smithi102 bash[109921]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j 2024-09-21T03:46:50.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T03:46:50.238 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:49 smithi102 podman[109933]: 2024-09-21 03:46:49.972838303 +0000 UTC m=+0.596908834 container remove ad24f03b47bc2bf2746d7356da63ec1271892d966df40118aab629076940c88e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:46:50.238 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:50 smithi102 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.j.service: Deactivated successfully. 2024-09-21T03:46:50.238 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:50 smithi102 systemd[1]: Stopped Ceph mds.j for a5dfbe26-77c8-11ef-baf5-efdc52797490. 2024-09-21T03:46:50.239 INFO:journalctl@ceph.mds.j.smithi102.stdout:Sep 21 03:46:50 smithi102 systemd[1]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.j.service: Consumed 1.034s CPU time. 2024-09-21T03:46:50.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:50.249 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T03:46:50.249 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T03:46:50.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.b 2024-09-21T03:46:50.536 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:50 smithi121 systemd[1]: Stopping Ceph mds.b for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:51.035 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: 2024-09-21T03:46:50.697+0000 7f8979d68640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:51.036 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:50 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b[63710]: 2024-09-21T03:46:50.697+0000 7f8979d68640 -1 mds.b *** got signal Terminated *** 2024-09-21T03:46:55.014 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:54 smithi121 podman[68226]: 2024-09-21 03:46:54.707069683 +0000 UTC m=+4.267105151 container died 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T03:46:55.286 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:55 smithi121 podman[68226]: 2024-09-21 03:46:55.013371594 +0000 UTC m=+4.573407061 container cleanup 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:46:55.286 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:55 smithi121 bash[68226]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b 2024-09-21T03:46:55.286 INFO:journalctl@ceph.mds.b.smithi121.stdout:Sep 21 03:46:55 smithi121 podman[68240]: 2024-09-21 03:46:55.256483273 +0000 UTC m=+0.542570517 container remove 1b0c74b8569b4ad8d2fb5ebdf73d8d0283ee8b76198c4a5243e6720acf7de60c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:46:55.385 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T03:46:55.420 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:55.420 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T03:46:55.420 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T03:46:55.421 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.e 2024-09-21T03:46:55.753 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:55 smithi121 systemd[1]: Stopping Ceph mds.e for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:46:56.035 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: 2024-09-21T03:46:55.750+0000 7f23300bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:46:56.036 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:55 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e[63164]: 2024-09-21T03:46:55.750+0000 7f23300bf640 -1 mds.e *** got signal Terminated *** 2024-09-21T03:46:59.335 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:59 smithi121 podman[68346]: 2024-09-21 03:46:59.037803676 +0000 UTC m=+3.391878133 container died 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T03:46:59.661 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:59 smithi121 podman[68346]: 2024-09-21 03:46:59.441869445 +0000 UTC m=+3.795943892 container cleanup 8cc48cda188d6f3b9b6daaab39a06fd814eb70c11fb64e5cfbf68d555a826533 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:46:59.661 INFO:journalctl@ceph.mds.e.smithi121.stdout:Sep 21 03:46:59 smithi121 bash[68346]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-e 2024-09-21T03:46:59.795 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T03:46:59.829 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:46:59.829 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T03:46:59.829 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T03:46:59.829 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.h 2024-09-21T03:47:00.035 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:46:59 smithi121 systemd[1]: Stopping Ceph mds.h for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:00.536 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: 2024-09-21T03:47:00.154+0000 7f19ae78b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:00.536 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:00 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h[63445]: 2024-09-21T03:47:00.154+0000 7f19ae78b640 -1 mds.h *** got signal Terminated *** 2024-09-21T03:47:03.373 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:03 smithi121 podman[68478]: 2024-09-21 03:47:03.041113217 +0000 UTC m=+2.994187023 container died 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T03:47:03.373 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:03 smithi121 podman[68478]: 2024-09-21 03:47:03.371861724 +0000 UTC m=+3.324935557 container cleanup 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T03:47:03.733 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:03 smithi121 bash[68478]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h 2024-09-21T03:47:03.733 INFO:journalctl@ceph.mds.h.smithi121.stdout:Sep 21 03:47:03 smithi121 podman[68490]: 2024-09-21 03:47:03.538290472 +0000 UTC m=+0.495218948 container remove 5bf6d72af172e60a77ce88d1a0608a45ee34086b0caf6cab4f2c949624933a8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-h, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:47:03.745 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T03:47:03.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:03.778 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T03:47:03.778 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T03:47:03.778 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.k 2024-09-21T03:47:04.036 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:03 smithi121 systemd[1]: Stopping Ceph mds.k for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:04.537 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k[62880]: 2024-09-21T03:47:04.132+0000 7f1e30d2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:04.538 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:04 smithi121 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k[62880]: 2024-09-21T03:47:04.132+0000 7f1e30d2b640 -1 mds.k *** got signal Terminated *** 2024-09-21T03:47:06.517 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:06 smithi121 podman[68596]: 2024-09-21 03:47:06.25363828 +0000 UTC m=+2.258500215 container died 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T03:47:06.786 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:06 smithi121 podman[68596]: 2024-09-21 03:47:06.59891982 +0000 UTC m=+2.603781745 container cleanup 31acd6426aa176e3638bfc94da6303a7cf6eeedcf03f4535a2e88f553135e17e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T03:47:06.786 INFO:journalctl@ceph.mds.k.smithi121.stdout:Sep 21 03:47:06 smithi121 bash[68596]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-k 2024-09-21T03:47:07.076 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T03:47:07.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:07.109 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T03:47:07.109 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T03:47:07.109 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.c 2024-09-21T03:47:07.395 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:07 smithi148 systemd[1]: Stopping Ceph mds.c for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:07.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: 2024-09-21T03:47:07.474+0000 7f482f57b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:07.744 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:07 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c[63768]: 2024-09-21T03:47:07.474+0000 7f482f57b640 -1 mds.c *** got signal Terminated *** 2024-09-21T03:47:11.328 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:11 smithi148 podman[68423]: 2024-09-21 03:47:11.043705692 +0000 UTC m=+3.741904708 container died 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:47:11.662 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:11 smithi148 podman[68423]: 2024-09-21 03:47:11.417244708 +0000 UTC m=+4.115443724 container cleanup 5ad41be66f81c8a3f85fd1f5a7b3683cca4a2e259a06e6c248af39e5b2db2939 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T03:47:11.662 INFO:journalctl@ceph.mds.c.smithi148.stdout:Sep 21 03:47:11 smithi148 bash[68423]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-c 2024-09-21T03:47:11.805 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T03:47:11.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:11.842 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T03:47:11.842 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T03:47:11.842 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.f 2024-09-21T03:47:12.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:11 smithi148 systemd[1]: Stopping Ceph mds.f for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:12.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: 2024-09-21T03:47:12.153+0000 7f3a3e565640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:12.244 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:12 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f[63501]: 2024-09-21T03:47:12.153+0000 7f3a3e565640 -1 mds.f *** got signal Terminated *** 2024-09-21T03:47:15.364 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:15 smithi148 podman[68559]: 2024-09-21 03:47:15.062710815 +0000 UTC m=+2.998527435 container died 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T03:47:15.706 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:15 smithi148 podman[68559]: 2024-09-21 03:47:15.462375995 +0000 UTC m=+3.398192615 container cleanup 7f64063aa051da69be99122af20643cddf15a3afd3c7a6f2ef5785d7331d87b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:47:15.706 INFO:journalctl@ceph.mds.f.smithi148.stdout:Sep 21 03:47:15 smithi148 bash[68559]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-f 2024-09-21T03:47:15.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T03:47:15.874 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:15.874 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T03:47:15.874 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T03:47:15.874 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.i 2024-09-21T03:47:15.994 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:15 smithi148 systemd[1]: Stopping Ceph mds.i for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:16.494 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: 2024-09-21T03:47:16.191+0000 7fb247831640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:16.494 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:16 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i[64047]: 2024-09-21T03:47:16.191+0000 7fb247831640 -1 mds.i *** got signal Terminated *** 2024-09-21T03:47:19.319 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:19 smithi148 podman[68681]: 2024-09-21 03:47:19.0677256 +0000 UTC m=+2.973563069 container died 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T03:47:19.744 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:19 smithi148 podman[68681]: 2024-09-21 03:47:19.407420894 +0000 UTC m=+3.313258314 container cleanup 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T03:47:19.744 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:19 smithi148 bash[68681]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i 2024-09-21T03:47:19.744 INFO:journalctl@ceph.mds.i.smithi148.stdout:Sep 21 03:47:19 smithi148 podman[68693]: 2024-09-21 03:47:19.558739766 +0000 UTC m=+0.483388387 container remove 2f4ae004e6584ea78e5a59c037ce8944d463b8820323600c1d580d56afe2d005 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-i, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:47:19.783 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T03:47:19.815 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:19.815 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T03:47:19.815 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T03:47:19.815 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.l 2024-09-21T03:47:20.129 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:19 smithi148 systemd[1]: Stopping Ceph mds.l for a5dfbe26-77c8-11ef-baf5-efdc52797490... 2024-09-21T03:47:20.494 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l[63230]: 2024-09-21T03:47:20.128+0000 7f8d5162b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:47:20.494 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:20 smithi148 ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l[63230]: 2024-09-21T03:47:20.128+0000 7f8d5162b640 -1 mds.l *** got signal Terminated *** 2024-09-21T03:47:23.796 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:23 smithi148 podman[68801]: 2024-09-21 03:47:23.530328235 +0000 UTC m=+3.498750851 container died 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:47:24.146 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:23 smithi148 podman[68801]: 2024-09-21 03:47:23.894134119 +0000 UTC m=+3.862556724 container cleanup 391456710c1fbadc21e67cedb2890bbfc08999cef0e5878514336cfe52999eb0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T03:47:24.146 INFO:journalctl@ceph.mds.l.smithi148.stdout:Sep 21 03:47:23 smithi148 bash[68801]: ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490-mds-l 2024-09-21T03:47:24.268 DEBUG:teuthology.orchestra.run.smithi148:> sudo pkill -f 'journalctl -f -n 0 -u ceph-a5dfbe26-77c8-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T03:47:24.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T03:47:24.300 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T03:47:24.300 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:47:24.498 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:47:27.035 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:47:27.235 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:47:29.761 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T03:47:29.963 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:47:32.436 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:47:32.468 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:47:32.500 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:47:32.527 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T03:47:32.529 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi102/crash 2024-09-21T03:47:32.530 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:47:32.557 INFO:teuthology.orchestra.run.smithi102.stderr:tar: /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:47:32.557 INFO:teuthology.orchestra.run.smithi102.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:47:32.559 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi121/crash 2024-09-21T03:47:32.560 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:47:32.599 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:47:32.599 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:47:32.601 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi148/crash 2024-09-21T03:47:32.601 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash -- . 2024-09-21T03:47:32.639 INFO:teuthology.orchestra.run.smithi148.stderr:tar: /var/lib/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T03:47:32.639 INFO:teuthology.orchestra.run.smithi148.stderr:tar: Error is not recoverable: exiting now 2024-09-21T03:47:32.640 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T03:47:32.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T03:47:32.681 INFO:tasks.cephadm:Compressing logs... 2024-09-21T03:47:32.682 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:47:32.724 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:47:32.727 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T03:47:32.747 INFO:teuthology.orchestra.run.smithi102.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T03:47:32.747 INFO:teuthology.orchestra.run.smithi102.stderr:: No such file or directory 2024-09-21T03:47:32.748 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T03:47:32.748 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:47:32.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:47:32.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T03:47:32.749 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:47:32.749 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T03:47:32.750 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T03:47:32.751 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.a.log: 84.2%gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T03:47:32.751 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:47:32.752 INFO:teuthology.orchestra.run.smithi148.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:47:32.752 INFO:teuthology.orchestra.run.smithi148.stderr:: No such file or directory 2024-09-21T03:47:32.752 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:47:32.752 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T03:47:32.752 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log: 95.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.d.log: 95.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr: 87.8% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T03:47:32.759 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T03:47:32.760 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:47:32.760 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T03:47:32.760 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr: 81.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr: 90.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log.gz/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log: 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr: 87.8% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T03:47:32.761 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T03:47:32.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.j.log: /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T03:47:32.766 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:47:32.766 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.3.log: 91.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:47:32.766 INFO:teuthology.orchestra.run.smithi102.stderr: 95.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T03:47:32.766 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:: No such file or directory 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log 2024-09-21T03:47:32.767 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.y.log: 95.0% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T03:47:32.772 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T03:47:32.772 INFO:teuthology.orchestra.run.smithi148.stderr: 90.9% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log.gzgzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T03:47:32.772 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T03:47:32.773 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi121.stderr: 90.9% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi121.stderr: 92.5% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T03:47:32.774 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T03:47:32.775 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T03:47:32.775 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.b.log: 87.9% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T03:47:32.780 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:47:32.784 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T03:47:32.799 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:47:32.802 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T03:47:33.118 INFO:teuthology.orchestra.run.smithi102.stderr: 90.3% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T03:47:33.171 INFO:teuthology.orchestra.run.smithi148.stderr: 91.7% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T03:47:33.182 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T03:47:33.611 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T03:47:33.975 INFO:teuthology.orchestra.run.smithi148.stderr: 95.6% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T03:47:33.998 INFO:teuthology.orchestra.run.smithi121.stderr: 95.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T03:47:35.051 INFO:teuthology.orchestra.run.smithi121.stderr: 95.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T03:47:35.731 INFO:teuthology.orchestra.run.smithi102.stderr: 92.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T03:47:35.932 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T03:47:36.236 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T03:47:36.260 INFO:teuthology.orchestra.run.smithi148.stderr: 92.2% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T03:47:36.293 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T03:47:36.566 INFO:teuthology.orchestra.run.smithi121.stderr: 91.6% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T03:47:37.008 INFO:teuthology.orchestra.run.smithi148.stderr: 91.6% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T03:47:37.132 INFO:teuthology.orchestra.run.smithi121.stderr: 92.1% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T03:47:37.217 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T03:47:37.219 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-21T03:47:37.219 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m4.482s 2024-09-21T03:47:37.219 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m14.895s 2024-09-21T03:47:37.219 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.486s 2024-09-21T03:47:37.518 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T03:47:37.687 INFO:teuthology.orchestra.run.smithi148.stderr: 91.8% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T03:47:38.211 INFO:teuthology.orchestra.run.smithi148.stderr: 91.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T03:47:44.719 INFO:teuthology.orchestra.run.smithi121.stderr: 93.3% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T03:47:44.721 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-09-21T03:47:44.721 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m11.980s 2024-09-21T03:47:44.721 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m31.405s 2024-09-21T03:47:44.721 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m0.958s 2024-09-21T03:47:44.972 INFO:teuthology.orchestra.run.smithi148.stderr: 93.4% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T03:48:01.521 INFO:teuthology.orchestra.run.smithi148.stderr: 93.3% -- replaced with /var/log/ceph/a5dfbe26-77c8-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T03:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr: 2024-09-21T03:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m28.782s 2024-09-21T03:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m58.905s 2024-09-21T03:48:01.523 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m1.782s 2024-09-21T03:48:01.523 INFO:tasks.cephadm:Archiving logs... 2024-09-21T03:48:01.523 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi102/log 2024-09-21T03:48:01.524 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:48:03.862 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi121/log 2024-09-21T03:48:03.862 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:48:07.984 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi148/log 2024-09-21T03:48:07.985 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T03:48:15.897 INFO:tasks.cephadm:Removing cluster... 2024-09-21T03:48:15.897 DEBUG:teuthology.orchestra.run.smithi102:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force 2024-09-21T03:48:16.097 INFO:teuthology.orchestra.run.smithi102.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:48:16.384 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force 2024-09-21T03:48:16.587 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:48:16.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid a5dfbe26-77c8-11ef-baf5-efdc52797490 --force 2024-09-21T03:48:17.132 INFO:teuthology.orchestra.run.smithi148.stdout:Deleting cluster with fsid: a5dfbe26-77c8-11ef-baf5-efdc52797490 2024-09-21T03:48:17.463 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T03:48:17.463 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:48:17.482 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:48:17.499 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T03:48:17.515 INFO:tasks.cephadm:Teardown complete 2024-09-21T03:48:17.515 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T03:48:17.529 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T03:48:17.529 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:48:17.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:48:17.541 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T03:48:17.655 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T03:48:17.664 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T03:48:17.665 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:17.667 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:17.670 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:17.681 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:17.683 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:17.684 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -456us[ -440us] +/- 61ms 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 11 +675us[ +675us] +/- 58ms 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -278us[ -262us] +/- 60ms 2024-09-21T03:48:17.686 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 7 377 74 -422us[ -422us] +/- 60ms 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 75 +735us[ +735us] +/- 57ms 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -217us[ -217us] +/- 60ms 2024-09-21T03:48:17.688 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 -468us[ -468us] +/- 61ms 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +598us[ +598us] +/- 58ms 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -263us[ -263us] +/- 60ms 2024-09-21T03:48:17.689 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:17.690 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T03:48:17.699 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T03:48:17.700 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T03:48:17.708 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:48:17.810 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:48:17.899 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T03:48:17.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:48:18.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:18.001 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:48:18.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:18.031 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:48:18.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:18.060 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T03:48:18.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T03:48:18.101 INFO:teuthology.task.internal:Duration was 1947.901633 seconds 2024-09-21T03:48:18.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T03:48:18.145 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T03:48:18.145 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:48:18.150 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:48:18.154 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T03:48:18.189 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:48:18.192 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:48:18.193 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:48:18.576 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T03:48:18.576 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-21T03:48:18.576 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:48:18.598 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-09-21T03:48:18.598 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:48:18.641 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2024-09-21T03:48:18.641 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T03:48:18.667 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T03:48:18.667 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:48:18.669 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:48:18.684 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T03:48:18.734 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T03:48:18.735 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:48:18.737 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:48:18.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T03:48:19.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T03:48:19.931 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T03:48:19.932 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:48:19.957 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:48:19.986 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T03:48:20.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T03:48:20.027 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.029 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.032 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.050 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-21T03:48:20.055 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-09-21T03:48:20.083 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2024-09-21T03:48:20.183 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:20.198 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:20.213 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T03:48:20.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:48:20.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T03:48:20.251 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T03:48:20.252 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi102 2024-09-21T03:48:20.252 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:48:20.313 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi121 2024-09-21T03:48:20.313 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:48:20.351 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913460/remote/smithi148 2024-09-21T03:48:20.351 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T03:48:20.388 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T03:48:20.389 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:48:20.391 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:48:20.394 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T03:48:20.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T03:48:20.451 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T03:48:20.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T03:48:20.462 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T03:48:20.463 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:48:20.465 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:48:20.467 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T03:48:20.477 INFO:teuthology.orchestra.run.smithi102.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:48 /home/ubuntu/cephtest 2024-09-21T03:48:20.480 INFO:teuthology.orchestra.run.smithi121.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:48 /home/ubuntu/cephtest 2024-09-21T03:48:20.495 INFO:teuthology.orchestra.run.smithi148.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 03:48 /home/ubuntu/cephtest 2024-09-21T03:48:20.496 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T03:48:20.508 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T03:48:20.533 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} duration: 1947.9016327857971 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T03:48:20.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:48:20.617 INFO:teuthology.run:pass